2451 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
DKnight54	381303d64f	Update train_network.py	2025-03-29 02:26:18 +08:00
rockerBOO	0181b7a042	Remove progress bar avg norms	2025-03-27 03:28:33 -04:00
rockerBOO	182544dcce	Remove pertubation seed	2025-03-26 14:23:04 -04:00
Kohya S	8ebe858f89	Merge branch 'dev' into sd3	2025-03-24 22:02:16 +09:00
Kohya S.	a0f11730f7	Merge pull request #1966 from sdbds/faster_fix_sdxl ... Fatser fix bug for SDXL super SD1.5 assert cant use 32	2025-03-24 21:53:42 +09:00
青龍聖者@bdsqlsz	30008168e3	Merge pull request #24 from rockerBOO/lumina-fix-max-norms ... Fix max norms not applying to noise	2025-03-22 14:59:10 +08:00
青龍聖者@bdsqlsz	1481217eb2	Merge pull request #25 from rockerBOO/lumina-fix-non-cache-image-vae-encode ... Fix non-cache vae encode	2025-03-22 14:58:52 +08:00
rockerBOO	61f7283167	Fix non-cache vae encode	2025-03-21 20:38:43 -04:00
rockerBOO	2ba1cc7791	Fix max norms not applying to noise	2025-03-21 20:17:22 -04:00
Kohya S	6364379f17	Merge branch 'dev' into sd3	2025-03-21 22:07:50 +09:00
Kohya S	5253a38783	Merge branch 'main' into dev	2025-03-21 22:07:03 +09:00
Kohya S	8f4ee8fc34	doc: update README for latest v0.9.1	2025-03-21 22:05:48 +09:00
Kohya S.	367f348430	Merge pull request #1964 from Nekotekina/main ... Fix missing text encoder attn modules	2025-03-21 21:59:03 +09:00
rockerBOO	89f0d27a59	Set sigmoid_scale to default 1.0	2025-03-20 15:10:33 -04:00
rockerBOO	d40f5b1e4e	Revert "Scale sigmoid to default 1.0" ... This reverts commit 8aa126582e.	2025-03-20 15:09:50 -04:00
rockerBOO	8aa126582e	Scale sigmoid to default 1.0	2025-03-20 15:09:11 -04:00
rockerBOO	e8b3254858	Add flux_train_utils tests for get get_noisy_model_input_and_timesteps	2025-03-20 15:01:15 -04:00
rockerBOO	16cef81aea	Refactor sigmas and timesteps	2025-03-20 14:32:56 -04:00
Kohya S	d151833526	docs: update README with recent changes and specify version for pytorch-optimizer	2025-03-20 22:05:29 +09:00
Kohya S.	936d333ff4	Merge pull request #1985 from gesen2egee/pytorch-optimizer ... Support pytorch_optimizer	2025-03-20 22:01:03 +09:00
rockerBOO	f974c6b257	change order to match upstream	2025-03-19 14:27:43 -04:00
rockerBOO	5d5a7d2acf	Fix IP noise calculation	2025-03-19 13:50:04 -04:00
rockerBOO	1eddac26b0	Separate random to a variable, and make sure on device	2025-03-19 00:49:42 -04:00
rockerBOO	8e6817b0c2	Remove double noise	2025-03-19 00:45:13 -04:00
rockerBOO	d93ad90a71	Add perturbation on noisy_model_input if needed	2025-03-19 00:37:27 -04:00
rockerBOO	7197266703	Perturbed noise should be separate of input noise	2025-03-19 00:25:51 -04:00
gesen2egee	5b210ad717	update prodigyopt and prodigy-plus-schedule-free	2025-03-19 10:49:06 +08:00
rockerBOO	b81bcd0b01	Move IP noise gamma to noise creation to remove complexity and align noise for target loss	2025-03-18 21:36:55 -04:00
rockerBOO	6f4d365775	zeros_like because we are adding	2025-03-18 18:53:34 -04:00
rockerBOO	a4f3a9fc1a	Use ones_like	2025-03-18 18:44:21 -04:00
rockerBOO	b425466e7b	Fix IP noise gamma to use random values	2025-03-18 18:42:35 -04:00
rockerBOO	c8be141ae0	Apply IP gamma to noise fix	2025-03-18 15:42:18 -04:00
rockerBOO	0b25a05e3c	Add IP noise gamma for Flux	2025-03-18 15:40:40 -04:00
rockerBOO	3647d065b5	Cache weight norms estimate on initialization. Move to update norms every step	2025-03-18 14:25:09 -04:00
Disty0	620a06f517	Check for uppercase file extension too	2025-03-17 17:44:29 +03:00
Disty0	564ec5fb7f	use extend instead of +=	2025-03-17 17:41:03 +03:00
Disty0	7e90cdd47a	use bytearray and add typing hints	2025-03-17 17:26:08 +03:00
gesen2egee	e5b5c7e1db	Update requirements.txt	2025-03-15 13:29:32 +08:00
青龍聖者@bdsqlsz	7482784f74	Merge pull request #23 from rockerBOO/lumina-lora ... Lumina lora updates	2025-03-09 21:04:45 +08:00
rockerBOO	ea53290f62	Add LoRA-GGPO for Flux	2025-03-06 00:00:38 -05:00
Kohya S.	75933d70a1	Merge pull request #1960 from kohya-ss/sd3_safetensors_merge ... Sd3 safetensors merge	2025-03-05 23:28:38 +09:00
Kohya S	aa2bde7ece	docs: add utility script for merging SD3 weights into a single .safetensors file	2025-03-05 23:24:52 +09:00
rockerBOO	e8c15c7167	Remove log	2025-03-04 02:30:08 -05:00
rockerBOO	9fe8a47080	Undo dropout after up	2025-03-04 02:28:56 -05:00
rockerBOO	1f22a94cfe	Update embedder_dims, add more flexible caption extension	2025-03-04 02:25:50 -05:00
sdbds	5e45df722d	update gemma2 train attention layer	2025-03-04 08:07:33 +08:00
青龍聖者@bdsqlsz	09c4710d1e	Merge pull request #22 from rockerBOO/sage_attn ... Add Sage Attention for Lumina	2025-03-03 10:26:02 +08:00
sdbds	3f49053c90	fatser fix bug for SDXL super SD1.5 assert cant use 32	2025-03-02 19:32:06 +08:00
青龍聖者@bdsqlsz	dfe1ab6c50	Merge pull request #21 from rockerBOO/lumina-torch-dynamo-gemma2 ... fix torch compile/dynamo for Gemma2	2025-03-02 18:31:13 +08:00
青龍聖者@bdsqlsz	b6e4194ea5	Merge pull request #20 from rockerBOO/lumina-system-prompt-special-token ... Lumina system prompt special token	2025-03-02 18:30:49 +08:00