1663 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Kohya S	99744af53a	Merge branch 'dev' into sd3	2024-08-22 21:34:24 +09:00
Kohya S	afb971f9c3	fix SD1.5 LoRA extraction #1490	2024-08-22 21:33:15 +09:00
Kohya S	bf9f798985	chore: fix typos, remove debug print	2024-08-22 19:59:38 +09:00
Kohya S	b0a980844a	added a script to extract LoRA	2024-08-22 19:57:29 +09:00
Kohya S	2d8fa3387a	Fix to remove zero pad for t5xxl output	2024-08-22 19:56:27 +09:00
Kohya S	a4d27a232b	Fix --debug_dataset to work.	2024-08-22 19:55:31 +09:00
kohya-ss	98c91a7625	Fix bug in FLUX multi GPU training	2024-08-22 12:37:41 +09:00
Kohya S	e1cd19c0c0	add stochastic rounding, fix single block	2024-08-21 21:04:10 +09:00
Kohya S	2b07a92c8d	Fix error in applying mask in Attention and add LoRA converter script	2024-08-21 12:30:23 +09:00
Kohya S	e17c42cb0d	Add BFL/Diffusers LoRA converter #1467 #1458 #1483	2024-08-21 12:28:45 +09:00
Kohya S	7e459c00b2	Update T5 attention mask handling in FLUX	2024-08-21 08:02:33 +09:00
Kohya S	6ab48b09d8	feat: Support multi-resolution training with caching latents to disk	2024-08-20 21:39:43 +09:00
Kohya S.	388b3b4b74	Merge pull request #1482 from kohya-ss/flux-merge-lora ... Flux merge lora	2024-08-20 19:34:57 +09:00
Kohya S	dbed5126bd	chore: formatting	2024-08-20 19:33:47 +09:00
Kohya S	9381332020	revert merge function add add option to use new func	2024-08-20 19:32:26 +09:00
Kohya S	6f6faf9b5a	fix to work with ai-toolkit LoRA	2024-08-20 19:16:25 +09:00
Kohya S.	92b1f6d968	Merge pull request #1469 from exveria1015/sd3 ... Flux の LoRA マージ機能を修正	2024-08-20 19:06:06 +09:00
Kohya S	c62c95e862	update about multi-resolution training in FLUX.1	2024-08-20 08:21:01 +09:00
Kohya S	9e72be0a13	Fix debug_dataset to work	2024-08-20 08:19:00 +09:00
Kohya S	486fe8f70a	feat: reduce memory usage and add memory efficient option for model saving	2024-08-19 22:30:24 +09:00
Kohya S	6e72a799c8	reduce peak VRAM usage by excluding some blocks to cuda	2024-08-19 21:55:28 +09:00
Kohya S	d034032a5d	update README fix option name	2024-08-19 13:08:49 +09:00
Kohya S	a450488928	update readme	2024-08-18 16:56:50 +09:00
Kohya S	ef535ec6bb	add memory efficient training for FLUX.1	2024-08-18 16:54:18 +09:00
exveria1015	7e688913ae	fix: Flux の LoRA マージ機能を修正	2024-08-18 12:38:05 +09:00
kohya-ss	25f77f6ef0	fix flux fine tuning to work	2024-08-17 15:54:32 +09:00
Kohya S	400955d3ea	add fine tuning FLUX.1 (WIP)	2024-08-17 15:36:18 +09:00
Kohya S	7367584e67	fix sd3 training to work without cachine TE outputs #1465	2024-08-17 14:38:34 +09:00
Kohya S	e45d3f8634	add merge LoRA script	2024-08-16 22:19:21 +09:00
Kohya S	3921a4efda	add t5xxl max token length, support schnell	2024-08-16 17:06:05 +09:00
Kohya S.	739a8969bc	Merge pull request #1461 from fireicewolf/sd3-devel ... Fix AttributeError: 'FluxNetworkTrainer' object has no attribute 'sample_prompts_te_outputs'	2024-08-16 14:15:24 +09:00
DukeG	08ef886bfe	Fix AttributeError: 'FluxNetworkTrainer' object has no attribute 'sample_prompts_te_outputs' ... Move "self.sample_prompts_te_outputs = None" from Line 150 to Line 26.	2024-08-16 11:00:08 +08:00
Kohya S	35b6cb0cd1	update for torchvision	2024-08-15 22:07:35 +09:00
Kohya S	8aaa1967bd	fix encoding latents closes #1456	2024-08-15 22:07:23 +09:00
Kohya S.	e2d822cad7	Merge pull request #1452 from fireicewolf/sd3-devel ... Fix AttributeError: 'T5EncoderModel' object has no attribute 'text_model', while loading T5 model in GPU.	2024-08-15 21:12:19 +09:00
Kohya S	7db4222119	add sample image generation during training	2024-08-14 22:15:26 +09:00
DukeG	9760d097b0	Fix AttributeError: 'T5EncoderModel' object has no attribute 'text_model' ... While loading T5 model in GPU.	2024-08-14 19:58:54 +08:00
Kohya S	56d7651f08	add experimental split mode for FLUX	2024-08-13 22:28:39 +09:00
kohya-ss	9711c96f96	update README	2024-08-13 21:03:17 +09:00
kohya-ss	f5ce754bc2	Merge branch 'dev' into sd3	2024-08-13 21:00:44 +09:00
kohya-ss	4cf42cc5d4	Merge branch 'sd3' of https://github.com/kohya-ss/sd-scripts into sd3	2024-08-13 21:00:21 +09:00
kohya-ss	0415d200f5	update dependencies closes #1450	2024-08-13 21:00:16 +09:00
Kohya S	a7d5dabde3	Update readme	2024-08-12 17:09:19 +09:00
kohya-ss	4af36f9632	update to work interactive mode	2024-08-12 13:24:10 +09:00
Kohya S	9e09a69df1	update README	2024-08-12 08:19:45 +09:00
Kohya S	74f91c2ff7	correct option name closes #1446	2024-08-11 21:54:10 +09:00
Kohya S	d25ae361d0	fix apply_t5_attn_mask to work	2024-08-11 19:07:07 +09:00
Kohya S	82314ac2e7	update readme for ai toolkit settings	2024-08-11 11:14:08 +09:00
Kohya S	8a0f12dde8	update FLUX LoRA training	2024-08-10 23:42:05 +09:00
Kohya S	358f13f2c9	fix alpha is ignored	2024-08-10 14:03:59 +09:00