337 Commits

Author	SHA1	Message	Date
Kohya S	b755ebd0a4	add LBW support for SDXL merge LoRA	2024-09-13 21:29:31 +09:00
Kohya S	f3ce80ef8f	Merge branch 'dev' into sd3	2024-09-13 19:49:16 +09:00
Kohya S	9d2860760d	Merge branch 'main' into dev	2024-09-13 19:48:53 +09:00
Kohya S	3387dc7306	formatting, update README	2024-09-13 19:45:42 +09:00
Kohya S	237317fffd	update README	2024-09-11 22:23:43 +09:00
Kohya S	eaafa5c9da	Merge branch 'dev' into sd3	2024-09-11 21:46:21 +09:00
Kohya S	6dbfd47a59	Fix to work PIECEWISE_CONSTANT, update requirement.txt and README #1393	2024-09-11 21:44:36 +09:00
Kohya S	65b8a064f6	update README	2024-09-10 21:20:38 +09:00
Kohya S	d10ff62a78	support individual LR for CLIP-L/T5XXL	2024-09-10 20:32:09 +09:00
Kohya S	d29af146b8	add negative prompt for flux inference script	2024-09-09 23:01:15 +09:00
Kohya S	ce144476cf	Merge branch 'dev' into sd3	2024-09-07 10:59:22 +09:00
Kohya S	0005867ba5	update README, format code	2024-09-07 10:45:18 +09:00
Kohya S	2889108d85	feat: Add --cpu_offload_checkpointing option to LoRA training	2024-09-05 20:58:33 +09:00
Kohya S	90ed2dfb52	feat: Add support for merging CLIP-L and T5XXL LoRA models	2024-09-05 08:39:29 +09:00
Kohya S	b7cff0a754	update README	2024-09-04 21:35:47 +09:00
Kohya S	b65ae9b439	T5XXL LoRA training, fp8 T5XXL support	2024-09-04 21:33:17 +09:00
Kohya S	6abacf04da	update README	2024-09-02 13:05:26 +09:00
Kohya S	4f6d915d15	update help and README	2024-09-01 19:12:29 +09:00
Kohya S	92e7600cc2	Move freeze_blocks to sd3_train because it's only for sd3	2024-09-01 18:57:07 +09:00
Kohya S	8fdfd8c857	Update safetensors to version 0.4.4 in requirements.txt #1524	2024-08-29 22:26:29 +09:00
Kohya S.	daa6ad5165	Update README.md	2024-08-29 21:25:30 +09:00
Kohya S	a0cfb0894c	Cleaned up README	2024-08-29 21:20:33 +09:00
Kohya S	a61cf73a5c	update readme	2024-08-27 21:44:10 +09:00
Kohya S	3be712e3e0	feat: Update direct loading fp8 ckpt for LoRA training	2024-08-27 21:40:02 +09:00
Kohya S	0087a46e14	FLUX.1 LoRA supports CLIP-L	2024-08-27 19:59:40 +09:00
Kohya S	72287d39c7	feat: Add shift option to --timestep_sampling in FLUX.1 fine-tuning and LoRA training	2024-08-25 16:01:24 +09:00
Kohya S	ea9242653c	Merge branch 'dev' into sd3	2024-08-24 21:24:44 +09:00
Kohya S	d5c076cf90	update readme	2024-08-24 21:21:39 +09:00
Kohya S	cf689e7aa6	feat: Add option to split projection layers and apply LoRA	2024-08-24 16:35:43 +09:00
Kohya S	2e89cd2cc6	Fix issue with attention mask not being applied in single blocks	2024-08-24 12:39:54 +09:00
Kohya S	2d8fa3387a	Fix to remove zero pad for t5xxl output	2024-08-22 19:56:27 +09:00
kohya-ss	98c91a7625	Fix bug in FLUX multi GPU training	2024-08-22 12:37:41 +09:00
Kohya S	e1cd19c0c0	add stochastic rounding, fix single block	2024-08-21 21:04:10 +09:00
Kohya S	2b07a92c8d	Fix error in applying mask in Attention and add LoRA converter script	2024-08-21 12:30:23 +09:00
Kohya S	7e459c00b2	Update T5 attention mask handling in FLUX	2024-08-21 08:02:33 +09:00
Kohya S	6ab48b09d8	feat: Support multi-resolution training with caching latents to disk	2024-08-20 21:39:43 +09:00
Kohya S	9381332020	revert merge function add add option to use new func	2024-08-20 19:32:26 +09:00
Kohya S	c62c95e862	update about multi-resolution training in FLUX.1	2024-08-20 08:21:01 +09:00
Kohya S	486fe8f70a	feat: reduce memory usage and add memory efficient option for model saving	2024-08-19 22:30:24 +09:00
Kohya S	d034032a5d	update README fix option name	2024-08-19 13:08:49 +09:00
Kohya S	a450488928	update readme	2024-08-18 16:56:50 +09:00
Kohya S	ef535ec6bb	add memory efficient training for FLUX.1	2024-08-18 16:54:18 +09:00
kohya-ss	25f77f6ef0	fix flux fine tuning to work	2024-08-17 15:54:32 +09:00
Kohya S	e45d3f8634	add merge LoRA script	2024-08-16 22:19:21 +09:00
Kohya S	3921a4efda	add t5xxl max token length, support schnell	2024-08-16 17:06:05 +09:00
Kohya S	35b6cb0cd1	update for torchvision	2024-08-15 22:07:35 +09:00
Kohya S	7db4222119	add sample image generation during training	2024-08-14 22:15:26 +09:00
Kohya S	56d7651f08	add experimental split mode for FLUX	2024-08-13 22:28:39 +09:00
kohya-ss	9711c96f96	update README	2024-08-13 21:03:17 +09:00
Kohya S	a7d5dabde3	Update readme	2024-08-12 17:09:19 +09:00