324 Commits

Author	SHA1	Message	Date
Kohya S	90ed2dfb52	feat: Add support for merging CLIP-L and T5XXL LoRA models	2024-09-05 08:39:29 +09:00
Kohya S	b7cff0a754	update README	2024-09-04 21:35:47 +09:00
Kohya S	b65ae9b439	T5XXL LoRA training, fp8 T5XXL support	2024-09-04 21:33:17 +09:00
Kohya S	6abacf04da	update README	2024-09-02 13:05:26 +09:00
Kohya S	4f6d915d15	update help and README	2024-09-01 19:12:29 +09:00
Kohya S	92e7600cc2	Move freeze_blocks to sd3_train because it's only for sd3	2024-09-01 18:57:07 +09:00
Kohya S	8fdfd8c857	Update safetensors to version 0.4.4 in requirements.txt #1524	2024-08-29 22:26:29 +09:00
Kohya S.	daa6ad5165	Update README.md	2024-08-29 21:25:30 +09:00
Kohya S	a0cfb0894c	Cleaned up README	2024-08-29 21:20:33 +09:00
Kohya S	a61cf73a5c	update readme	2024-08-27 21:44:10 +09:00
Kohya S	3be712e3e0	feat: Update direct loading fp8 ckpt for LoRA training	2024-08-27 21:40:02 +09:00
Kohya S	0087a46e14	FLUX.1 LoRA supports CLIP-L	2024-08-27 19:59:40 +09:00
Kohya S	72287d39c7	feat: Add shift option to --timestep_sampling in FLUX.1 fine-tuning and LoRA training	2024-08-25 16:01:24 +09:00
Kohya S	ea9242653c	Merge branch 'dev' into sd3	2024-08-24 21:24:44 +09:00
Kohya S	d5c076cf90	update readme	2024-08-24 21:21:39 +09:00
Kohya S	cf689e7aa6	feat: Add option to split projection layers and apply LoRA	2024-08-24 16:35:43 +09:00
Kohya S	2e89cd2cc6	Fix issue with attention mask not being applied in single blocks	2024-08-24 12:39:54 +09:00
Kohya S	2d8fa3387a	Fix to remove zero pad for t5xxl output	2024-08-22 19:56:27 +09:00
kohya-ss	98c91a7625	Fix bug in FLUX multi GPU training	2024-08-22 12:37:41 +09:00
Kohya S	e1cd19c0c0	add stochastic rounding, fix single block	2024-08-21 21:04:10 +09:00
Kohya S	2b07a92c8d	Fix error in applying mask in Attention and add LoRA converter script	2024-08-21 12:30:23 +09:00
Kohya S	7e459c00b2	Update T5 attention mask handling in FLUX	2024-08-21 08:02:33 +09:00
Kohya S	6ab48b09d8	feat: Support multi-resolution training with caching latents to disk	2024-08-20 21:39:43 +09:00
Kohya S	9381332020	revert merge function add add option to use new func	2024-08-20 19:32:26 +09:00
Kohya S	c62c95e862	update about multi-resolution training in FLUX.1	2024-08-20 08:21:01 +09:00
Kohya S	486fe8f70a	feat: reduce memory usage and add memory efficient option for model saving	2024-08-19 22:30:24 +09:00
Kohya S	d034032a5d	update README fix option name	2024-08-19 13:08:49 +09:00
Kohya S	a450488928	update readme	2024-08-18 16:56:50 +09:00
Kohya S	ef535ec6bb	add memory efficient training for FLUX.1	2024-08-18 16:54:18 +09:00
kohya-ss	25f77f6ef0	fix flux fine tuning to work	2024-08-17 15:54:32 +09:00
Kohya S	e45d3f8634	add merge LoRA script	2024-08-16 22:19:21 +09:00
Kohya S	3921a4efda	add t5xxl max token length, support schnell	2024-08-16 17:06:05 +09:00
Kohya S	35b6cb0cd1	update for torchvision	2024-08-15 22:07:35 +09:00
Kohya S	7db4222119	add sample image generation during training	2024-08-14 22:15:26 +09:00
Kohya S	56d7651f08	add experimental split mode for FLUX	2024-08-13 22:28:39 +09:00
kohya-ss	9711c96f96	update README	2024-08-13 21:03:17 +09:00
Kohya S	a7d5dabde3	Update readme	2024-08-12 17:09:19 +09:00
kohya-ss	4af36f9632	update to work interactive mode	2024-08-12 13:24:10 +09:00
Kohya S	9e09a69df1	update README	2024-08-12 08:19:45 +09:00
Kohya S	d25ae361d0	fix apply_t5_attn_mask to work	2024-08-11 19:07:07 +09:00
Kohya S	82314ac2e7	update readme for ai toolkit settings	2024-08-11 11:14:08 +09:00
Kohya S	8a0f12dde8	update FLUX LoRA training	2024-08-10 23:42:05 +09:00
Kohya S	36b2e6fc28	add FLUX.1 LoRA training	2024-08-09 22:56:48 +09:00
Kohya S	41dee60383	Refactor caching mechanism for latents and text encoder outputs, etc.	2024-07-27 13:50:05 +09:00
Kohya S	b8896aad40	update README	2024-07-11 08:01:23 +09:00
Kohya S	19086465e8	Fix fp16 mixed precision, model is in bf16 without full_bf16	2024-06-29 17:21:25 +09:00
Kohya S	d53ea22b2a	sd3 training	2024-06-23 23:38:20 +09:00
Kohya S	9dd1ee458c	Merge branch 'main' into dev	2024-06-23 14:11:51 +09:00
Kohya S	25f961bc77	fix to work cache_latents/text_encoder_outputs	2024-06-23 13:24:30 +09:00
Kohya S	18d7597b0b	update README	2024-06-11 19:51:30 +09:00