22 Commits

Author	SHA1	Message	Date
rockerBOO	9647f1e324	Fix validation block swap. Add custom offloading tests	2025-02-27 20:36:36 -05:00
Kohya S	6bee18db4f	fix: resolve model corruption issue with pos_embed when using --enable_scaled_pos_embed	2024-12-07 15:12:27 +09:00
Kohya S	9c885e549d	fix: improve pos_embed handling for oversized images and update resolution_area_to_latent_size, when sample image size > train image size	2024-11-30 18:25:50 +09:00
Kohya S	2cb7a6db02	feat: add block swap for FLUX.1/SD3 LoRA training	2024-11-12 21:39:13 +09:00
Kohya S	5e86323f12	Update README and clean-up the code for SD3 timesteps	2024-11-07 21:27:12 +09:00
Kohya S	82daa98fe8	remove duplicate resolution for scaled pos embed	2024-11-01 21:43:47 +09:00
Kohya S	830df4abcc	Fix crashing if image is too tall or wide.	2024-10-31 21:39:07 +09:00
Kohya S	1434d8506f	Support SD3.5M multi resolutional training	2024-10-31 19:58:22 +09:00
Kohya S	70a179e446	Fix to use SDPA instead of xformers	2024-10-30 14:34:19 +09:00
Kohya S	bdddc20d68	support SD3.5M	2024-10-30 12:51:49 +09:00
kohya-ss	d2c549d7b2	support SD3 LoRA	2024-10-25 21:58:31 +09:00
Kohya S	f8c5146d71	support block swap with fused_optimizer_pass	2024-10-24 22:02:05 +09:00
Kohya S	623017f716	refactor SD3 CLIP to transformers etc.	2024-10-24 19:49:28 +09:00
Kohya S	36b2e6fc28	add FLUX.1 LoRA training	2024-08-09 22:56:48 +09:00
Kohya S	41dee60383	Refactor caching mechanism for latents and text encoder outputs, etc.	2024-07-27 13:50:05 +09:00
Kohya S	082f13658b	reduce peak GPU memory usage before training	2024-07-12 21:28:01 +09:00
Kohya S	9dc7997803	fix typo	2024-07-09 20:37:00 +09:00
Kohya S	50e3d62474	fix to work T5XXL with fp16	2024-07-08 19:46:23 +09:00
Kohya S	ea18d5ba6d	Fix to work full_bf16 and full_fp16.	2024-06-29 17:45:50 +09:00
Kohya S	4802e4aaec	workaround for long caption ref #1382	2024-06-24 23:13:14 +09:00
Kohya S	d53ea22b2a	sd3 training	2024-06-23 23:38:20 +09:00
Kohya S	e5268286bf	add sd3 models and inference script	2024-06-15 22:20:24 +09:00