1949 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Kohya S	ca44e3e447	reduce VRAM usage, instead of increasing main RAM usage	2024-10-27 10:19:05 +09:00
Kohya S	150579db32	Merge branch 'sd3' into sd3_5_support	2024-10-26 22:03:41 +09:00
Kohya S	8549669f89	Merge branch 'dev' into sd3	2024-10-26 22:02:57 +09:00
Kohya S	900d551a6a	Merge branch 'main' into dev	2024-10-26 22:02:36 +09:00
Kohya S	56b4ea963e	Fix LoRA metadata hash calculation bug in svd_merge_lora.py, sdxl_merge_lora.py, and resize_lora.py closes #1722	2024-10-26 22:01:10 +09:00
kohya-ss	014064fd81	fix sample image generation without seed failed close #1726	2024-10-26 18:59:45 +09:00
kohya-ss	56bf761164	fix errors in SD3 LoRA training with Text Encoders close #1724	2024-10-26 17:29:24 +09:00
kohya-ss	0031d916f0	add latent scaling/shifting	2024-10-25 23:20:38 +09:00
kohya-ss	d2c549d7b2	support SD3 LoRA	2024-10-25 21:58:31 +09:00
Kohya S	f52fb66e8f	Merge branch 'sd3' into sd3_5_support	2024-10-25 19:03:58 +09:00
Kohya S	5fba6f514a	Merge branch 'dev' into sd3	2024-10-25 19:03:27 +09:00
Kohya S	b1e6504007	update README	2024-10-25 18:56:25 +09:00
Kohya S.	b8ae745d0c	Merge pull request #1717 from catboxanon/fix/remove-vpred-warnings ... Remove v-pred warnings	2024-10-25 18:49:40 +09:00
Kohya S.	c632af860e	Merge pull request #1715 from catboxanon/vpred-ztsnr-fixes ... Update debiased estimation loss function to accommodate V-pred	2024-10-25 18:48:14 +09:00
Kohya S	f8c5146d71	support block swap with fused_optimizer_pass	2024-10-24 22:02:05 +09:00
Kohya S	0286114bd2	support SD3.5L, fix final saving	2024-10-24 21:28:42 +09:00
Kohya S	e3c43bda49	reduce memory usage in sample image generation	2024-10-24 20:35:47 +09:00
Kohya S	623017f716	refactor SD3 CLIP to transformers etc.	2024-10-24 19:49:28 +09:00
catboxanon	be14c06267	Remove v-pred warnings ... Different model architectures, such as SDXL, can take advantage of v-pred. It doesn't make sense to include these warnings anymore.	2024-10-22 12:13:51 -04:00
catboxanon	0e7c592933	Remove scale_v_pred_loss_like_noise_pred deprecation ... https://github.com/kohya-ss/sd-scripts/pull/1715#issuecomment-2427876376	2024-10-22 11:19:34 -04:00
catboxanon	e1b63c2249	Only add warning for deprecated scaling vpred loss function	2024-10-21 08:12:53 -04:00
catboxanon	8fc30f8205	Fix training for V-pred and ztSNR ... 1) Updates debiased estimation loss function for V-pred. 2) Prevents now-deprecated scaling of loss if ztSNR is enabled.	2024-10-21 07:34:33 -04:00
Kohya S	138dac4aea	update README	2024-10-20 09:22:38 +09:00
Kohya S	7fe8e162cb	fix to work ControlNetSubset with custom_attributes	2024-10-20 08:45:27 +09:00
Kohya S.	aa932429d1	Merge pull request #1710 from kohya-ss/diff_output_prsv ... Differential Output Preservation loss for LoRA	2024-10-19 19:56:13 +09:00
Kohya S	09b4d1e9b6	Merge branch 'sd3' into diff_output_prsv	2024-10-19 19:30:23 +09:00
kohya-ss	2c45d979e6	update README, remove unnecessary autocast	2024-10-19 19:21:12 +09:00
kohya-ss	ef70aa7b42	add FLUX.1 support	2024-10-18 23:39:48 +09:00
Kohya S	d8d7142665	fix to work caching latents #1696	2024-10-18 23:16:30 +09:00
Kohya S	3cc5b8db99	Diff Output Preserv loss for SDXL	2024-10-18 20:57:13 +09:00
Kohya S	2500f5a798	fix latents caching not working closes #1696	2024-10-15 07:16:34 +09:00
Kohya S.	1275e148df	Merge pull request #1690 from kohya-ss/multi-gpu-caching ... Caching latents and Text Encoder outputs with multiple GPUs	2024-10-13 19:25:59 +09:00
kohya-ss	2d5f7fa709	update README	2024-10-13 19:23:21 +09:00
kohya-ss	886ffb4d65	Merge branch 'sd3' into multi-gpu-caching	2024-10-13 19:14:06 +09:00
Kohya S.	d02a6ef7c4	Merge pull request #1660 from kohya-ss/fast_image_sizes ... Fast image sizes	2024-10-13 19:11:37 +09:00
kohya-ss	bfc3a65acd	fix to work cache latents/text encoder outputs	2024-10-13 19:08:16 +09:00
kohya-ss	2244cf5b83	load images in parallel when caching latents	2024-10-13 18:22:19 +09:00
Kohya S	c65cf3812d	Merge branch 'sd3' into fast_image_sizes	2024-10-13 17:31:11 +09:00
kohya-ss	74228c9953	update cache_latents/text_encoder_outputs	2024-10-13 16:27:22 +09:00
kohya-ss	5bb9f7fb1a	Merge branch 'sd3' into multi-gpu-caching	2024-10-13 11:52:42 +09:00
Kohya S	e277b5789e	Update FLUX.1 support for compact models	2024-10-12 21:49:07 +09:00
kohya-ss	ecaea909b1	update README	2024-10-12 20:26:57 +09:00
kohya-ss	c80c304779	Refactor caching in train scripts	2024-10-12 20:18:41 +09:00
kohya-ss	ff4083b910	Merge branch 'sd3' into multi-gpu-caching	2024-10-12 16:39:36 +09:00
kohya-ss	0d3058b65a	update README	2024-10-12 14:46:35 +09:00
Kohya S.	d005652d03	Merge pull request #1686 from Akegarasu/sd3 ... fix: fix some distributed training error in windows	2024-10-12 14:33:02 +09:00
Kohya S.	43bfeea600	Merge pull request #1655 from kohya-ss/sdxl-ctrl-net ... ControlNet training for SDXL	2024-10-11 22:27:53 +09:00
Kohya S	035c4a8552	update docs and help text	2024-10-11 22:23:15 +09:00
Kohya S	f2bc820133	support weighted captions for SD/SDXL	2024-10-11 08:48:55 +09:00
Akegarasu	9f4dac5731	torch 2.4	2024-10-10 14:08:55 +08:00