Commit Graph

  • 2a188f07e6 Fix to work DOP with bock swap Kohya S 2024-11-17 16:12:10 +09:00
  • e358b118af fix dataloader minux302 2024-11-16 14:49:29 +09:00
  • 42f6edf3a8 fix for adding controlnet minux302 2024-11-15 23:48:51 +09:00
  • bdac55ebbc feat: refactor latent cache format Kohya S 2024-11-15 21:16:49 +09:00
  • ccfaa001e7 add flux controlnet base module minux302 2024-11-15 20:21:28 +09:00
  • 0047bb1fc3 Merge pull request #1779 from kohya-ss/faster-block-swap Kohya S. 2024-11-14 19:47:10 +09:00
  • fd2d879ac8 docs: update README Kohya S 2024-11-14 19:43:08 +09:00
  • 5c5b544b91 refactor: remove unused prepare_split_model method from FluxNetworkTrainer Kohya S 2024-11-14 19:35:43 +09:00
  • 2bb0f547d7 update grad hook creation to fix TE lr in sd3 fine tuning Kohya S 2024-11-14 19:33:12 +09:00
  • 2cb7a6db02 feat: add block swap for FLUX.1/SD3 LoRA training Kohya S 2024-11-12 21:39:13 +09:00
  • 17cf249d76 Merge branch 'sd3' into faster-block-swap Kohya S 2024-11-12 08:49:15 +09:00
  • cde90b8903 feat: implement block swapping for FLUX.1 LoRA (WIP) Kohya S 2024-11-12 08:49:05 +09:00
  • 3fe94b058a update comment Kohya S 2024-11-12 08:09:07 +09:00
  • 92482c7a07 Merge pull request #1774 from sdbds/avif_get_imagesize Kohya S. 2024-11-12 08:02:16 +09:00
  • 7feaae5f06 Merge branch 'sd3' into faster-block-swap Kohya S 2024-11-11 21:16:01 +09:00
  • 02bd76e6c7 Refactor block swapping to utilize custom offloading utilities Kohya S 2024-11-11 21:15:36 +09:00
  • 26bd4540a6 init sdbds 2024-11-11 09:25:28 +08:00
  • 8fac3c3b08 update README Kohya S 2024-11-09 19:56:02 +09:00
  • 2a2042a762 Merge pull request #1770 from feffy380/fix-size-from-cache Kohya S. 2024-11-09 19:51:03 +09:00
  • b3248a8eef fix: sort order when getting image size from cache file feffy380 2024-11-07 14:31:05 +01:00
  • 186aa5b97d fix illeagal block is swapped #1764 Kohya S 2024-11-07 22:16:05 +09:00
  • b8d3feca77 Merge branch 'sd3' into faster-block-swap Kohya S 2024-11-07 21:43:48 +09:00
  • 123474d784 Merge branch 'sd3' of https://github.com/kohya-ss/sd-scripts into sd3 Kohya S 2024-11-07 21:43:37 +09:00
  • e877b306c8 Merge branch 'dev' into sd3 Kohya S 2024-11-07 21:43:04 +09:00
  • 6adb69be63 Merge branch 'main' into dev Kohya S 2024-11-07 21:42:44 +09:00
  • 387b40ea37 Merge pull request #1769 from Dango233/patch-1 Kohya S. 2024-11-07 21:41:12 +09:00
  • e5ac095749 add about dev and sd3 branch to README v0.8.8 Kohya S 2024-11-07 21:39:47 +09:00
  • 5eb6d209d5 Update README.md Dango233 2024-11-07 20:33:31 +08:00
  • f264f4091f Update README.md Kohya S. 2024-11-07 21:30:31 +09:00
  • 5e86323f12 Update README and clean-up the code for SD3 timesteps Kohya S 2024-11-07 21:27:12 +09:00
  • 588ea9e123 Merge pull request #1768 from Dango233/dango/timesteps_fix Kohya S. 2024-11-07 20:56:04 +09:00
  • bafd10d558 Fix typo Dango233 2024-11-07 18:21:04 +08:00
  • e54462a4a9 Fix SD3 trained lora loading and merging Dango233 2024-11-07 09:54:12 +00:00
  • 40ed54bfc0 Simplify Timestep weighting * Remove diffusers dependency in ts & sigma calc * support Shift setting * Add uniform distribution * Default to Uniform distribution and shift 1 Dango233 2024-11-07 09:53:54 +00:00
  • 43849030cf Fix to work without latent cache #1758 Kohya S 2024-11-06 21:33:28 +09:00
  • aab943cea3 remove unused weight swapping functions from utils.py Kohya S 2024-11-05 23:27:41 +09:00
  • 81c0c965a2 faster block swap Kohya S 2024-11-05 21:22:42 +09:00
  • 5e32ee26a1 fix crashing in DDP training closes #1751 Kohya S 2024-11-02 15:32:16 +09:00
  • e0db59695f update multi-res training in SD3.5M Kohya S 2024-11-02 11:13:04 +09:00
  • 264328d117 Merge pull request #1719 from kohya-ss/sd3_5_support Kohya S. 2024-11-01 21:55:48 +09:00
  • 82daa98fe8 remove duplicate resolution for scaled pos embed Kohya S 2024-11-01 21:43:47 +09:00
  • 9aa6f52ac3 Fix memory leak in latent caching. bmp failed to cache Kohya S 2024-11-01 21:43:21 +09:00
  • 830df4abcc Fix crashing if image is too tall or wide. Kohya S 2024-10-31 21:39:07 +09:00
  • 9e23368e3d Update SD3 training Kohya S 2024-10-31 19:58:41 +09:00
  • 1434d8506f Support SD3.5M multi resolutional training Kohya S 2024-10-31 19:58:22 +09:00
  • 70a179e446 Fix to use SDPA instead of xformers Kohya S 2024-10-30 14:34:19 +09:00
  • 8c3c825b5f Merge branch 'sd3_5_support' of https://github.com/kohya-ss/sd-scripts into sd3_5_support Kohya S 2024-10-30 12:51:55 +09:00
  • bdddc20d68 support SD3.5M Kohya S 2024-10-30 12:51:49 +09:00
  • b502f58488 Fix emb_dim to work. kohya-ss 2024-10-29 23:29:50 +09:00
  • c9a1417157 Merge branch 'sd3' into sd3_5_support kohya-ss 2024-10-29 22:30:01 +09:00
  • ce5b532582 Fix additional LoRA to work kohya-ss 2024-10-29 22:29:24 +09:00
  • 1e2f7b0e44 Support for checkpoint files with a mysterious prefix "model.diffusion_model." Kohya S 2024-10-29 22:11:04 +09:00
  • 80bb3f4ecf Merge branch 'sd3_5_support' of https://github.com/kohya-ss/sd-scripts into sd3_5_support kohya-ss 2024-10-29 21:52:08 +09:00
  • d4e19fbd5e Support Lora kohya-ss 2024-10-29 21:52:04 +09:00
  • 0af4edd8a6 Fix split_qkv kohya-ss 2024-10-29 21:51:56 +09:00
  • 75554867ce Fix error on saving T5XXL Kohya S 2024-10-29 08:34:31 +09:00
  • af8e216035 Fix sample image gen to work with block swap Kohya S 2024-10-28 22:08:57 +09:00
  • 1065dd1b56 Fix to work dropout_rate for TEs kohya-ss 2024-10-27 19:36:36 +09:00
  • d4f7849592 prevent unintended cast for disk cached TE outputs kohya-ss 2024-10-27 19:35:56 +09:00
  • a1255d637f Fix SD3 LoRA training to work (WIP) kohya-ss 2024-10-27 17:03:36 +09:00
  • db2b4d41b9 Add dropout rate arguments for CLIP-L, CLIP-G, and T5, fix Text Encoders LoRA not trained Kohya S 2024-10-27 16:42:58 +09:00
  • b649bbf2b6 Merge branch 'sd3' into sd3_5_support Kohya S 2024-10-27 10:20:35 +09:00
  • 731664b8c3 Merge branch 'dev' into sd3 Kohya S 2024-10-27 10:20:14 +09:00
  • e070bd9973 Merge branch 'main' into dev Kohya S 2024-10-27 10:19:55 +09:00
  • ca44e3e447 reduce VRAM usage, instead of increasing main RAM usage Kohya S 2024-10-27 10:19:05 +09:00
  • 150579db32 Merge branch 'sd3' into sd3_5_support Kohya S 2024-10-26 22:03:41 +09:00
  • 8549669f89 Merge branch 'dev' into sd3 Kohya S 2024-10-26 22:02:57 +09:00
  • 900d551a6a Merge branch 'main' into dev Kohya S 2024-10-26 22:02:36 +09:00
  • 56b4ea963e Fix LoRA metadata hash calculation bug in svd_merge_lora.py, sdxl_merge_lora.py, and resize_lora.py closes #1722 Kohya S 2024-10-26 22:01:10 +09:00
  • 014064fd81 fix sample image generation without seed failed close #1726 kohya-ss 2024-10-26 18:59:45 +09:00
  • 56bf761164 fix errors in SD3 LoRA training with Text Encoders close #1724 kohya-ss 2024-10-26 17:29:24 +09:00
  • 0031d916f0 add latent scaling/shifting kohya-ss 2024-10-25 23:20:38 +09:00
  • d2c549d7b2 support SD3 LoRA kohya-ss 2024-10-25 21:58:31 +09:00
  • f52fb66e8f Merge branch 'sd3' into sd3_5_support Kohya S 2024-10-25 19:03:58 +09:00
  • 5fba6f514a Merge branch 'dev' into sd3 Kohya S 2024-10-25 19:03:27 +09:00
  • b1e6504007 update README Kohya S 2024-10-25 18:56:25 +09:00
  • b8ae745d0c Merge pull request #1717 from catboxanon/fix/remove-vpred-warnings Kohya S. 2024-10-25 18:49:40 +09:00
  • c632af860e Merge pull request #1715 from catboxanon/vpred-ztsnr-fixes Kohya S. 2024-10-25 18:48:14 +09:00
  • f8c5146d71 support block swap with fused_optimizer_pass Kohya S 2024-10-24 22:02:05 +09:00
  • 0286114bd2 support SD3.5L, fix final saving Kohya S 2024-10-24 21:28:42 +09:00
  • e3c43bda49 reduce memory usage in sample image generation Kohya S 2024-10-24 20:35:47 +09:00
  • 623017f716 refactor SD3 CLIP to transformers etc. Kohya S 2024-10-24 19:49:28 +09:00
  • be14c06267 Remove v-pred warnings catboxanon 2024-10-22 12:13:51 -04:00
  • 0e7c592933 Remove scale_v_pred_loss_like_noise_pred deprecation catboxanon 2024-10-22 11:19:34 -04:00
  • e1b63c2249 Only add warning for deprecated scaling vpred loss function catboxanon 2024-10-21 08:12:53 -04:00
  • 8fc30f8205 Fix training for V-pred and ztSNR catboxanon 2024-10-21 07:34:33 -04:00
  • 138dac4aea update README Kohya S 2024-10-20 09:22:38 +09:00
  • 7fe8e162cb fix to work ControlNetSubset with custom_attributes Kohya S 2024-10-20 08:45:27 +09:00
  • aa932429d1 Merge pull request #1710 from kohya-ss/diff_output_prsv Kohya S. 2024-10-19 19:56:13 +09:00
  • 09b4d1e9b6 Merge branch 'sd3' into diff_output_prsv Kohya S 2024-10-19 19:30:23 +09:00
  • 2c45d979e6 update README, remove unnecessary autocast kohya-ss 2024-10-19 19:21:12 +09:00
  • ef70aa7b42 add FLUX.1 support kohya-ss 2024-10-18 23:39:48 +09:00
  • d8d7142665 fix to work caching latents #1696 Kohya S 2024-10-18 23:16:30 +09:00
  • 3cc5b8db99 Diff Output Preserv loss for SDXL Kohya S 2024-10-18 20:57:13 +09:00
  • 2500f5a798 fix latents caching not working closes #1696 Kohya S 2024-10-15 07:16:34 +09:00
  • 1275e148df Merge pull request #1690 from kohya-ss/multi-gpu-caching Kohya S. 2024-10-13 19:25:59 +09:00
  • 2d5f7fa709 update README kohya-ss 2024-10-13 19:23:21 +09:00
  • 886ffb4d65 Merge branch 'sd3' into multi-gpu-caching kohya-ss 2024-10-13 19:14:06 +09:00
  • d02a6ef7c4 Merge pull request #1660 from kohya-ss/fast_image_sizes Kohya S. 2024-10-13 19:11:37 +09:00
  • bfc3a65acd fix to work cache latents/text encoder outputs kohya-ss 2024-10-13 19:08:16 +09:00