DKnight54
381303d64f
Update train_network.py
2025-03-29 02:26:18 +08:00
Kohya S
8f4ee8fc34
doc: update README for latest
2025-03-21 22:05:48 +09:00
Kohya S.
367f348430
Merge pull request #1964 from Nekotekina/main
...
Fix missing text encoder attn modules
2025-03-21 21:59:03 +09:00
Ivan Chikish
acdca2abb7
Fix [occasionally] missing text encoder attn modules
...
Should fix #1952
I added alternative name for CLIPAttention.
I have no idea why this name changed.
Now it should accept both names.
2025-03-01 20:35:45 +03:00
Kohya S.
6e3c1d0b58
Merge pull request #1879 from kohya-ss/dev
...
merge dev to main
2025-01-17 23:25:56 +09:00
Kohya S
345daaa986
update README for merging
2025-01-17 23:22:38 +09:00
Kohya S
6adb69be63
Merge branch 'main' into dev
2024-11-07 21:42:44 +09:00
Kohya S
e5ac095749
add about dev and sd3 branch to README
2024-11-07 21:39:47 +09:00
Kohya S
e070bd9973
Merge branch 'main' into dev
2024-10-27 10:19:55 +09:00
Kohya S
ca44e3e447
reduce VRAM usage, instead of increasing main RAM usage
2024-10-27 10:19:05 +09:00
Kohya S
900d551a6a
Merge branch 'main' into dev
2024-10-26 22:02:36 +09:00
Kohya S
56b4ea963e
Fix LoRA metadata hash calculation bug in svd_merge_lora.py, sdxl_merge_lora.py, and resize_lora.py closes #1722
2024-10-26 22:01:10 +09:00
Kohya S
b1e6504007
update README
2024-10-25 18:56:25 +09:00
Kohya S.
b8ae745d0c
Merge pull request #1717 from catboxanon/fix/remove-vpred-warnings
...
Remove v-pred warnings
2024-10-25 18:49:40 +09:00
Kohya S.
c632af860e
Merge pull request #1715 from catboxanon/vpred-ztsnr-fixes
...
Update debiased estimation loss function to accommodate V-pred
2024-10-25 18:48:14 +09:00
catboxanon
be14c06267
Remove v-pred warnings
...
Different model architectures, such as SDXL, can take advantage of
v-pred. It doesn't make sense to include these warnings anymore.
2024-10-22 12:13:51 -04:00
catboxanon
0e7c592933
Remove scale_v_pred_loss_like_noise_pred deprecation
...
https://github.com/kohya-ss/sd-scripts/pull/1715#issuecomment-2427876376
2024-10-22 11:19:34 -04:00
catboxanon
e1b63c2249
Only add warning for deprecated scaling vpred loss function
2024-10-21 08:12:53 -04:00
catboxanon
8fc30f8205
Fix training for V-pred and ztSNR
...
1) Updates debiased estimation loss function for V-pred.
2) Prevents now-deprecated scaling of loss if ztSNR is enabled.
2024-10-21 07:34:33 -04:00
Kohya S
012e7e63a5
fix to work linear/cosine scheduler closes #1651 ref #1393
2024-09-29 23:18:16 +09:00
Kohya S
1567549220
update help text #1632
2024-09-29 09:51:36 +09:00
Kohya S
fe2aa32484
adjust min/max bucket reso divisible by reso steps #1632
2024-09-29 09:49:25 +09:00
Kohya S
ce49ced699
update readme
2024-09-26 21:37:40 +09:00
Kohya S
a94bc84dec
fix to work bitsandbytes optimizers with full path #1640
2024-09-26 21:37:31 +09:00
Kohya S.
4296e286b8
Merge pull request #1640 from sdbds/ademamix8bit
...
New optimizer:AdEMAMix8bit and PagedAdEMAMix8bit
2024-09-26 21:20:19 +09:00
Kohya S
bf91bea2e4
fix flip_aug, alpha_mask, random_crop issue in caching
2024-09-26 20:51:40 +09:00
sdbds
1beddd84e5
delete code for cleaning
2024-09-25 22:58:26 +08:00
Kohya S
e74f58148c
update README
2024-09-25 20:55:50 +09:00
Kohya S.
c1d16a76d6
Merge pull request #1628 from recris/huber-timesteps
...
Make timesteps work in the standard way when Huber loss is used
2024-09-25 20:52:55 +09:00
sdbds
ab7b231870
init
2024-09-25 19:38:52 +08:00
Kohya S
29177d2f03
retain alpha in pil_resize backport #1619
2024-09-23 21:14:03 +09:00
recris
e1f23af1bc
make timestep sampling behave in the standard way when huber loss is used
2024-09-21 13:21:56 +01:00
Kohya S.
0b7927e50b
Merge pull request #1615 from Maru-mee/patch-1
...
Bug fix: alpha_mask load
2024-09-19 21:49:49 +09:00
Kohya S
d7e14721e2
Merge branch 'main' into dev
2024-09-19 21:15:19 +09:00
Kohya S
9c757c2fba
fix SDXL block index to match LBW
2024-09-19 21:14:57 +09:00
Maru-mee
e7040669bc
Bug fix: alpha_mask load
2024-09-19 15:47:06 +09:00
Kohya S
93d9fbf607
improve OFT implementation closes #944
2024-09-13 22:37:11 +09:00
Kohya S
43ad73860d
Merge branch 'main' into dev
2024-09-13 21:29:51 +09:00
Kohya S
b755ebd0a4
add LBW support for SDXL merge LoRA
2024-09-13 21:29:31 +09:00
Kohya S
f4a0bea6dc
format by black
2024-09-13 21:26:06 +09:00
terracottahaniwa
734d2e5b2b
Support Lora Block Weight (LBW) to svd_merge_lora.py ( #1575 )
...
* support lora block weight
* solve license incompatibility
* Fix issue: lbw index calculation
2024-09-13 20:45:35 +09:00
Kohya S
9d2860760d
Merge branch 'main' into dev
2024-09-13 19:48:53 +09:00
Kohya S
3387dc7306
formatting, update README
2024-09-13 19:45:42 +09:00
Kohya S
57ae44eb61
refactor to make safer
2024-09-13 19:45:00 +09:00
Maru-mee
1d7118a622
Support : OFT merge to base model ( #1580 )
...
* Support : OFT merge to base model
* Fix typo
* Fix typo_2
* Delete unused parameter 'eye'
2024-09-13 19:01:36 +09:00
Kohya S
c7c666b182
fix typo
2024-09-11 22:12:31 +09:00
Kohya S
6dbfd47a59
Fix to work PIECEWISE_CONSTANT, update requirement.txt and README #1393
2024-09-11 21:44:36 +09:00
青龍聖者@bdsqlsz
fd68703f37
Add New lr scheduler ( #1393 )
...
* add new lr scheduler
* fix bugs and use num_cycles / 2
* Update requirements.txt
* add num_cycles for min lr
* keep PIECEWISE_CONSTANT
* allow use float with warmup or decay ratio.
* Update train_util.py
2024-09-11 21:25:45 +09:00
Kohya S
62ec3e6424
Merge branch 'main' into dev
2024-09-07 10:52:49 +09:00
Kohya S.
de25945a93
Merge pull request #1550 from kohya-ss/dependabot/github_actions/crate-ci/typos-1.24.3
...
Bump crate-ci/typos from 1.19.0 to 1.24.3
2024-09-07 10:50:46 +09:00
