VictorMylle/Kohya-ss-sd-scripts
1
0
Fork 1
mirror of https://github.com/kohya-ss/sd-scripts.git synced 2026-04-16 17:02:45 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,236 Commits 25 Branches 38 Tags
9cedf18a974cd272c260da5bbe8d4c585f31a301
Commit Graph

422 Commits

Author SHA1 Message Date
rockerBOO
9cedf18a97 Add import hint 2025-07-15 19:53:54 -04:00
rockerBOO
479ec9c8a6 Use new wavelet-loss library github.com/rockerBOO/wavelet-loss 2025-07-15 19:52:33 -04:00
rockerBOO
8cc81e45f7 Fix wavelet loss on non-flow matching models (sd1.5, SDXL). Fix wavelet coorelation. 2025-07-14 21:20:49 -04:00
rockerBOO
9629853d15 Fix wavelet loss not separating levels. Refactor loss to be spatial 2025-06-05 22:03:52 -04:00
rockerBOO
0af0302c38 Metrics, energy, loss 2025-05-19 19:15:23 -04:00
rockerBOO
346790a996 Merge branch 'sd3' into network-wavelet-loss 2025-05-19 19:10:55 -04:00
rockerBOO
d0ce867498 Fix loss/wavelet metric 2025-05-06 00:29:27 -04:00
rockerBOO
869dc000d9 Remove latents 2025-05-06 00:04:12 -04:00
rockerBOO
984472ca09 Fix metrics 2025-05-04 18:58:54 -04:00
rockerBOO
964bfcb576 Fix padding for small latents. Add DWT tests 2025-05-04 18:57:42 -04:00
rockerBOO
d5f8f7de1f Add wavelet loss fn 2025-05-04 18:57:10 -04:00
rockerBOO
56dfdae7c5 Add QuaternionWaveletTransform. Update WaveletLoss 2025-05-04 18:55:50 -04:00
rockerBOO
40128b7dc0 Use args.wavelet_loss to activate 2025-05-04 18:39:56 -04:00
rockerBOO
19ce0ae61f Add wavelet_loss_band_level_weights 2025-05-04 18:39:51 -04:00
rockerBOO
7b9e92a8cc Fix band weights via toml. Add more logging 2025-05-04 18:39:48 -04:00
rockerBOO
f553b7bf31 Add wavelet loss recording 2025-05-04 18:39:36 -04:00
rockerBOO
6d42b95e2b Refactor transforms, fix loss calculations 
- add full conditional_loss functionality to wavelet loss
- Transforms are separate and abstracted
- Loss now doesn't include LL except the lowest level
  - ll_level_threshold allows you to control the level the ll is
    used in the loss
- band weights can now be passed in
- rectified flow calculations can be bypassed for experimentation
- Fixed alpha to 1.0 with new weighted bands producing lower loss
 2025-05-04 18:39:32 -04:00
rockerBOO
813942a967 Add wavelet loss 2025-05-04 18:38:47 -04:00
rockerBOO
b4a89c3cdf Fix None 2025-05-01 02:03:22 -04:00
rockerBOO
f62c68df3c Make grad_norm and combined_grad_norm None is not recording 2025-05-01 01:37:57 -04:00
Kohya S
5a18a03ffc Merge branch 'dev' into sd3 2025-04-07 21:55:17 +09:00
Kohya S
d0b5c0e5cf chore: formatting, add TODO comment 2025-03-30 21:15:37 +09:00
Kohya S.
59d98e45a9 Merge pull request #1974 from rockerBOO/lora-ggpo 
Add LoRA-GGPO for Flux
 2025-03-30 21:07:31 +09:00
Kohya S.
93a4efabb5 Merge branch 'sd3' into resize-interpolation 2025-03-30 19:30:56 +09:00
DKnight54
381303d64f Update train_network.py 2025-03-29 02:26:18 +08:00
rockerBOO
0181b7a042 Remove progress bar avg norms 2025-03-27 03:28:33 -04:00
rockerBOO
3647d065b5 Cache weight norms estimate on initialization. Move to update norms every step 2025-03-18 14:25:09 -04:00
rockerBOO
ea53290f62 Add LoRA-GGPO for Flux 2025-03-06 00:00:38 -05:00
Kohya S
1fcac98280 Merge branch 'sd3' into val-loss-improvement 2025-02-26 21:09:10 +09:00
Kohya S.
6e90c0f86c Merge pull request #1909 from rockerBOO/progress_bar 
Move progress bar to account for sampling image first
 2025-02-24 18:57:44 +09:00
Kohya S
efb2a128cd fix wandb val logging 2025-02-21 22:07:35 +09:00
rockerBOO
ca1c129ffd Fix metadata 2025-02-19 14:20:40 -05:00
rockerBOO
7729c4c8f9 Add metadata 2025-02-19 14:20:40 -05:00
Kohya S
4a36996134 modify log step calculation 2025-02-18 22:05:08 +09:00
Kohya S
dc7d5fb459 Merge branch 'sd3' into val-loss-improvement 2025-02-18 21:34:30 +09:00
rockerBOO
4671e23778 Fix validation epoch loss to check epoch average 2025-02-16 01:42:44 -05:00
Kohya S
63337d9fe4 Merge branch 'sd3' into val-loss-improvement 2025-02-15 21:41:07 +09:00
rockerBOO
ab88b431b0 Fix validation epoch divergence 2025-02-14 11:14:38 -05:00
Kohya S
76b761943b fix: simplify validation step condition in NetworkTrainer 2025-02-11 21:53:57 +09:00
Kohya S
177203818a fix: unpause training progress bar after vaidation 2025-02-11 21:42:46 +09:00
Kohya S
344845b429 fix: validation with block swap 2025-02-09 21:25:40 +09:00
Kohya S
0911683717 set python random state 2025-02-09 20:53:49 +09:00
Kohya S
c5b803ce94 rng state management: Implement functions to get and set RNG states for consistent validation 2025-02-04 21:59:09 +09:00
rockerBOO
de830b8941 Move progress bar to account for sampling image first 2025-01-29 00:02:45 -05:00
Kohya S
45ec02b2a8 use same noise for every validation 2025-01-27 22:10:38 +09:00
Kohya S
0778dd9b1d fix Text Encoder only LoRA training 2025-01-27 22:03:42 +09:00
Kohya S
0750859133 validation: Implement timestep-based validation processing 2025-01-27 21:56:59 +09:00
Kohya S
29f31d005f add network.train()/eval() for validation 2025-01-27 21:35:43 +09:00
Kohya S
b6a3093216 call optimizer eval/train fn before/after validation 2025-01-27 21:22:11 +09:00
Kohya S
86a2f3fd26 Fix gradient handling when Text Encoders are trained 2025-01-27 21:10:52 +09:00