VictorMylle/Kohya-ss-sd-scripts
1
0
Fork 1
mirror of https://github.com/kohya-ss/sd-scripts.git synced 2026-04-16 08:52:45 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,236 Commits 25 Branches 38 Tags
9cedf18a974cd272c260da5bbe8d4c585f31a301
Commit Graph

2236 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
rockerBOO
9cedf18a97 Add import hint 2025-07-15 19:53:54 -04:00
rockerBOO
479ec9c8a6 Use new wavelet-loss library github.com/rockerBOO/wavelet-loss 2025-07-15 19:52:33 -04:00
rockerBOO
121cc23f2e Moved matplotlib into functions to not require it 2025-07-14 21:26:36 -04:00
rockerBOO
8cc81e45f7 Fix wavelet loss on non-flow matching models (sd1.5, SDXL). Fix wavelet coorelation. 2025-07-14 21:20:49 -04:00
rockerBOO
8b0a467bc0 Merge branch 'sd3' into network-wavelet-loss 2025-06-10 13:37:20 -04:00
rockerBOO
7c83ac4369 Add avg non-zero ratio metric 2025-06-10 13:17:04 -04:00
rockerBOO
9629853d15 Fix wavelet loss not separating levels. Refactor loss to be spatial 2025-06-05 22:03:52 -04:00
Kohya S.
61eda76278 Merge pull request #2108 from rockerBOO/syntax-test 
Add tests for syntax checking training scripts
 2025-06-05 07:49:57 +09:00
rockerBOO
e4d6923409 Add tests for syntax checking training scripts 2025-06-03 16:12:02 -04:00
Kohya S.
5753b8ff6b Merge pull request #2088 from rockerBOO/checkov-update 
Update workflows to read-all instead of write-all
 2025-05-20 20:30:27 +09:00
rockerBOO
2bfda1271b Update workflows to read-all instead of write-all 2025-05-19 20:25:42 -04:00
rockerBOO
0af0302c38 Metrics, energy, loss 2025-05-19 19:15:23 -04:00
rockerBOO
346790a996 Merge branch 'sd3' into network-wavelet-loss 2025-05-19 19:10:55 -04:00
Kohya S.
5b38d07f03 Merge pull request #2073 from rockerBOO/fix-mean-grad-norms 
Fix mean grad norms
 2025-05-11 21:32:34 +09:00
rockerBOO
d0ce867498 Fix loss/wavelet metric 2025-05-06 00:29:27 -04:00
rockerBOO
869dc000d9 Remove latents 2025-05-06 00:04:12 -04:00
rockerBOO
3b949b9295 Add PyWavelets for test 2025-05-04 18:59:05 -04:00
rockerBOO
984472ca09 Fix metrics 2025-05-04 18:58:54 -04:00
rockerBOO
7be3c5dce1 Refactor SWT to work properly and faster. Add SWT tests 2025-05-04 18:57:53 -04:00
rockerBOO
964bfcb576 Fix padding for small latents. Add DWT tests 2025-05-04 18:57:42 -04:00
rockerBOO
d5f8f7de1f Add wavelet loss fn 2025-05-04 18:57:10 -04:00
rockerBOO
56dfdae7c5 Add QuaternionWaveletTransform. Update WaveletLoss 2025-05-04 18:55:50 -04:00
rockerBOO
40128b7dc0 Use args.wavelet_loss to activate 2025-05-04 18:39:56 -04:00
rockerBOO
19ce0ae61f Add wavelet_loss_band_level_weights 2025-05-04 18:39:51 -04:00
rockerBOO
7b9e92a8cc Fix band weights via toml. Add more logging 2025-05-04 18:39:48 -04:00
rockerBOO
20a99771bf Add back in padding 2025-05-04 18:39:45 -04:00
rockerBOO
f553b7bf31 Add wavelet loss recording 2025-05-04 18:39:36 -04:00
rockerBOO
6d42b95e2b Refactor transforms, fix loss calculations 
- add full conditional_loss functionality to wavelet loss
- Transforms are separate and abstracted
- Loss now doesn't include LL except the lowest level
  - ll_level_threshold allows you to control the level the ll is
    used in the loss
- band weights can now be passed in
- rectified flow calculations can be bypassed for experimentation
- Fixed alpha to 1.0 with new weighted bands producing lower loss
 2025-05-04 18:39:32 -04:00
rockerBOO
64422ff4a0 Suggest the right module 2025-05-04 18:39:25 -04:00
rockerBOO
837231a5c7 Add wavelet loss 2025-05-04 18:39:17 -04:00
rockerBOO
813942a967 Add wavelet loss 2025-05-04 18:38:47 -04:00
Kohya S.
e2ed265104 Merge pull request #2072 from rockerBOO/pytest-pythonpath 
Add  pythonpath to pytest.ini
 2025-05-01 23:38:29 +09:00
Kohya S.
e85813200a Merge pull request #2074 from kohya-ss/deepspeed-readme 
Deepspeed readme
 2025-05-01 23:34:41 +09:00
Kohya S
a27ace74d9 doc: add DeepSpeed installation in header section 2025-05-01 23:31:23 +09:00
Kohya S
865c8d55e2 README.md: Update recent updates and add DeepSpeed installation instructions 2025-05-01 23:29:19 +09:00
Kohya S.
7c075a9c8d Merge pull request #2060 from saibit-tech/sd3 
Fix: try aligning dtype of matrixes when training with deepspeed and mixed-precision is set to bf16 or fp16
 2025-05-01 23:20:17 +09:00
rockerBOO
b4a89c3cdf Fix None 2025-05-01 02:03:22 -04:00
rockerBOO
f62c68df3c Make grad_norm and combined_grad_norm None is not recording 2025-05-01 01:37:57 -04:00
rockerBOO
a4fae93dce Add pythonpath to pytest.ini 2025-05-01 00:55:10 -04:00
sharlynxy
1684ababcd remove deepspeed from requirements.txt 2025-04-30 19:51:09 +08:00
Kohya S
64430eb9b2 Merge branch 'dev' into sd3 2025-04-29 21:30:57 +09:00
Kohya S
d8717a3d1c Merge branch 'main' into dev 2025-04-29 21:30:33 +09:00
Kohya S.
a21b6a917e Merge pull request #2070 from kohya-ss/fix-mean-ar-error-nan 
Fix mean image aspect ratio error calculation to avoid NaN values
 2025-04-29 21:29:42 +09:00
Kohya S
4625b34f4e Fix mean image aspect ratio error calculation to avoid NaN values 2025-04-29 21:27:04 +09:00
Kohya S.
80320d21fe Merge pull request #2066 from kohya-ss/quick-fix-flux-sampling-scales 
Quick fix flux sampling scales
 2025-04-27 23:39:47 +09:00
Kohya S
29523c9b68 docs: add note for user feedback on CFG scale in FLUX.1 training 2025-04-27 23:34:37 +09:00
Kohya S
fd3a445769 fix: revert default emb guidance scale and CFG scale for FLUX.1 sampling 2025-04-27 22:50:27 +09:00
Kohya S
13296ae93b Merge branch 'sd3' of https://github.com/kohya-ss/sd-scripts into sd3 2025-04-27 21:48:03 +09:00
Kohya S
0e8ac43760 Merge branch 'dev' into sd3 2025-04-27 21:47:58 +09:00
Kohya S
bc9252cc1b Merge branch 'main' into dev 2025-04-27 21:47:39 +09:00