rockerBOO
121cc23f2e
Moved matplotlib into functions to not require it
2025-07-14 21:26:36 -04:00
rockerBOO
8cc81e45f7
Fix wavelet loss on non-flow matching models (sd1.5, SDXL). Fix wavelet coorelation.
2025-07-14 21:20:49 -04:00
rockerBOO
8b0a467bc0
Merge branch 'sd3' into network-wavelet-loss
2025-06-10 13:37:20 -04:00
rockerBOO
7c83ac4369
Add avg non-zero ratio metric
2025-06-10 13:17:04 -04:00
rockerBOO
9629853d15
Fix wavelet loss not separating levels. Refactor loss to be spatial
2025-06-05 22:03:52 -04:00
Kohya S.
61eda76278
Merge pull request #2108 from rockerBOO/syntax-test
...
Add tests for syntax checking training scripts
2025-06-05 07:49:57 +09:00
rockerBOO
e4d6923409
Add tests for syntax checking training scripts
2025-06-03 16:12:02 -04:00
Kohya S.
5753b8ff6b
Merge pull request #2088 from rockerBOO/checkov-update
...
Update workflows to read-all instead of write-all
2025-05-20 20:30:27 +09:00
rockerBOO
2bfda1271b
Update workflows to read-all instead of write-all
2025-05-19 20:25:42 -04:00
rockerBOO
0af0302c38
Metrics, energy, loss
2025-05-19 19:15:23 -04:00
rockerBOO
346790a996
Merge branch 'sd3' into network-wavelet-loss
2025-05-19 19:10:55 -04:00
Kohya S.
5b38d07f03
Merge pull request #2073 from rockerBOO/fix-mean-grad-norms
...
Fix mean grad norms
2025-05-11 21:32:34 +09:00
rockerBOO
d0ce867498
Fix loss/wavelet metric
2025-05-06 00:29:27 -04:00
rockerBOO
869dc000d9
Remove latents
2025-05-06 00:04:12 -04:00
rockerBOO
3b949b9295
Add PyWavelets for test
2025-05-04 18:59:05 -04:00
rockerBOO
984472ca09
Fix metrics
2025-05-04 18:58:54 -04:00
rockerBOO
7be3c5dce1
Refactor SWT to work properly and faster. Add SWT tests
2025-05-04 18:57:53 -04:00
rockerBOO
964bfcb576
Fix padding for small latents. Add DWT tests
2025-05-04 18:57:42 -04:00
rockerBOO
d5f8f7de1f
Add wavelet loss fn
2025-05-04 18:57:10 -04:00
rockerBOO
56dfdae7c5
Add QuaternionWaveletTransform. Update WaveletLoss
2025-05-04 18:55:50 -04:00
rockerBOO
40128b7dc0
Use args.wavelet_loss to activate
2025-05-04 18:39:56 -04:00
rockerBOO
19ce0ae61f
Add wavelet_loss_band_level_weights
2025-05-04 18:39:51 -04:00
rockerBOO
7b9e92a8cc
Fix band weights via toml. Add more logging
2025-05-04 18:39:48 -04:00
rockerBOO
20a99771bf
Add back in padding
2025-05-04 18:39:45 -04:00
rockerBOO
f553b7bf31
Add wavelet loss recording
2025-05-04 18:39:36 -04:00
rockerBOO
6d42b95e2b
Refactor transforms, fix loss calculations
...
- add full conditional_loss functionality to wavelet loss
- Transforms are separate and abstracted
- Loss now doesn't include LL except the lowest level
- ll_level_threshold allows you to control the level the ll is
used in the loss
- band weights can now be passed in
- rectified flow calculations can be bypassed for experimentation
- Fixed alpha to 1.0 with new weighted bands producing lower loss
2025-05-04 18:39:32 -04:00
rockerBOO
64422ff4a0
Suggest the right module
2025-05-04 18:39:25 -04:00
rockerBOO
837231a5c7
Add wavelet loss
2025-05-04 18:39:17 -04:00
rockerBOO
813942a967
Add wavelet loss
2025-05-04 18:38:47 -04:00
Kohya S.
e2ed265104
Merge pull request #2072 from rockerBOO/pytest-pythonpath
...
Add pythonpath to pytest.ini
2025-05-01 23:38:29 +09:00
Kohya S.
e85813200a
Merge pull request #2074 from kohya-ss/deepspeed-readme
...
Deepspeed readme
2025-05-01 23:34:41 +09:00
Kohya S
a27ace74d9
doc: add DeepSpeed installation in header section
2025-05-01 23:31:23 +09:00
Kohya S
865c8d55e2
README.md: Update recent updates and add DeepSpeed installation instructions
2025-05-01 23:29:19 +09:00
Kohya S.
7c075a9c8d
Merge pull request #2060 from saibit-tech/sd3
...
Fix: try aligning dtype of matrixes when training with deepspeed and mixed-precision is set to bf16 or fp16
2025-05-01 23:20:17 +09:00
rockerBOO
b4a89c3cdf
Fix None
2025-05-01 02:03:22 -04:00
rockerBOO
f62c68df3c
Make grad_norm and combined_grad_norm None is not recording
2025-05-01 01:37:57 -04:00
rockerBOO
a4fae93dce
Add pythonpath to pytest.ini
2025-05-01 00:55:10 -04:00
sharlynxy
1684ababcd
remove deepspeed from requirements.txt
2025-04-30 19:51:09 +08:00
Kohya S
64430eb9b2
Merge branch 'dev' into sd3
2025-04-29 21:30:57 +09:00
Kohya S
d8717a3d1c
Merge branch 'main' into dev
2025-04-29 21:30:33 +09:00
Kohya S.
a21b6a917e
Merge pull request #2070 from kohya-ss/fix-mean-ar-error-nan
...
Fix mean image aspect ratio error calculation to avoid NaN values
2025-04-29 21:29:42 +09:00
Kohya S
4625b34f4e
Fix mean image aspect ratio error calculation to avoid NaN values
2025-04-29 21:27:04 +09:00
Kohya S.
80320d21fe
Merge pull request #2066 from kohya-ss/quick-fix-flux-sampling-scales
...
Quick fix flux sampling scales
2025-04-27 23:39:47 +09:00
Kohya S
29523c9b68
docs: add note for user feedback on CFG scale in FLUX.1 training
2025-04-27 23:34:37 +09:00
Kohya S
fd3a445769
fix: revert default emb guidance scale and CFG scale for FLUX.1 sampling
2025-04-27 22:50:27 +09:00
Kohya S
13296ae93b
Merge branch 'sd3' of https://github.com/kohya-ss/sd-scripts into sd3
2025-04-27 21:48:03 +09:00
Kohya S
0e8ac43760
Merge branch 'dev' into sd3
2025-04-27 21:47:58 +09:00
Kohya S
bc9252cc1b
Merge branch 'main' into dev
2025-04-27 21:47:39 +09:00
Kohya S.
3b25de1f17
Merge pull request #2065 from kohya-ss/kohya-ss-funding-yml
...
Create FUNDING.yml
2025-04-27 21:29:44 +09:00
Kohya S.
f0b07c52ab
Create FUNDING.yml
2025-04-27 21:28:38 +09:00
