rockerBOO
d0ce867498
Fix loss/wavelet metric
2025-05-06 00:29:27 -04:00
rockerBOO
869dc000d9
Remove latents
2025-05-06 00:04:12 -04:00
rockerBOO
3b949b9295
Add PyWavelets for test
2025-05-04 18:59:05 -04:00
rockerBOO
984472ca09
Fix metrics
2025-05-04 18:58:54 -04:00
rockerBOO
7be3c5dce1
Refactor SWT to work properly and faster. Add SWT tests
2025-05-04 18:57:53 -04:00
rockerBOO
964bfcb576
Fix padding for small latents. Add DWT tests
2025-05-04 18:57:42 -04:00
rockerBOO
d5f8f7de1f
Add wavelet loss fn
2025-05-04 18:57:10 -04:00
rockerBOO
56dfdae7c5
Add QuaternionWaveletTransform. Update WaveletLoss
2025-05-04 18:55:50 -04:00
rockerBOO
40128b7dc0
Use args.wavelet_loss to activate
2025-05-04 18:39:56 -04:00
rockerBOO
19ce0ae61f
Add wavelet_loss_band_level_weights
2025-05-04 18:39:51 -04:00
rockerBOO
7b9e92a8cc
Fix band weights via toml. Add more logging
2025-05-04 18:39:48 -04:00
rockerBOO
20a99771bf
Add back in padding
2025-05-04 18:39:45 -04:00
rockerBOO
f553b7bf31
Add wavelet loss recording
2025-05-04 18:39:36 -04:00
rockerBOO
6d42b95e2b
Refactor transforms, fix loss calculations
...
- add full conditional_loss functionality to wavelet loss
- Transforms are separate and abstracted
- Loss now doesn't include LL except the lowest level
- ll_level_threshold allows you to control the level the ll is
used in the loss
- band weights can now be passed in
- rectified flow calculations can be bypassed for experimentation
- Fixed alpha to 1.0 with new weighted bands producing lower loss
2025-05-04 18:39:32 -04:00
rockerBOO
64422ff4a0
Suggest the right module
2025-05-04 18:39:25 -04:00
rockerBOO
837231a5c7
Add wavelet loss
2025-05-04 18:39:17 -04:00
rockerBOO
813942a967
Add wavelet loss
2025-05-04 18:38:47 -04:00
Kohya S.
80320d21fe
Merge pull request #2066 from kohya-ss/quick-fix-flux-sampling-scales
...
Quick fix flux sampling scales
2025-04-27 23:39:47 +09:00
Kohya S
29523c9b68
docs: add note for user feedback on CFG scale in FLUX.1 training
2025-04-27 23:34:37 +09:00
Kohya S
fd3a445769
fix: revert default emb guidance scale and CFG scale for FLUX.1 sampling
2025-04-27 22:50:27 +09:00
Kohya S
13296ae93b
Merge branch 'sd3' of https://github.com/kohya-ss/sd-scripts into sd3
2025-04-27 21:48:03 +09:00
Kohya S
0e8ac43760
Merge branch 'dev' into sd3
2025-04-27 21:47:58 +09:00
Kohya S
bc9252cc1b
Merge branch 'main' into dev
2025-04-27 21:47:39 +09:00
Kohya S.
3b25de1f17
Merge pull request #2065 from kohya-ss/kohya-ss-funding-yml
...
Create FUNDING.yml
2025-04-27 21:29:44 +09:00
Kohya S.
f0b07c52ab
Create FUNDING.yml
2025-04-27 21:28:38 +09:00
Kohya S.
309c44bdf2
Merge pull request #2064 from kohya-ss/flux-sample-cfg
...
Add CFG for sampling in training with FLUX.1
2025-04-27 18:35:45 +09:00
Kohya S
8387e0b95c
docs: update README to include CFG scale support in FLUX.1 training
2025-04-27 18:25:59 +09:00
Kohya S
5c50cdbb44
Merge branch 'sd3' into flux-sample-cfg
2025-04-27 17:59:26 +09:00
Kohya S
b11c053b8f
Merge branch 'dev' into sd3
2025-04-22 21:48:24 +09:00
Kohya S.
c46f08a87a
Merge pull request #2053 from GlenCarpenter/main
...
fix: update hf_hub_download parameters to fix wd14 tagger regression
2025-04-22 21:47:29 +09:00
Glen
26db64be17
fix: update hf_hub_download parameters to fix wd14 tagger regression
2025-04-19 11:54:12 -06:00
Kohya S
629073cd9d
Add guidance scale for prompt param and flux sampling
2025-04-16 21:50:36 +09:00
Kohya S
06df0377f9
Merge branch 'sd3' into flux-sample-cfg
2025-04-16 21:27:08 +09:00
Kohya S
5a18a03ffc
Merge branch 'dev' into sd3
2025-04-07 21:55:17 +09:00
Kohya S
572cc3efb8
Merge branch 'main' into dev
2025-04-07 21:48:45 +09:00
Kohya S.
52c8dec953
Merge pull request #2015 from DKnight54/uncache_vae_batch
...
Using --vae_batch_size to set batch size for dynamic latent generation
2025-04-07 21:48:02 +09:00
Kohya S
4589262f8f
README.md: Update recent updates section to include IP noise gamma feature for FLUX.1
2025-04-06 21:34:27 +09:00
Kohya S.
c56dc90b26
Merge pull request #1992 from rockerBOO/flux-ip-noise-gamma
...
Add IP noise gamma for Flux
2025-04-06 21:29:26 +09:00
Kohya S.
ee0f754b08
Merge pull request #2028 from rockerBOO/patch-5
...
Fix resize PR link
2025-04-05 20:15:13 +09:00
Kohya S.
606e6875d2
Merge pull request #2022 from LexSong/fix-resize-issue
...
Fix size parameter types and improve resize_image interpolation
2025-04-05 19:28:25 +09:00
Dave Lage
fd36fd1aa9
Fix resize PR link
2025-04-03 16:09:45 -04:00
Kohya S.
92845e8806
Merge pull request #2026 from kohya-ss/fix-finetune-dataset-resize-interpolation
...
fix: add resize_interpolation parameter to FineTuningDataset constructor
2025-04-03 21:52:14 +09:00
Kohya S
f1423a7229
fix: add resize_interpolation parameter to FineTuningDataset constructor
2025-04-03 21:48:51 +09:00
Lex Song
b822b7e60b
Fix the interpolation logic error in resize_image()
...
The original code had a mistake. It used 'lanczos' when the image got smaller (width > resized_width and height > resized_height) and 'area' when it stayed the same or got bigger. This was the wrong way. 'area' is better for big shrinking.
2025-04-02 22:04:37 +08:00
Lex Song
ede3470260
Ensure all size parameters are integers to prevent type errors
2025-04-02 03:50:33 +08:00
Kohya S
b3c56b22bd
Merge branch 'dev' into sd3
2025-03-31 22:05:40 +09:00
Kohya S
583ab27b3c
doc: update license information in jpeg_xl_util.py
2025-03-31 22:02:25 +09:00
Kohya S.
aa5978dffd
Merge pull request #1955 from Disty0/dev
...
Fast image size reading support for JPEG XL
2025-03-31 22:00:31 +09:00
Kohya S
aaa26bb882
docs: update README to include LoRA-GGPO details for FLUX.1 training
2025-03-30 21:18:05 +09:00
Kohya S
d0b5c0e5cf
chore: formatting, add TODO comment
2025-03-30 21:15:37 +09:00
