rockerBOO
d40f5b1e4e
Revert "Scale sigmoid to default 1.0"
...
This reverts commit 8aa126582e .
2025-03-20 15:09:50 -04:00
rockerBOO
8aa126582e
Scale sigmoid to default 1.0
2025-03-20 15:09:11 -04:00
rockerBOO
e8b3254858
Add flux_train_utils tests for get get_noisy_model_input_and_timesteps
2025-03-20 15:01:15 -04:00
rockerBOO
16cef81aea
Refactor sigmas and timesteps
2025-03-20 14:32:56 -04:00
rockerBOO
f974c6b257
change order to match upstream
2025-03-19 14:27:43 -04:00
rockerBOO
5d5a7d2acf
Fix IP noise calculation
2025-03-19 13:50:04 -04:00
rockerBOO
1eddac26b0
Separate random to a variable, and make sure on device
2025-03-19 00:49:42 -04:00
rockerBOO
8e6817b0c2
Remove double noise
2025-03-19 00:45:13 -04:00
rockerBOO
d93ad90a71
Add perturbation on noisy_model_input if needed
2025-03-19 00:37:27 -04:00
rockerBOO
7197266703
Perturbed noise should be separate of input noise
2025-03-19 00:25:51 -04:00
rockerBOO
b81bcd0b01
Move IP noise gamma to noise creation to remove complexity and align noise for target loss
2025-03-18 21:36:55 -04:00
rockerBOO
6f4d365775
zeros_like because we are adding
2025-03-18 18:53:34 -04:00
rockerBOO
a4f3a9fc1a
Use ones_like
2025-03-18 18:44:21 -04:00
rockerBOO
b425466e7b
Fix IP noise gamma to use random values
2025-03-18 18:42:35 -04:00
rockerBOO
c8be141ae0
Apply IP gamma to noise fix
2025-03-18 15:42:18 -04:00
rockerBOO
0b25a05e3c
Add IP noise gamma for Flux
2025-03-18 15:40:40 -04:00
Kohya S
3d79239be4
docs: update README to include recent improvements in validation loss calculation
2025-02-26 21:21:04 +09:00
Kohya S
ec350c83eb
Merge branch 'dev' into sd3
2025-02-26 21:17:29 +09:00
Kohya S.
49651892ce
Merge pull request #1903 from kohya-ss/val-loss-improvement
...
Val loss improvement
2025-02-26 21:15:14 +09:00
Kohya S
1fcac98280
Merge branch 'sd3' into val-loss-improvement
2025-02-26 21:09:10 +09:00
Kohya S.
b286304e5f
Merge pull request #1953 from Disty0/dev
...
Update IPEX libs
2025-02-26 21:03:09 +09:00
Kohya S
ae409e83c9
fix: FLUX/SD3 network training not working without caching latents closes #1954
2025-02-26 20:56:32 +09:00
Disty0
f68702f71c
Update IPEX libs
2025-02-25 21:27:41 +03:00
Kohya S.
6e90c0f86c
Merge pull request #1909 from rockerBOO/progress_bar
...
Move progress bar to account for sampling image first
2025-02-24 18:57:44 +09:00
Kohya S
67fde015f7
Merge branch 'dev' into sd3
2025-02-24 18:56:15 +09:00
Kohya S.
386b7332c6
Merge pull request #1918 from tsukimiya/fix_vperd_warning
...
Remove v-pred warning.
2025-02-24 18:55:25 +09:00
Kohya S
905f081798
Merge branch 'dev' into sd3
2025-02-24 18:54:28 +09:00
Kohya S.
59ae9ea20c
Merge pull request #1945 from yidiq7/dev
...
Remove position_ids for V2
2025-02-24 18:53:46 +09:00
Kohya S
efb2a128cd
fix wandb val logging
2025-02-21 22:07:35 +09:00
Yidi
13df47516d
Remove position_ids for V2
...
The postions_ids cause errors for the newer version of transformer.
This has already been fixed in convert_ldm_clip_checkpoint_v1() but
not in v2.
The new code applies the same fix to convert_ldm_clip_checkpoint_v2().
2025-02-20 04:49:51 -05:00
Kohya S
4a36996134
modify log step calculation
2025-02-18 22:05:08 +09:00
Kohya S
dc7d5fb459
Merge branch 'sd3' into val-loss-improvement
2025-02-18 21:34:30 +09:00
Kohya S.
894037f2c6
Merge pull request #1943 from rockerBOO/validation-split-test
...
Fix validation split and add test
2025-02-18 21:30:32 +09:00
rockerBOO
9436b41061
Fix validation split and add test
2025-02-17 14:28:41 -05:00
Kohya S.
7c22e12a39
Merge pull request #1938 from rockerBOO/validation-epoch-loss-recorder
...
Fix validation epoch loss to check epoch average
2025-02-17 21:45:04 +09:00
Kohya S.
6051fa8217
Merge pull request #1940 from rockerBOO/split-size-fix
...
Fix sizes for validation split
2025-02-17 21:42:10 +09:00
rockerBOO
f3a010978c
Clear sizes for validation reg images to be consistent
2025-02-16 22:28:34 -05:00
rockerBOO
3c7496ae3f
Fix sizes for validation split
2025-02-16 22:18:14 -05:00
rockerBOO
4671e23778
Fix validation epoch loss to check epoch average
2025-02-16 01:42:44 -05:00
Kohya S
63337d9fe4
Merge branch 'sd3' into val-loss-improvement
2025-02-15 21:41:07 +09:00
Kohya S.
ee295c7d9f
Merge pull request #1935 from rockerBOO/validation-epoch-fix
...
Fix validation epoch divergence
2025-02-15 21:39:28 +09:00
rockerBOO
ab88b431b0
Fix validation epoch divergence
2025-02-14 11:14:38 -05:00
Kohya S
76b761943b
fix: simplify validation step condition in NetworkTrainer
2025-02-11 21:53:57 +09:00
Kohya S
cd80752175
fix: remove unused parameter 'accelerator' from encode_images_to_latents method
2025-02-11 21:42:58 +09:00
Kohya S
177203818a
fix: unpause training progress bar after vaidation
2025-02-11 21:42:46 +09:00
Kohya S
344845b429
fix: validation with block swap
2025-02-09 21:25:40 +09:00
Kohya S
0911683717
set python random state
2025-02-09 20:53:49 +09:00
Kohya S
a24db1d532
fix: validation timestep generation fails on SD/SDXL training
2025-02-04 22:02:42 +09:00
Kohya S
c5b803ce94
rng state management: Implement functions to get and set RNG states for consistent validation
2025-02-04 21:59:09 +09:00
tsukimiya
4a71687d20
不要な警告の削除
...
(おそらく be14c06267 の修正漏れ )
2025-02-04 00:42:27 +09:00