Kohya S.
6e90c0f86c
Merge pull request #1909 from rockerBOO/progress_bar
...
Move progress bar to account for sampling image first
2025-02-24 18:57:44 +09:00
Kohya S
67fde015f7
Merge branch 'dev' into sd3
2025-02-24 18:56:15 +09:00
Kohya S.
386b7332c6
Merge pull request #1918 from tsukimiya/fix_vperd_warning
...
Remove v-pred warning.
2025-02-24 18:55:25 +09:00
Kohya S
905f081798
Merge branch 'dev' into sd3
2025-02-24 18:54:28 +09:00
Kohya S.
59ae9ea20c
Merge pull request #1945 from yidiq7/dev
...
Remove position_ids for V2
2025-02-24 18:53:46 +09:00
Yidi
13df47516d
Remove position_ids for V2
...
The postions_ids cause errors for the newer version of transformer.
This has already been fixed in convert_ldm_clip_checkpoint_v1() but
not in v2.
The new code applies the same fix to convert_ldm_clip_checkpoint_v2().
2025-02-20 04:49:51 -05:00
Kohya S.
894037f2c6
Merge pull request #1943 from rockerBOO/validation-split-test
...
Fix validation split and add test
2025-02-18 21:30:32 +09:00
rockerBOO
9436b41061
Fix validation split and add test
2025-02-17 14:28:41 -05:00
Kohya S.
7c22e12a39
Merge pull request #1938 from rockerBOO/validation-epoch-loss-recorder
...
Fix validation epoch loss to check epoch average
2025-02-17 21:45:04 +09:00
Kohya S.
6051fa8217
Merge pull request #1940 from rockerBOO/split-size-fix
...
Fix sizes for validation split
2025-02-17 21:42:10 +09:00
rockerBOO
f3a010978c
Clear sizes for validation reg images to be consistent
2025-02-16 22:28:34 -05:00
rockerBOO
3c7496ae3f
Fix sizes for validation split
2025-02-16 22:18:14 -05:00
rockerBOO
4671e23778
Fix validation epoch loss to check epoch average
2025-02-16 01:42:44 -05:00
Kohya S.
ee295c7d9f
Merge pull request #1935 from rockerBOO/validation-epoch-fix
...
Fix validation epoch divergence
2025-02-15 21:39:28 +09:00
rockerBOO
ab88b431b0
Fix validation epoch divergence
2025-02-14 11:14:38 -05:00
tsukimiya
4a71687d20
不要な警告の削除
...
(おそらく be14c06267
2025-02-04 00:42:27 +09:00
rockerBOO
de830b8941
Move progress bar to account for sampling image first
2025-01-29 00:02:45 -05:00
Kohya S
0778dd9b1d
fix Text Encoder only LoRA training
2025-01-27 22:03:42 +09:00
Kohya S
59b3b94faf
README.md: Update limitation for validation loss support to include schedule-free optimizer
2025-01-26 21:52:58 +09:00
Kohya S.
f1ac81e07a
Merge pull request #1899 from kohya-ss/val-loss
...
Val loss
2025-01-26 21:32:29 +09:00
Kohya S
e8529613d8
README.md: Update recent updates section to include validation loss support for training scripts
2025-01-26 21:27:22 +09:00
Kohya S
58b82a576e
Fix to work with validation dataset
2025-01-26 21:21:21 +09:00
Kohya S.
b833d47afe
Merge pull request #1864 from rockerBOO/validation-loss-upstream
...
Validation loss
2025-01-26 21:08:14 +09:00
Kohya S
23ce75cf95
Merge branch 'dev' into sd3
2025-01-26 21:05:29 +09:00
Kohya S
6acdbed967
Merge branch 'dev' into sd3
2025-01-26 21:04:05 +09:00
rockerBOO
c04e5dfe92
Fix loss recorder on 0. Fix validation for cached runs. Assert on validation dataset
2025-01-23 09:57:24 -05:00
Kohya S.
6e3c1d0b58
Merge pull request #1879 from kohya-ss/dev
...
merge dev to main
2025-01-17 23:25:56 +09:00
Kohya S
345daaa986
update README for merging
2025-01-17 23:22:38 +09:00
rockerBOO
b489082495
Disable repeats for validation datasets
2025-01-12 16:42:04 -05:00
rockerBOO
25929dd0d7
Remove Validating... print to fix output layout
2025-01-12 15:38:57 -05:00
rockerBOO
ee9265cf26
Fix validate_every_n_steps for gradient accumulation
2025-01-12 14:56:35 -05:00
rockerBOO
0456858992
Fix validate_every_n_steps always running first step
2025-01-12 14:47:49 -05:00
rockerBOO
2bbb40ce51
Fix regularization images with validation
...
Adding metadata recording for validation arguments
Add comments about the validation split for clarity of intention
2025-01-12 14:29:50 -05:00
rockerBOO
4c61adc996
Add divergence to logs
...
Divergence is the difference between training and validation to
allow a clear value to indicate the difference between the two
in the logs.
2025-01-12 13:18:26 -05:00
rockerBOO
264167fa16
Apply is_training_dataset only to DreamBoothDataset. Add validation_split check and warning
2025-01-09 12:43:58 -05:00
rockerBOO
d6f158ddf6
Fix incorrect destructoring for load_abritrary_dataset
2025-01-08 18:48:05 -05:00
rockerBOO
1e61392cf2
Revert bucket_reso_steps to correct 64
2025-01-08 18:43:26 -05:00
rockerBOO
9fde0d7972
Handle tuple return from generate_dataset_group_by_blueprint
2025-01-08 18:38:20 -05:00
rockerBOO
556f3f1696
Fix documentation, remove unused function, fix bucket reso for sd1.5, fix multiple datasets
2025-01-08 13:41:15 -05:00
rockerBOO
1231f5114c
Remove unused train_util code, fix accelerate.log for wandb, add init_trackers library code
2025-01-07 22:31:41 -05:00
rockerBOO
742bee9738
Set validation steps in multiple lines for readability
2025-01-06 17:34:23 -05:00
rockerBOO
fcb2ff010c
Clean up some validation help documentation
2025-01-06 11:39:32 -05:00
rockerBOO
f8850296c8
Fix validate epoch, cleanup imports
2025-01-06 11:34:10 -05:00
rockerBOO
c64d1a22fc
Add validate_every_n_epochs, change name validate_every_n_steps
2025-01-06 11:30:21 -05:00
rockerBOO
1c63e7cc49
Cleanup unused code and formatting
2025-01-06 11:07:47 -05:00
rockerBOO
f4840ef29e
Revert train_db.py
2025-01-06 10:52:07 -05:00
rockerBOO
bbf6bbd5ea
Use self.get_noise_pred_and_target and drop fixed timesteps
2025-01-06 10:48:38 -05:00
rockerBOO
1c0ae306e5
Add missing functions for training batch
2025-01-03 15:43:02 -05:00
rockerBOO
1f9ba40b8b
Add step break for validation epoch. Remove unused variable
2025-01-03 15:32:07 -05:00
rockerBOO
695f38962c
Move get_huber_threshold_if_needed
2025-01-03 15:25:12 -05:00
