Kohya S
5bb571ccc0
Merge branch 'main' into dev
2023-03-06 17:49:47 +09:00
camenduru
772ee52ef2
metadata |= to metadata.update
2023-03-06 00:31:28 +03:00
Isotr0py
4396350271
Add network_args to meta if using another network
2023-03-04 13:59:22 +08:00
Kohya S
5602e0e5fc
change dataset config option to dataset_config
2023-03-02 21:51:58 +09:00
Kohya S
09f575fd4d
merge image_dir for metadata editor
2023-03-02 21:17:25 +09:00
Kohya S
7e1aa5f4d6
keep tag_frequency for each dataset
2023-03-02 20:27:22 +09:00
Kohya S
e9f37c4049
do not save image_dir to metadata if None
2023-03-01 23:37:17 +09:00
Kohya S
c95943b663
merge tag frequence for metadata editor
2023-03-01 22:10:43 +09:00
Kohya S
ed19a92bbe
fix typos
2023-03-01 21:01:10 +09:00
fur0ut0
8abb8645ae
add detail dataset config feature by extra config file ( #227 )
...
* add config file schema
* change config file specification
* refactor config utility
* unify batch_size to train_batch_size
* fix indent size
* use batch_size instead of train_batch_size
* make cache_latents configurable on subset
* rename options
* bucket_repo_range
* shuffle_keep_tokens
* update readme
* revert to min_bucket_reso & max_bucket_reso
* use subset structure in dataset
* format import lines
* split mode specific options
* use only valid subset
* change valid subsets name
* manage multiple datasets by dataset group
* update config file sanitizer
* prune redundant validation
* add comments
* update type annotation
* rename json_file_name to metadata_file
* ignore when image dir is invalid
* fix tag shuffle and dropout
* ignore duplicated subset
* add method to check latent cachability
* fix format
* fix bug
* update caption dropout default values
* update annotation
* fix bug
* add option to enable bucket shuffle across dataset
* update blueprint generate function
* use blueprint generator for dataset initialization
* delete duplicated function
* update config readme
* delete debug print
* print dataset and subset info as info
* enable bucket_shuffle_across_dataset option
* update config readme for clarification
* compensate quotes for string option example
* fix bug of bad usage of join
* conserve trained metadata backward compatibility
* enable shuffle in data loader by default
* delete resolved TODO
* add comment for image data handling
* fix reference bug
* fix undefined variable bug
* prevent raise overwriting
* assert image_dir and metadata_file validity
* add debug message for ignoring subset
* fix inconsistent import statement
* loosen too strict validation on float value
* sanitize argument parser separately
* make image_dir optional for fine tuning dataset
* fix import
* fix trailing characters in print
* parse flexible dataset config deterministically
* use relative import
* print supplementary message for parsing error
* add note about different methods
* add note of benefit of separate dataset
* add error example
* add note for english readme plan
---------
Co-authored-by: Kohya S <52813779+kohya-ss@users.noreply.github.com >
2023-03-01 20:58:08 +09:00
Kohya S
dd523c94ff
sample images in training (not fully tested)
2023-02-27 17:48:32 +09:00
Kohya S
0eb01dea55
add max_grad_norm to metadata
2023-02-23 21:34:38 +09:00
Kohya S
95b5aed41b
Merge pull request #221 from space-nuko/add-more-metadata
...
Add more missing metadata
2023-02-23 21:14:26 +09:00
Kohya S
f403ac6132
fix float32 training doesn't work in some case
2023-02-23 20:56:41 +09:00
space-nuko
b39cf6e2c0
Add more missing metadata
2023-02-23 02:25:24 -08:00
Kohya S
9ab964d0b8
Add Adafactor optimzier
2023-02-22 21:09:47 +09:00
Kohya S
663aad2b0d
refactor get_scheduler etc.
2023-02-20 22:47:43 +09:00
Kohya S
107fa754e5
Merge branch 'dev' into optimizer-expand-and-refactor
2023-02-20 20:12:42 +09:00
mgz-dev
b29c5a750c
expand optimizer options and refactor
...
Refactor code to make it easier to add new optimizers, and support alternate optimizer parameters
-move redundant code to train_util for initializing optimizers
- add SGD Nesterov optimizers as option (since they are already available)
- add new parameters which may be helpful for tuning existing and new optimizers
2023-02-19 17:45:09 -06:00
unknown
045a3dbe48
apply dadaptation
2023-02-19 18:37:07 +09:00
space-nuko
4e5db58a71
Add optimizer to metadata
2023-02-18 23:28:36 -08:00
Kohya S
048e7cd428
add lion optimizer support
2023-02-19 15:26:14 +09:00
Isotr0py
78d1fb5ce6
Add '--lowram' argument
2023-02-17 12:08:54 +08:00
Kohya S
d01d953262
Merge pull request #196 from space-nuko/add-noise-offset-metadata
...
Add noise offset to metadata
2023-02-16 22:01:02 +09:00
Kohya S
914d1505df
Merge pull request #189 from shirayu/improve_loss_track
...
Show the moving average loss
2023-02-16 22:00:26 +09:00
space-nuko
496c8cdc09
Add noise-offset to metadata
2023-02-16 02:56:39 -08:00
Kohya S
43c0a69843
Add noise_offset
2023-02-14 21:15:48 +09:00
Yuta Hayashibe
8aed5125de
Removed call of sum()
2023-02-14 21:11:30 +09:00
Kohya S
e0f007f2a9
Fix import
2023-02-14 20:55:38 +09:00
Kohya S
8f1e930bf4
Merge pull request #187 from space-nuko/add-commit-hash
...
Add commit hash to metadata
2023-02-14 19:52:30 +09:00
Yuta Hayashibe
21f5b618c3
Show the moving average loss
2023-02-14 19:46:27 +09:00
space-nuko
5471b0deb0
Add commit hash to metadata
2023-02-13 02:58:06 -08:00
Isotr0py
2b1a3080e7
Add type checking
2023-02-12 15:32:38 +08:00
Isotr0py
92a1af8024
Merge branch 'kohya-ss:main' into support-multi-gpu
2023-02-12 15:06:46 +08:00
Kohya S
3a72e6f003
add tag dropout
2023-02-09 21:35:27 +09:00
Isotr0py
b8ad17902f
fix get_hidden_states expected scalar Error again
2023-02-08 23:09:59 +08:00
Isotr0py
9a9ac79edf
correct wrong inserted code for noise_pred fix
2023-02-08 22:30:20 +08:00
Isotr0py
6473aa1dd7
fix Input type error in noise_pred when using DDP
2023-02-08 21:32:21 +08:00
Isotr0py
b599adc938
fix Input type error when using DDP
2023-02-08 20:14:20 +08:00
Isotr0py
fb312acb7f
support DistributedDataParallel
2023-02-08 20:12:43 +08:00
Isotr0py
938bd71844
lower ram usage
2023-02-08 18:31:27 +08:00
Kohya S
e42b2f7aa9
conditional caption dropout (in progress)
2023-02-07 22:28:56 +09:00
forestsource
7db98baa86
Add dropout options
2023-02-07 00:01:30 +09:00
Kohya S
ea2dfd09ef
update bucketing features
2023-02-05 21:37:46 +09:00
Kohya S
9fd7fb813d
Merge branch 'dev' into main
2023-02-04 18:16:03 +09:00
Kohya S
58a809eaff
Add comment
2023-02-03 21:04:03 +09:00
hitomi
26a81d075c
add --persistent_data_loader_workers option
2023-02-01 16:02:15 +08:00
Kohya S
74eba06d13
Merge pull request #104 from space-nuko/caption-frequency-metadata
...
Add tag frequency metadata
2023-01-31 20:56:15 +09:00
Kohya S
7817e95a86
change name of arg
2023-01-29 20:28:24 +09:00
Kohya S
ed2e431950
Merge branch 'main' into caption-frequency-metadata
2023-01-29 17:50:23 +09:00
