Kohya S
|
5114e8daf1
|
fix training scripts except controlnet not working
|
2023-06-22 08:46:53 +09:00 |
|
ddPn08
|
62d00b4520
|
add controlnet training
|
2023-06-01 20:48:25 +09:00 |
|
Kohya S
|
f407f5a686
|
Merge pull request #352 from rockerBOO/dataset-config
Open dataset_config json file before load
|
2023-04-03 21:31:55 +09:00 |
|
u-haru
|
94441fa746
|
繰り返し回数のないディレクトリの名前表示修正
|
2023-03-31 02:26:54 +09:00 |
|
rockerBOO
|
313f3e8286
|
Open dataset_config json file before load
|
2023-03-30 12:08:04 -04:00 |
|
Kohya S
|
14891523ce
|
fix seed for each dataset to make shuffling same
|
2023-03-26 22:17:03 +09:00 |
|
u-haru
|
a4b34a9c3c
|
blueprint_args_conflictは不要なため削除、shuffleが毎回行われる不具合修正
|
2023-03-26 03:26:55 +09:00 |
|
u-haru
|
292cdb8379
|
データセットにepoch、stepが通達されないバグ修正
|
2023-03-26 01:44:25 +09:00 |
|
u-haru
|
143c26e552
|
競合時にpersistant_data_loader側を無効にするように変更
|
2023-03-24 13:08:56 +09:00 |
|
u-haru
|
dbadc40ec2
|
persistent_workersを有効にした際にキャプションが変化しなくなるバグ修正
|
2023-03-23 12:33:03 +09:00 |
|
u-haru
|
447c56bf50
|
typo修正、stepをglobal_stepに修正、バグ修正
|
2023-03-23 09:53:14 +09:00 |
|
u-haru
|
a9b26b73e0
|
implement token warmup
|
2023-03-23 07:37:14 +09:00 |
|
Kohya S
|
46aee85d2a
|
re2-fix to support python 3.8/3.9
|
2023-03-05 23:27:16 +09:00 |
|
Kohya S
|
2ae33db83f
|
re-fix to support python 3.8/3.9
|
2023-03-05 22:35:32 +09:00 |
|
Kohya S
|
dd39e5d944
|
hope to support python 3.8/3.9
|
2023-03-05 20:04:18 +09:00 |
|
Kohya S
|
5602e0e5fc
|
change dataset config option to dataset_config
|
2023-03-02 21:51:58 +09:00 |
|
Kohya S
|
83bfb54f20
|
fix num_repeats not working in DB classic dataset
|
2023-03-02 19:01:22 +09:00 |
|
Kohya S
|
d1d7d432e9
|
print dataset index in making buckets
|
2023-03-01 21:30:12 +09:00 |
|
fur0ut0
|
8abb8645ae
|
add detail dataset config feature by extra config file (#227)
* add config file schema
* change config file specification
* refactor config utility
* unify batch_size to train_batch_size
* fix indent size
* use batch_size instead of train_batch_size
* make cache_latents configurable on subset
* rename options
* bucket_repo_range
* shuffle_keep_tokens
* update readme
* revert to min_bucket_reso & max_bucket_reso
* use subset structure in dataset
* format import lines
* split mode specific options
* use only valid subset
* change valid subsets name
* manage multiple datasets by dataset group
* update config file sanitizer
* prune redundant validation
* add comments
* update type annotation
* rename json_file_name to metadata_file
* ignore when image dir is invalid
* fix tag shuffle and dropout
* ignore duplicated subset
* add method to check latent cachability
* fix format
* fix bug
* update caption dropout default values
* update annotation
* fix bug
* add option to enable bucket shuffle across dataset
* update blueprint generate function
* use blueprint generator for dataset initialization
* delete duplicated function
* update config readme
* delete debug print
* print dataset and subset info as info
* enable bucket_shuffle_across_dataset option
* update config readme for clarification
* compensate quotes for string option example
* fix bug of bad usage of join
* conserve trained metadata backward compatibility
* enable shuffle in data loader by default
* delete resolved TODO
* add comment for image data handling
* fix reference bug
* fix undefined variable bug
* prevent raise overwriting
* assert image_dir and metadata_file validity
* add debug message for ignoring subset
* fix inconsistent import statement
* loosen too strict validation on float value
* sanitize argument parser separately
* make image_dir optional for fine tuning dataset
* fix import
* fix trailing characters in print
* parse flexible dataset config deterministically
* use relative import
* print supplementary message for parsing error
* add note about different methods
* add note of benefit of separate dataset
* add error example
* add note for english readme plan
---------
Co-authored-by: Kohya S <52813779+kohya-ss@users.noreply.github.com>
|
2023-03-01 20:58:08 +09:00 |
|