478 Commits

Author	SHA1	Message	Date
Kohya S	6f6f9b537f	Merge pull request #364 from shirayu/check_needless_num_warmup_steps ... Check needless num_warmup_steps	2023-04-03 21:38:52 +09:00
Kohya S	f407f5a686	Merge pull request #352 from rockerBOO/dataset-config ... Open dataset_config json file before load	2023-04-03 21:31:55 +09:00
AI-Casanova	1892c82a60	Reinstantiate weighted captions after a necessary revert to Main	2023-04-02 19:43:34 +00:00
ddPn08	3f339cda6f	small fix	2023-04-02 23:21:17 +09:00
ddPn08	16ba1cec69	change async uploading to optional	2023-04-02 17:45:26 +09:00
ddPn08	8bfa50e283	small fix	2023-04-02 17:39:23 +09:00
ddPn08	c4a11e5a5a	fix help	2023-04-02 17:39:23 +09:00
ddPn08	3cc4939dd3	Implement huggingface upload for all scripts	2023-04-02 17:39:22 +09:00
ddPn08	b5ff4e816f	resume from huggingface repository	2023-04-02 17:39:21 +09:00
ddPn08	45381b188c	small fix	2023-04-02 17:39:20 +09:00
ddPn08	054fb3308c	use access token	2023-04-02 17:39:19 +09:00
ddPn08	d42431d73a	Added feature to upload to huggingface	2023-04-02 17:39:10 +09:00
Yuta Hayashibe	9577a9f38d	Check needless num_warmup_steps	2023-04-01 20:33:20 +09:00
u-haru	786971d443	Merge branch 'dev' into feature/stratified_lr	2023-04-01 15:08:41 +09:00
Kohya S	4627b389ff	fix device not specified in merge_lora.py	2023-04-01 09:15:57 +09:00
Kohya S	1cd07770a4	format by black	2023-04-01 09:13:47 +09:00
u-haru	1e164b6ec3	specify device when loading state_dict	2023-03-31 12:52:39 +09:00
u-haru	41ecccb2a9	Merge branch 'kohya-ss:main' into feature/stratified_lr	2023-03-31 12:47:56 +09:00
Kohya S	8cecc676cf	Fix device issue in load_file, reduce vram usage	2023-03-31 09:05:51 +09:00
u-haru	94441fa746	繰り返し回数のないディレクトリの名前表示修正	2023-03-31 02:26:54 +09:00
rockerBOO	313f3e8286	Open dataset_config json file before load	2023-03-30 12:08:04 -04:00
u-haru	b1dffe8d9a	ファイルロードができないバグ修正(Exception: device cuda is invalid)	2023-03-31 00:11:11 +09:00
Kohya S	31069e1dc5	add comments about debice for clarify	2023-03-30 21:44:40 +09:00
Kohya S	6c28dfb417	Merge pull request #332 from guaneec/ddp-lowram ... Reduce peak RAM usage	2023-03-30 21:37:37 +09:00
Jakaline-dev	b0c33a4294	Merge remote-tracking branch 'upstream/main'	2023-03-30 01:35:38 +09:00
Kohya S	4f70e5dca6	fix to work with num_workers=0	2023-03-28 19:42:47 +09:00
Kohya S	895b0b6ca7	Fix saving issue if epoch/step not in checkpoint	2023-03-27 21:22:32 +09:00
Kohya S	238f01bc9c	fix images are used twice, update debug dataset	2023-03-27 20:48:21 +09:00
Kohya S	43a08b4061	add ja comment	2023-03-27 20:47:27 +09:00
guaneec	3cdae0cbd2	Reduce peak RAM usage	2023-03-27 14:34:17 +08:00
Kohya S	14891523ce	fix seed for each dataset to make shuffling same	2023-03-26 22:17:03 +09:00
Kohya S	6732df93e2	Merge branch 'dev' into min-SNR	2023-03-26 17:10:53 +09:00
Kohya S	4f42f759ea	Merge pull request #322 from u-haru/feature/token_warmup ... タグ数を徐々に増やしながら学習するオプションの追加、persistent_workersに関する軽微なバグ修正	2023-03-26 17:05:59 +09:00
AI-Casanova	4c06bfad60	Fix for TypeError from bf16 precision: Thanks to mgz-dev	2023-03-26 00:01:29 +00:00
Jakaline-dev	a35d7ef227	Implement XTI	2023-03-26 05:26:10 +09:00
u-haru	a4b34a9c3c	blueprint_args_conflictは不要なため削除、shuffleが毎回行われる不具合修正	2023-03-26 03:26:55 +09:00
u-haru	5a3d564a30	print削除	2023-03-26 02:26:08 +09:00
u-haru	4dc1124f93	lora以外も対応	2023-03-26 02:19:55 +09:00
u-haru	292cdb8379	データセットにepoch、stepが通達されないバグ修正	2023-03-26 01:44:25 +09:00
u-haru	1b89b2a10e	シャッフル前にタグを切り詰めるように変更	2023-03-24 13:44:30 +09:00
u-haru	143c26e552	競合時にpersistant_data_loader側を無効にするように変更	2023-03-24 13:08:56 +09:00
AI-Casanova	518a18aeff	(ACTUAL) Min-SNR Weighting Strategy: Fixed SNR calculation to authors implementation	2023-03-23 12:34:49 +00:00
AI-Casanova	a3c7d711e4	Min-SNR Weighting Strategy: Fixed SNR calculation to authors implementation	2023-03-23 05:43:46 +00:00
u-haru	dbadc40ec2	persistent_workersを有効にした際にキャプションが変化しなくなるバグ修正	2023-03-23 12:33:03 +09:00
u-haru	447c56bf50	typo修正、stepをglobal_stepに修正、バグ修正	2023-03-23 09:53:14 +09:00
u-haru	a9b26b73e0	implement token warmup	2023-03-23 07:37:14 +09:00
AI-Casanova	64c923230e	Min-SNR Weighting Strategy: Refactored and added to all trainers	2023-03-22 01:27:29 +00:00
AI-Casanova	795a6bd2d8	Merge branch 'kohya-ss:main' into min-SNR	2023-03-21 13:19:15 -05:00
Kohya S	7b324bcc3b	support extensions of image files with uppercases	2023-03-21 21:10:34 +09:00
Kohya S	6d9f3bc0b2	fix different reso in batch	2023-03-21 18:33:46 +09:00