321 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Kohya S	f2b300a221	Add about optimizer	2023-02-22 22:04:53 +09:00
Kohya S	9ab964d0b8	Add Adafactor optimzier	2023-02-22 21:09:47 +09:00
Kohya S	663aad2b0d	refactor get_scheduler etc.	2023-02-20 22:47:43 +09:00
Kohya S	12d30afb39	Merge pull request #212 from mgz-dev/optimizer-expand-and-refactor ... expand optimizer options and refactor	2023-02-20 20:13:41 +09:00
Kohya S	107fa754e5	Merge branch 'dev' into optimizer-expand-and-refactor	2023-02-20 20:12:42 +09:00
Kohya S	a17d1180cb	Merge pull request #209 from BootsofLagrangian/dadaptation ... Dadaptation optimizer	2023-02-20 20:06:55 +09:00
mgz-dev	b29c5a750c	expand optimizer options and refactor ... Refactor code to make it easier to add new optimizers, and support alternate optimizer parameters -move redundant code to train_util for initializing optimizers - add SGD Nesterov optimizers as option (since they are already available) - add new parameters which may be helpful for tuning existing and new optimizers	2023-02-19 17:45:09 -06:00
unknown	b612d0b091	apply dadaptation	2023-02-19 19:07:26 +09:00
unknown	045a3dbe48	apply dadaptation	2023-02-19 18:37:07 +09:00
Kohya S	08ae46b163	Merge pull request #208 from space-nuko/add-optimizer-to-metadata ... Add optimizer to metadata v0.4.3	2023-02-19 17:21:57 +09:00
space-nuko	4e5db58a71	Add optimizer to metadata	2023-02-18 23:28:36 -08:00
Kohya S	a9d29ac78c	Merge pull request #207 from kohya-ss/dev ... Dev	2023-02-19 15:29:40 +09:00
Kohya S	5c065eee79	update readme	2023-02-19 15:26:21 +09:00
Kohya S	048e7cd428	add lion optimizer support	2023-02-19 15:26:14 +09:00
Kohya S	a76ad2d1d5	add comment for future requirement update	2023-02-19 15:25:01 +09:00
Kohya S	9d0f9736bf	Merge pull request #202 from vladmandic/main ... fix git path	2023-02-19 15:01:21 +09:00
Kohya S	00bb8a65a6	Merge pull request #200 from Isotr0py/lowram ... Add '--lowram' argument	2023-02-19 14:32:32 +09:00
Vladimir Mandic	dac2bd163a	fix git path	2023-02-17 14:19:08 -05:00
Isotr0py	78d1fb5ce6	Add '--lowram' argument	2023-02-17 12:08:54 +08:00
Kohya S	14d7b24619	Merge pull request #198 from kohya-ss/dev ... Dev	2023-02-16 22:35:47 +09:00
Kohya S	3bc0d83769	update readme	2023-02-16 22:21:51 +09:00
Kohya S	ffdfd5f615	fix name of loss for epoch	2023-02-16 22:21:36 +09:00
Kohya S	d01d953262	Merge pull request #196 from space-nuko/add-noise-offset-metadata ... Add noise offset to metadata	2023-02-16 22:01:02 +09:00
Kohya S	914d1505df	Merge pull request #189 from shirayu/improve_loss_track ... Show the moving average loss	2023-02-16 22:00:26 +09:00
space-nuko	496c8cdc09	Add noise-offset to metadata	2023-02-16 02:56:39 -08:00
Kohya S	82713e9aa6	Update README.md	2023-02-14 21:41:04 +09:00
Kohya S	e067d64b53	Merge pull request #190 from kohya-ss/dev ... Dev	2023-02-14 21:32:03 +09:00
Kohya S	3d400667d2	fix typos	2023-02-14 21:29:40 +09:00
Kohya S	2aef2872fb	update readme	2023-02-14 21:28:34 +09:00
Kohya S	43c0a69843	Add noise_offset	2023-02-14 21:15:48 +09:00
Yuta Hayashibe	8aed5125de	Removed call of sum()	2023-02-14 21:11:30 +09:00
Kohya S	e0f007f2a9	Fix import	2023-02-14 20:55:38 +09:00
Kohya S	3c29784825	Add ja comment	2023-02-14 20:55:20 +09:00
Kohya S	8f1e930bf4	Merge pull request #187 from space-nuko/add-commit-hash ... Add commit hash to metadata	2023-02-14 19:52:30 +09:00
Kohya S	f771396e90	Merge pull request #179 from mgz-dev/resize_lora-verbose-print ... add verbosity option for resize_lora.py	2023-02-14 19:50:49 +09:00
Kohya S	f67b3f4452	Merge pull request #165 from Isotr0py/support-multi-gpu ... Add support with multi-gpu train for train_newtork.py	2023-02-14 19:47:53 +09:00
Yuta Hayashibe	21f5b618c3	Show the moving average loss	2023-02-14 19:46:27 +09:00
space-nuko	5471b0deb0	Add commit hash to metadata	2023-02-13 02:58:06 -08:00
Isotr0py	2b1a3080e7	Add type checking	2023-02-12 15:32:38 +08:00
Isotr0py	92a1af8024	Merge branch 'kohya-ss:main' into support-multi-gpu	2023-02-12 15:06:46 +08:00
michaelgzhang	b35b053b8d	clean up print formatting	2023-02-11 03:14:43 -06:00
michaelgzhang	55521eece0	add verbosity option for resize_lora.py ... add --verbose flag to print additional statistics during resize_lora function correct some parameter references in resize_lora_model function	2023-02-11 02:38:13 -06:00
Kohya S	b32abdd327	Merge pull request #178 from kohya-ss/dev ... Dev	2023-02-11 16:16:15 +09:00
Kohya S	d1ecfde487	fix typo	2023-02-11 16:12:27 +09:00
Kohya S	04ad46a9a7	update readme	2023-02-11 16:11:42 +09:00
Kohya S	4c561411aa	revert batch size limiting for bucket	2023-02-11 16:02:56 +09:00
Kohya S	43a41c6c43	Merge pull request #177 from kohya-ss/dev ... Dev	2023-02-11 15:11:07 +09:00
Kohya S	5367daa210	update readme	2023-02-11 15:09:45 +09:00
Kohya S	b825e4602c	update readme	2023-02-11 15:05:45 +09:00
Kohya S	188e54b760	support multiple init words	2023-02-11 15:00:11 +09:00