mgz-dev
b29c5a750c
expand optimizer options and refactor
...
Refactor code to make it easier to add new optimizers, and support alternate optimizer parameters
-move redundant code to train_util for initializing optimizers
- add SGD Nesterov optimizers as option (since they are already available)
- add new parameters which may be helpful for tuning existing and new optimizers
2023-02-19 17:45:09 -06:00
Kohya S
08ae46b163
Merge pull request #208 from space-nuko/add-optimizer-to-metadata
...
Add optimizer to metadata
v0.4.3
2023-02-19 17:21:57 +09:00
space-nuko
4e5db58a71
Add optimizer to metadata
2023-02-18 23:28:36 -08:00
Kohya S
a9d29ac78c
Merge pull request #207 from kohya-ss/dev
...
Dev
2023-02-19 15:29:40 +09:00
Kohya S
5c065eee79
update readme
2023-02-19 15:26:21 +09:00
Kohya S
048e7cd428
add lion optimizer support
2023-02-19 15:26:14 +09:00
Kohya S
a76ad2d1d5
add comment for future requirement update
2023-02-19 15:25:01 +09:00
Kohya S
9d0f9736bf
Merge pull request #202 from vladmandic/main
...
fix git path
2023-02-19 15:01:21 +09:00
Kohya S
00bb8a65a6
Merge pull request #200 from Isotr0py/lowram
...
Add '--lowram' argument
2023-02-19 14:32:32 +09:00
Vladimir Mandic
dac2bd163a
fix git path
2023-02-17 14:19:08 -05:00
Isotr0py
78d1fb5ce6
Add '--lowram' argument
2023-02-17 12:08:54 +08:00
Kohya S
14d7b24619
Merge pull request #198 from kohya-ss/dev
...
Dev
2023-02-16 22:35:47 +09:00
Kohya S
3bc0d83769
update readme
2023-02-16 22:21:51 +09:00
Kohya S
ffdfd5f615
fix name of loss for epoch
2023-02-16 22:21:36 +09:00
Kohya S
d01d953262
Merge pull request #196 from space-nuko/add-noise-offset-metadata
...
Add noise offset to metadata
2023-02-16 22:01:02 +09:00
Kohya S
914d1505df
Merge pull request #189 from shirayu/improve_loss_track
...
Show the moving average loss
2023-02-16 22:00:26 +09:00
space-nuko
496c8cdc09
Add noise-offset to metadata
2023-02-16 02:56:39 -08:00
Kohya S
82713e9aa6
Update README.md
2023-02-14 21:41:04 +09:00
Kohya S
e067d64b53
Merge pull request #190 from kohya-ss/dev
...
Dev
2023-02-14 21:32:03 +09:00
Kohya S
3d400667d2
fix typos
2023-02-14 21:29:40 +09:00
Kohya S
2aef2872fb
update readme
2023-02-14 21:28:34 +09:00
Kohya S
43c0a69843
Add noise_offset
2023-02-14 21:15:48 +09:00
Yuta Hayashibe
8aed5125de
Removed call of sum()
2023-02-14 21:11:30 +09:00
Kohya S
e0f007f2a9
Fix import
2023-02-14 20:55:38 +09:00
Kohya S
3c29784825
Add ja comment
2023-02-14 20:55:20 +09:00
Kohya S
8f1e930bf4
Merge pull request #187 from space-nuko/add-commit-hash
...
Add commit hash to metadata
2023-02-14 19:52:30 +09:00
Kohya S
f771396e90
Merge pull request #179 from mgz-dev/resize_lora-verbose-print
...
add verbosity option for resize_lora.py
2023-02-14 19:50:49 +09:00
Kohya S
f67b3f4452
Merge pull request #165 from Isotr0py/support-multi-gpu
...
Add support with multi-gpu train for train_newtork.py
2023-02-14 19:47:53 +09:00
Yuta Hayashibe
21f5b618c3
Show the moving average loss
2023-02-14 19:46:27 +09:00
space-nuko
5471b0deb0
Add commit hash to metadata
2023-02-13 02:58:06 -08:00
Isotr0py
2b1a3080e7
Add type checking
2023-02-12 15:32:38 +08:00
Isotr0py
92a1af8024
Merge branch 'kohya-ss:main' into support-multi-gpu
2023-02-12 15:06:46 +08:00
michaelgzhang
b35b053b8d
clean up print formatting
2023-02-11 03:14:43 -06:00
michaelgzhang
55521eece0
add verbosity option for resize_lora.py
...
add --verbose flag to print additional statistics during resize_lora function
correct some parameter references in resize_lora_model function
2023-02-11 02:38:13 -06:00
Kohya S
b32abdd327
Merge pull request #178 from kohya-ss/dev
...
Dev
2023-02-11 16:16:15 +09:00
Kohya S
d1ecfde487
fix typo
2023-02-11 16:12:27 +09:00
Kohya S
04ad46a9a7
update readme
2023-02-11 16:11:42 +09:00
Kohya S
4c561411aa
revert batch size limiting for bucket
2023-02-11 16:02:56 +09:00
Kohya S
43a41c6c43
Merge pull request #177 from kohya-ss/dev
...
Dev
2023-02-11 15:11:07 +09:00
Kohya S
5367daa210
update readme
2023-02-11 15:09:45 +09:00
Kohya S
b825e4602c
update readme
2023-02-11 15:05:45 +09:00
Kohya S
188e54b760
support multiple init words
2023-02-11 15:00:11 +09:00
Kohya S
2c5f5c324a
Fix crash TI train close #172 , tag drop wo shuffle
2023-02-11 14:41:44 +09:00
Kohya S
5777be5208
Update README.md
2023-02-11 13:36:33 +09:00
Kohya S
e727a0d222
Update README.md
2023-02-11 13:30:12 +09:00
Kohya S
cdd8882a01
Merge pull request #176 from kohya-ss/dev
...
Dev
2023-02-11 13:22:40 +09:00
Kohya S
3f3502fb57
add message
2023-02-11 13:20:58 +09:00
Kohya S
20c00603a8
Merge branch 'main' into dev
2023-02-11 13:16:13 +09:00
Kohya S
9239fefa52
add lora interrogator with text encoder
2023-02-11 13:15:57 +09:00
Kohya S
53d60543e5
Merge pull request #174 from kohya-ss/dev
...
Dev
2023-02-10 23:11:12 +09:00