VictorMylle/Kohya-ss-sd-scripts
1
0
Fork 1
mirror of https://github.com/kohya-ss/sd-scripts.git synced 2026-04-09 06:45:09 +00:00
Code Issues Packages Projects Releases Wiki Activity

Fix default LR, Add overall LoRA+ ratio, Add log

Browse Source 
`--loraplus_ratio` added for both TE and UNet
Add log for lora+
This commit is contained in:
rockerBOO
2024-04-08 19:23:02 -04:00
parent 1933ab4b48
commit 75833e84a1
5 changed files with 101 additions and 60 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
library/train_util.py
View File

@@ -2789,6 +2789,7 @@ def add_optimizer_arguments(parser: argparse.ArgumentParser):
default=1,
help="Polynomial power for polynomial scheduler / polynomialスケジューラでのpolynomial power",
)
parser.add_argument("--loraplus_lr_ratio", default=None, type=float, help="LoRA+ learning rate ratio")
parser.add_argument("--loraplus_unet_lr_ratio", default=None, type=float, help="LoRA+ UNet learning rate ratio")
parser.add_argument("--loraplus_text_encoder_lr_ratio", default=None, type=float, help="LoRA+ text encoder learning rate ratio")