diff --git a/README.md b/README.md index 426eaed8..59b0e676 100644 --- a/README.md +++ b/README.md @@ -14,6 +14,10 @@ The command to install PyTorch is as follows: ### Recent Updates +Mar 20, 2025: +- `pytorch-optimizer` is added to requirements.txt. Thank you to gesen2egee for PR [#1985](https://github.com/kohya-ss/sd-scripts/pull/1985). + - For example, you can use CAME optimizer with `--optimizer_type "pytorch_optimizer.CAME" --optimizer_args "weight_decay=0.01"`. + Mar 6, 2025: - Added a utility script to merge the weights of SD3's DiT, VAE (optional), CLIP-L, CLIP-G, and T5XXL into a single .safetensors file. Run `tools/merge_sd3_safetensors.py`. See `--help` for usage. PR [#1960](https://github.com/kohya-ss/sd-scripts/pull/1960) diff --git a/requirements.txt b/requirements.txt index 7348647f..767d9e8e 100644 --- a/requirements.txt +++ b/requirements.txt @@ -9,6 +9,9 @@ pytorch-lightning==1.9.0 bitsandbytes==0.44.0 lion-pytorch==0.0.6 schedulefree==1.4 +pytorch-optimizer==3.5.0 +prodigy-plus-schedule-free==1.9.0 +prodigyopt==1.1.2 tensorboard safetensors==0.4.4 # gradio==3.16.2 @@ -42,7 +45,4 @@ rich==13.7.0 # for T5XXL tokenizer (SD3/FLUX) sentencepiece==0.2.0 # for kohya_ss library -pytorch-optimizer -prodigy-plus-schedule-free==1.9.0 -prodigyopt==1.1.2 -e .