Merge branch 'dev' into sd3

This commit is contained in:
Kohya S
2024-09-25 20:56:16 +09:00
2 changed files with 12 additions and 16 deletions

View File

@@ -681,6 +681,8 @@ The majority of scripts is licensed under ASL 2.0 (including codes from Diffuser
- transformers, accelerate and huggingface_hub are updated.
- If you encounter any issues, please report them.
- Fixed an issue where the timesteps in the batch were the same when using Huber loss. PR [#1628](https://github.com/kohya-ss/sd-scripts/pull/1628) Thanks to recris!
- Improvements in OFT (Orthogonal Finetuning) Implementation
1. Optimization of Calculation Order:
- Changed the calculation order in the forward method from (Wx)R to W(xR).