AI-Casanova 9c7237157d Dropout and Max Norm Regularization for LoRA training (#545) ...

* Instantiate max_norm

* minor

* Move to end of step

* argparse

* metadata

* phrasing

* Sqrt ratio and logging

* fix logging

* Dropout test

* Dropout Args

* Dropout changed to affect LoRA only

---------

Co-authored-by: Kohya S <52813779+kohya-ss@users.noreply.github.com>

2023-06-01 14:58:38 +09:00

154 KiB

Raw Blame History

View Raw