青龍聖者@bdsqlsz fd68703f37 Add New lr scheduler (#1393) ...

* add new lr scheduler

* fix bugs and use num_cycles / 2

* Update requirements.txt

* add num_cycles for min lr

* keep PIECEWISE_CONSTANT

* allow use float with warmup or decay ratio.

* Update train_util.py

2024-09-11 21:25:45 +09:00

240 KiB

Raw Blame History

View Raw