10 Commits

Author	SHA1	Message	Date
Yuta Hayashibe	5f6bf29e52	Replace print with logger if they are logs (#905) ... * Add get_my_logger() * Use logger instead of print * Fix log level * Removed line-breaks for readability * Use setup_logging() * Add rich to requirements.txt * Make simple * Use logger instead of print --------- Co-authored-by: Kohya S <52813779+kohya-ss@users.noreply.github.com>	2024-02-04 18:14:34 +09:00
Aarni Koskela	6f3f701d3d	Deduplicate ipex initialization code	2024-01-19 18:07:36 +02:00
Kohya S	04ef8d395f	speed up nan replace in sdxl training ref #1009	2023-12-21 21:44:03 +09:00
Isotr0py	db84530074	Fix gradients synchronization for multi-GPUs training (#989) ... * delete DDP wrapper * fix train_db vae and train_network * fix train_db vae and train_network unwrap * network grad sync --------- Co-authored-by: Kohya S <52813779+kohya-ss@users.noreply.github.com>	2023-12-07 22:01:42 +09:00
feffy380	6b3148fd3f	Fix min-snr-gamma for v-prediction and ZSNR. ... This fixes min-snr for vpred+zsnr by dividing directly by SNR+1. The old implementation did it in two steps: (min-snr/snr) * (snr/(snr+1)), which causes division by zero when combined with --zero_terminal_snr	2023-11-07 23:02:25 +01:00
Kohya S	9d6a5a0c79	Merge pull request #899 from shirayu/use_moving_average ... Show moving average loss in the progress bar	2023-10-29 14:37:58 +09:00
Yuta Hayashibe	9d00c8eea2	Use LossRecorder	2023-10-27 18:31:36 +09:00
青龍聖者@bdsqlsz	202f2c3292	Debias Estimation loss (#889) ... * update for bnb 0.41.1 * fixed generate_controlnet_subsets_config for training * Revert "update for bnb 0.41.1" This reverts commit 70bd3612d8. * add debiased_estimation_loss * add train_network * Revert "add train_network" This reverts commit 6539363c5c. * Update train_network.py	2023-10-23 22:59:14 +09:00
Yuta Hayashibe	27f9b6ffeb	updated typos to v1.16.15 and fix typos	2023-10-01 21:51:24 +09:00
Kohya S	3757855231	rename train_lllite_alt to train_lllite	2023-09-24 14:34:31 +09:00