679 Commits

Author	SHA1	Message	Date
Kohya S	fbb98f144e	Merge branch 'dev' into deep-speed	2024-03-20 18:15:26 +09:00
Kohya S	9b6b39f204	Merge branch 'dev' into masked-loss	2024-03-20 18:14:36 +09:00
Kohya S	855add067b	update option help and readme	2024-03-20 18:14:05 +09:00
Kohya S	bf6cd4b9da	Merge pull request #1168 from gesen2egee/save_state_on_train_end ... Save state on train end	2024-03-20 18:02:13 +09:00
Kohya S	119cc99fb0	Merge pull request #1167 from Horizon1704/patch-1 ... Add "encoding='utf-8'" for --config_file	2024-03-20 17:39:08 +09:00
Kohya S	cf09c6aa9f	Merge pull request #1177 from KohakuBlueleaf/random-strength-noise ... Random strength for Noise Offset and input perturbation noise	2024-03-20 16:17:16 +09:00
Kohya S	86e40fabbc	Merge branch 'dev' into deep-speed	2024-03-17 19:30:42 +09:00
Kohya S	3419c3de0d	common masked loss func, apply to all training script	2024-03-17 19:30:20 +09:00
Kohya S	7081a0cf0f	extension of src image could be different than target image	2024-03-17 18:09:15 +09:00
Kohya S	0ef4fe70f0	Merge branch 'dev' into masked-loss	2024-03-17 11:18:18 +09:00
Kohya S	0a8ec5224e	Merge branch 'main' into dev	2024-03-15 21:33:07 +09:00
Kohya S	f811b115ba	fix sdxl timestep embedding	2024-03-15 21:05:00 +09:00
kblueleaf	53954a1e2e	use correct settings for parser	2024-03-13 18:21:49 +08:00
kblueleaf	86399407b2	random noise_offset strength	2024-03-13 18:21:49 +08:00
kblueleaf	948029fe61	random ip_noise_gamma strength	2024-03-13 18:21:49 +08:00
Kohya S	74c266a597	Merge branch 'dev' into masked-loss	2024-03-12 20:40:57 +09:00
gesen2egee	095b8035e6	save state on train end	2024-03-10 23:33:38 +08:00
Horizon1704	124ec45876	Add "encoding='utf-8'"	2024-03-10 22:53:05 +08:00
Kohya S	e3ccf8fbf7	make deepspeed_utils	2024-02-27 21:30:46 +09:00
Kohya S	eefb3cc1e7	Merge branch 'deep-speed' into deepspeed	2024-02-27 18:57:42 +09:00
Kohya S	074d32af20	Merge branch 'main' into dev	2024-02-27 18:53:43 +09:00
Kohya S	f2c727fc8c	add minimal impl for masked loss	2024-02-26 23:19:58 +09:00
Kohya S	577e9913ca	add some new dataset settings	2024-02-26 20:01:25 +09:00
Kohya S	fccbee2727	revert logging #1137	2024-02-25 10:43:14 +09:00
Yuta Hayashibe	5d5f39b6e6	Replaced print with logger	2024-02-25 01:24:11 +09:00
BootsofLagrangian	4d5186d1cf	refactored codes, some function moved into train_utils.py	2024-02-22 16:20:53 +09:00
Kohya S	d1fb480887	format by black	2024-02-18 09:13:24 +09:00
Kohya S	baa0e97ced	Merge branch 'dev' into dev_device_support	2024-02-17 11:54:07 +09:00
Kohya S	93bed60762	fix to work --console_log_xxx options	2024-02-12 14:49:29 +09:00
Kohya S	358ca205a3	Merge branch 'dev' into dev_device_support	2024-02-12 13:01:54 +09:00
Kohya S	98f42d3a0b	Merge branch 'dev' into gradual_latent_hires_fix	2024-02-12 12:59:25 +09:00
Kohya S	20ae603221	Merge branch 'dev' into gradual_latent_hires_fix	2024-02-12 11:26:36 +09:00
Kohya S	672851e805	Merge branch 'dev' into dev_improve_log	2024-02-12 11:24:33 +09:00
Kohya S	e579648ce9	fix help for highvram arg	2024-02-12 11:12:41 +09:00
Kohya S	e24d9606a2	add clean_memory_on_device and use it from training	2024-02-12 11:10:52 +09:00
Kohya S	75ecb047e2	Merge branch 'dev' into dev_device_support	2024-02-11 19:51:28 +09:00
BootsofLagrangian	03f0816f86	the reason not working grad accum steps found. it was becasue of my accelerate settings	2024-02-09 17:47:49 +09:00
Kohya S	5d9e2873f6	make rich to output to stderr instead of stdout	2024-02-08 21:38:02 +09:00
Kohya S	9b8ea12d34	update log initialization without rich	2024-02-08 21:06:39 +09:00
Kohya S	74fe0453b2	add comment for get_preferred_device	2024-02-08 20:58:54 +09:00
BootsofLagrangian	a98fecaeb1	forgot setting mixed_precision for deepspeed. sorry	2024-02-07 17:19:46 +09:00
BootsofLagrangian	62556619bd	fix full_fp16 compatible and train_step	2024-02-07 16:42:05 +09:00
BootsofLagrangian	3970bf4080	maybe fix branch to run offloading	2024-02-05 22:40:43 +09:00
BootsofLagrangian	2824312d5e	fix vae type error during training sdxl	2024-02-05 20:13:28 +09:00
BootsofLagrangian	64873c1b43	fix offload_optimizer_device typo	2024-02-05 17:11:50 +09:00
Kohya S	efd3b58973	Add logging arguments and update logging setup	2024-02-04 20:44:10 +09:00
Kohya S	6279b33736	fallback to basic logging if rich is not installed	2024-02-04 18:28:54 +09:00
Yuta Hayashibe	5f6bf29e52	Replace print with logger if they are logs (#905) ... * Add get_my_logger() * Use logger instead of print * Fix log level * Removed line-breaks for readability * Use setup_logging() * Add rich to requirements.txt * Make simple * Use logger instead of print --------- Co-authored-by: Kohya S <52813779+kohya-ss@users.noreply.github.com>	2024-02-04 18:14:34 +09:00
Kohya S	e793d7780d	reduce peak VRAM in sample gen	2024-02-04 17:31:01 +09:00
BootsofLagrangian	dfe08f395f	support deepspeed	2024-02-04 03:12:42 +09:00