42 Commits

Author	SHA1	Message	Date
Kohya S	67fde015f7	Merge branch 'dev' into sd3	2025-02-24 18:56:15 +09:00
tsukimiya	4a71687d20	不要な警告の削除 ... (おそらく be14c06267 の修正漏れ )	2025-02-04 00:42:27 +09:00
Kohya S	f2bc820133	support weighted captions for SD/SDXL	2024-10-11 08:48:55 +09:00
Kohya S	c2440f9e53	fix cond image normlization, add independent LR for control	2024-10-03 21:32:21 +09:00
Kohya S	41dee60383	Refactor caching mechanism for latents and text encoder outputs, etc.	2024-07-27 13:50:05 +09:00
Kohya S	9ddb4d7a01	update readme and help message etc.	2024-05-12 17:55:08 +09:00
Zovjsra	64916a35b2	add disable_mmap to args	2024-04-16 16:40:08 +08:00
Kohya S	eefb3cc1e7	Merge branch 'deep-speed' into deepspeed	2024-02-27 18:57:42 +09:00
Kohya S	358ca205a3	Merge branch 'dev' into dev_device_support	2024-02-12 13:01:54 +09:00
Kohya S	e24d9606a2	add clean_memory_on_device and use it from training	2024-02-12 11:10:52 +09:00
BootsofLagrangian	2824312d5e	fix vae type error during training sdxl	2024-02-05 20:13:28 +09:00
Yuta Hayashibe	5f6bf29e52	Replace print with logger if they are logs (#905) ... * Add get_my_logger() * Use logger instead of print * Fix log level * Removed line-breaks for readability * Use setup_logging() * Add rich to requirements.txt * Make simple * Use logger instead of print --------- Co-authored-by: Kohya S <52813779+kohya-ss@users.noreply.github.com>	2024-02-04 18:14:34 +09:00
Disty0	a6a2b5a867	Fix IPEX support and add XPU device to device_utils	2024-01-31 17:32:37 +03:00
Aarni Koskela	afc38707d5	Refactor memory cleaning into a single function	2024-01-23 14:28:50 +02:00
Isotr0py	db84530074	Fix gradients synchronization for multi-GPUs training (#989) ... * delete DDP wrapper * fix train_db vae and train_network * fix train_db vae and train_network unwrap * network grad sync --------- Co-authored-by: Kohya S <52813779+kohya-ss@users.noreply.github.com>	2023-12-07 22:01:42 +09:00
Kohya S	0ee75fd75d	fix typos, add comments etc.	2023-09-03 12:24:15 +09:00
Isotr0py	6155f9c171	intergrate fp16/bf16 to model loading	2023-08-27 19:16:23 +08:00
Kohya S	3307ccb2dc	revert default noise offset to 0 (None) in sdxl	2023-08-11 20:35:46 +09:00
Kohya S	c142dadb46	support sai model spec	2023-08-06 21:50:05 +09:00
Kohya S	b62185b821	change method name, add comments	2023-07-30 13:34:07 +09:00
Isotr0py	fdb58b0b62	fix mismatch dtype	2023-07-28 13:47:54 +08:00
Isotr0py	315fbc11e5	refactor model loading to catch error	2023-07-28 13:10:38 +08:00
Isotr0py	272dd993e6	Merge branch 'sdxl' into sdxl	2023-07-28 10:19:37 +08:00
Isotr0py	96a52d9810	add dtype to u-net loading	2023-07-27 23:58:25 +08:00
Isotr0py	50544b7805	fix pipeline dtype	2023-07-27 23:16:58 +08:00
Kohya S	b78c0e2a69	remove unused func	2023-07-25 19:07:26 +09:00
Isotr0py	bb167f94ca	init unet with empty weights	2023-07-23 13:17:11 +08:00
Kohya S	50b53e183e	re-organize import	2023-07-23 13:33:02 +09:00
Kohya S	fc276a51fb	fix invalid args checking in sdxl TI training	2023-07-20 14:50:57 +09:00
Kohya S	6d2d8dfd2f	add zero_terminal_snr option	2023-07-18 23:17:23 +09:00
Kohya S	516f64f4d9	add caching to disk for text encoder outputs	2023-07-16 14:53:47 +09:00
Kohya S	9de357e373	fix tokenizer 2 is not same as open clip tokenizer	2023-07-14 12:27:19 +09:00
Kohya S	b4a3824ce4	change tokenizer from open clip to transformers	2023-07-13 20:49:26 +09:00
Kohya S	8fa5fb2816	support diffusers format for SDXL	2023-07-12 21:57:14 +09:00
Kohya S	f54b784d88	support textual inversion training	2023-07-10 22:04:02 +09:00
Kohya S	0416f26a76	support multi gpu in caching text encoder outputs	2023-07-09 16:02:56 +09:00
ykume	fe7ede5af3	fix wrapper tokenizer not work for weighted prompt	2023-07-09 13:33:16 +09:00
Kohya S	64cf922841	add feature to sample images during sdxl training	2023-07-02 16:42:19 +09:00
Kohya S	d395bc0647	fix max_token_length not works for sdxl	2023-06-29 13:02:19 +09:00
Kohya S	a751dc25d6	use CLIPTextModelWithProjection	2023-06-27 20:48:06 +09:00
Kohya S	9ebebb22db	fix typos	2023-06-26 20:43:34 +09:00
Kohya S	747af145ed	add sdxl fine-tuning and LoRA	2023-06-26 08:07:24 +09:00