29 Commits

Author	SHA1	Message	Date
Aarni Koskela	afc38707d5	Refactor memory cleaning into a single function	2024-01-23 14:28:50 +02:00
Isotr0py	db84530074	Fix gradients synchronization for multi-GPUs training (#989) ... * delete DDP wrapper * fix train_db vae and train_network * fix train_db vae and train_network unwrap * network grad sync --------- Co-authored-by: Kohya S <52813779+kohya-ss@users.noreply.github.com>	2023-12-07 22:01:42 +09:00
Kohya S	0ee75fd75d	fix typos, add comments etc.	2023-09-03 12:24:15 +09:00
Isotr0py	6155f9c171	intergrate fp16/bf16 to model loading	2023-08-27 19:16:23 +08:00
Kohya S	3307ccb2dc	revert default noise offset to 0 (None) in sdxl	2023-08-11 20:35:46 +09:00
Kohya S	c142dadb46	support sai model spec	2023-08-06 21:50:05 +09:00
Kohya S	b62185b821	change method name, add comments	2023-07-30 13:34:07 +09:00
Isotr0py	fdb58b0b62	fix mismatch dtype	2023-07-28 13:47:54 +08:00
Isotr0py	315fbc11e5	refactor model loading to catch error	2023-07-28 13:10:38 +08:00
Isotr0py	272dd993e6	Merge branch 'sdxl' into sdxl	2023-07-28 10:19:37 +08:00
Isotr0py	96a52d9810	add dtype to u-net loading	2023-07-27 23:58:25 +08:00
Isotr0py	50544b7805	fix pipeline dtype	2023-07-27 23:16:58 +08:00
Kohya S	b78c0e2a69	remove unused func	2023-07-25 19:07:26 +09:00
Isotr0py	bb167f94ca	init unet with empty weights	2023-07-23 13:17:11 +08:00
Kohya S	50b53e183e	re-organize import	2023-07-23 13:33:02 +09:00
Kohya S	fc276a51fb	fix invalid args checking in sdxl TI training	2023-07-20 14:50:57 +09:00
Kohya S	6d2d8dfd2f	add zero_terminal_snr option	2023-07-18 23:17:23 +09:00
Kohya S	516f64f4d9	add caching to disk for text encoder outputs	2023-07-16 14:53:47 +09:00
Kohya S	9de357e373	fix tokenizer 2 is not same as open clip tokenizer	2023-07-14 12:27:19 +09:00
Kohya S	b4a3824ce4	change tokenizer from open clip to transformers	2023-07-13 20:49:26 +09:00
Kohya S	8fa5fb2816	support diffusers format for SDXL	2023-07-12 21:57:14 +09:00
Kohya S	f54b784d88	support textual inversion training	2023-07-10 22:04:02 +09:00
Kohya S	0416f26a76	support multi gpu in caching text encoder outputs	2023-07-09 16:02:56 +09:00
ykume	fe7ede5af3	fix wrapper tokenizer not work for weighted prompt	2023-07-09 13:33:16 +09:00
Kohya S	64cf922841	add feature to sample images during sdxl training	2023-07-02 16:42:19 +09:00
Kohya S	d395bc0647	fix max_token_length not works for sdxl	2023-06-29 13:02:19 +09:00
Kohya S	a751dc25d6	use CLIPTextModelWithProjection	2023-06-27 20:48:06 +09:00
Kohya S	9ebebb22db	fix typos	2023-06-26 20:43:34 +09:00
Kohya S	747af145ed	add sdxl fine-tuning and LoRA	2023-06-26 08:07:24 +09:00