2312 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
sdbds	fc772affbe	1、Implement cfg_trunc calculation directly using timesteps, without intermediate steps. ... 2、Deprecate and remove the guidance_scale parameter because it used in inference not train 3、Add inference command-line arguments --ct for cfg_trunc_ratio and --rc for renorm_cfg to control CFG truncation and renormalization during inference.	2025-02-24 14:10:24 +08:00
青龍聖者@bdsqlsz	653621de57	Merge pull request #15 from rockerBOO/samples-training ... Fix samples, LoRA training. Add system prompt, use_flash_attn	2025-02-24 11:24:53 +08:00
rockerBOO	2c94d17f05	Fix typo	2025-02-23 20:21:06 -05:00
rockerBOO	48e7da2d4a	Add sample batch size for Lumina	2025-02-23 20:19:24 -05:00
rockerBOO	ba725a84e9	Set default discrete_flow_shift to 6.0. Remove default system prompt.	2025-02-23 18:01:09 -05:00
rockerBOO	42a801514c	Fix system prompt in datasets	2025-02-23 13:48:37 -05:00
rockerBOO	6d7bec8a37	Remove non-used code	2025-02-23 01:46:47 -05:00
rockerBOO	025cca699b	Fix samples, LoRA training. Add system prompt, use_flash_attn	2025-02-23 01:29:18 -05:00
Kohya S	efb2a128cd	fix wandb val logging	2025-02-21 22:07:35 +09:00
Yidi	13df47516d	Remove position_ids for V2 ... The postions_ids cause errors for the newer version of transformer. This has already been fixed in convert_ldm_clip_checkpoint_v1() but not in v2. The new code applies the same fix to convert_ldm_clip_checkpoint_v2().	2025-02-20 04:49:51 -05:00
rockerBOO	7f2747176b	Use resize_image where resizing is required	2025-02-19 14:20:40 -05:00
rockerBOO	ca1c129ffd	Fix metadata	2025-02-19 14:20:40 -05:00
rockerBOO	545425c13e	Typo	2025-02-19 14:20:40 -05:00
rockerBOO	7729c4c8f9	Add metadata	2025-02-19 14:20:40 -05:00
rockerBOO	d0128d18be	Add resize interpolation CLI option	2025-02-19 14:20:40 -05:00
rockerBOO	58e9e146a3	Add resize interpolation configuration	2025-02-19 14:20:40 -05:00
青龍聖者@bdsqlsz	6597631b90	Merge pull request #14 from rockerBOO/samples-attention ... Samples attention	2025-02-19 13:08:00 +08:00
Kohya S	4a36996134	modify log step calculation	2025-02-18 22:05:08 +09:00
Kohya S	dc7d5fb459	Merge branch 'sd3' into val-loss-improvement	2025-02-18 21:34:30 +09:00
Kohya S.	894037f2c6	Merge pull request #1943 from rockerBOO/validation-split-test ... Fix validation split and add test	2025-02-18 21:30:32 +09:00
rockerBOO	bd16bd13ae	Remove unused attention, fix typo	2025-02-18 01:21:18 -05:00
rockerBOO	98efbc3bb7	Add documentation to model, use SDPA attention, sample images	2025-02-18 00:58:53 -05:00
rockerBOO	9436b41061	Fix validation split and add test	2025-02-17 14:28:41 -05:00
rockerBOO	1aa2f00e85	Fix validation epoch loss to check epoch average	2025-02-17 12:07:23 -05:00
rockerBOO	3ed7606f88	Clear sizes for validation reg images to be consistent	2025-02-17 12:07:23 -05:00
rockerBOO	3365cfadd7	Fix sizes for validation split	2025-02-17 12:07:23 -05:00
rockerBOO	44782dd790	Fix validation epoch divergence	2025-02-17 12:07:22 -05:00
Kohya S.	7c22e12a39	Merge pull request #1938 from rockerBOO/validation-epoch-loss-recorder ... Fix validation epoch loss to check epoch average	2025-02-17 21:45:04 +09:00
Kohya S.	6051fa8217	Merge pull request #1940 from rockerBOO/split-size-fix ... Fix sizes for validation split	2025-02-17 21:42:10 +09:00
sdbds	aa36c48685	update for always use gemma2 mask	2025-02-17 19:00:18 +08:00
青龍聖者@bdsqlsz	bb7bae5dff	Merge pull request #13 from rockerBOO/lumina-cache-checkpointing ... Lumina cache checkpointing	2025-02-17 15:43:54 +08:00
sdbds	3ce23b7f16	Merge branch 'lumina' of https://github.com/sdbds/sd-scripts into lumina ... # Conflicts: # library/lumina_models.py	2025-02-17 14:53:16 +08:00
sdbds	733fdc09c6	update	2025-02-17 14:52:48 +08:00
rockerBOO	f3a010978c	Clear sizes for validation reg images to be consistent	2025-02-16 22:28:34 -05:00
rockerBOO	3c7496ae3f	Fix sizes for validation split	2025-02-16 22:18:14 -05:00
青龍聖者@bdsqlsz	6965a0178a	Merge pull request #12 from rockerBOO/lumina-model-loading ... Lumina 2 and Gemma 2 model loading	2025-02-17 00:47:08 +08:00
rockerBOO	4671e23778	Fix validation epoch loss to check epoch average	2025-02-16 01:42:44 -05:00
rockerBOO	16015635d2	Update metadata.resolution for Lumina 2	2025-02-16 01:36:29 -05:00
rockerBOO	60a76ebb72	Add caching gemma2, add gradient checkpointing, refactor lumina model code	2025-02-16 01:06:34 -05:00
rockerBOO	a00b06bc97	Lumina 2 and Gemma 2 model loading	2025-02-15 14:56:11 -05:00
Kohya S	63337d9fe4	Merge branch 'sd3' into val-loss-improvement	2025-02-15 21:41:07 +09:00
Kohya S.	ee295c7d9f	Merge pull request #1935 from rockerBOO/validation-epoch-fix ... Fix validation epoch divergence	2025-02-15 21:39:28 +09:00
sdbds	7323ee1b9d	update lora_lumina	2025-02-15 17:10:34 +08:00
sdbds	c0caf33e3f	update	2025-02-15 16:38:59 +08:00
rockerBOO	ab88b431b0	Fix validation epoch divergence	2025-02-14 11:14:38 -05:00
sdbds	d154e76c45	init	2025-02-12 16:30:05 +08:00
Kohya S	76b761943b	fix: simplify validation step condition in NetworkTrainer	2025-02-11 21:53:57 +09:00
Kohya S	cd80752175	fix: remove unused parameter 'accelerator' from encode_images_to_latents method	2025-02-11 21:42:58 +09:00
Kohya S	177203818a	fix: unpause training progress bar after vaidation	2025-02-11 21:42:46 +09:00
Kohya S	344845b429	fix: validation with block swap	2025-02-09 21:25:40 +09:00