sdbds
a1a5627b13
fix shift
2025-02-26 11:35:38 +08:00
sdbds
ce37c08b9a
clean code and add finetune code
2025-02-26 11:20:03 +08:00
Disty0
f68702f71c
Update IPEX libs
2025-02-25 21:27:41 +03:00
sdbds
5f9047c8cf
add truncation when > max_length
2025-02-26 01:00:35 +08:00
Kohya S.
6e90c0f86c
Merge pull request #1909 from rockerBOO/progress_bar
...
Move progress bar to account for sampling image first
2025-02-24 18:57:44 +09:00
Kohya S
67fde015f7
Merge branch 'dev' into sd3
2025-02-24 18:56:15 +09:00
Kohya S.
386b7332c6
Merge pull request #1918 from tsukimiya/fix_vperd_warning
...
Remove v-pred warning.
2025-02-24 18:55:25 +09:00
Kohya S
905f081798
Merge branch 'dev' into sd3
2025-02-24 18:54:28 +09:00
Kohya S.
59ae9ea20c
Merge pull request #1945 from yidiq7/dev
...
Remove position_ids for V2
2025-02-24 18:53:46 +09:00
sdbds
fc772affbe
1、Implement cfg_trunc calculation directly using timesteps, without intermediate steps.
...
2、Deprecate and remove the guidance_scale parameter because it used in inference not train
3、Add inference command-line arguments --ct for cfg_trunc_ratio and --rc for renorm_cfg to control CFG truncation and renormalization during inference.
2025-02-24 14:10:24 +08:00
青龍聖者@bdsqlsz
653621de57
Merge pull request #15 from rockerBOO/samples-training
...
Fix samples, LoRA training. Add system prompt, use_flash_attn
2025-02-24 11:24:53 +08:00
rockerBOO
2c94d17f05
Fix typo
2025-02-23 20:21:06 -05:00
rockerBOO
48e7da2d4a
Add sample batch size for Lumina
2025-02-23 20:19:24 -05:00
rockerBOO
ba725a84e9
Set default discrete_flow_shift to 6.0. Remove default system prompt.
2025-02-23 18:01:09 -05:00
rockerBOO
42a801514c
Fix system prompt in datasets
2025-02-23 13:48:37 -05:00
rockerBOO
6d7bec8a37
Remove non-used code
2025-02-23 01:46:47 -05:00
rockerBOO
025cca699b
Fix samples, LoRA training. Add system prompt, use_flash_attn
2025-02-23 01:29:18 -05:00
Kohya S
efb2a128cd
fix wandb val logging
2025-02-21 22:07:35 +09:00
Yidi
13df47516d
Remove position_ids for V2
...
The postions_ids cause errors for the newer version of transformer.
This has already been fixed in convert_ldm_clip_checkpoint_v1() but
not in v2.
The new code applies the same fix to convert_ldm_clip_checkpoint_v2().
2025-02-20 04:49:51 -05:00
rockerBOO
7f2747176b
Use resize_image where resizing is required
2025-02-19 14:20:40 -05:00
rockerBOO
ca1c129ffd
Fix metadata
2025-02-19 14:20:40 -05:00
rockerBOO
545425c13e
Typo
2025-02-19 14:20:40 -05:00
rockerBOO
7729c4c8f9
Add metadata
2025-02-19 14:20:40 -05:00
rockerBOO
d0128d18be
Add resize interpolation CLI option
2025-02-19 14:20:40 -05:00
rockerBOO
58e9e146a3
Add resize interpolation configuration
2025-02-19 14:20:40 -05:00
青龍聖者@bdsqlsz
6597631b90
Merge pull request #14 from rockerBOO/samples-attention
...
Samples attention
2025-02-19 13:08:00 +08:00
Kohya S
4a36996134
modify log step calculation
2025-02-18 22:05:08 +09:00
Kohya S
dc7d5fb459
Merge branch 'sd3' into val-loss-improvement
2025-02-18 21:34:30 +09:00
Kohya S.
894037f2c6
Merge pull request #1943 from rockerBOO/validation-split-test
...
Fix validation split and add test
2025-02-18 21:30:32 +09:00
rockerBOO
bd16bd13ae
Remove unused attention, fix typo
2025-02-18 01:21:18 -05:00
rockerBOO
98efbc3bb7
Add documentation to model, use SDPA attention, sample images
2025-02-18 00:58:53 -05:00
rockerBOO
9436b41061
Fix validation split and add test
2025-02-17 14:28:41 -05:00
rockerBOO
1aa2f00e85
Fix validation epoch loss to check epoch average
2025-02-17 12:07:23 -05:00
rockerBOO
3ed7606f88
Clear sizes for validation reg images to be consistent
2025-02-17 12:07:23 -05:00
rockerBOO
3365cfadd7
Fix sizes for validation split
2025-02-17 12:07:23 -05:00
rockerBOO
44782dd790
Fix validation epoch divergence
2025-02-17 12:07:22 -05:00
Kohya S.
7c22e12a39
Merge pull request #1938 from rockerBOO/validation-epoch-loss-recorder
...
Fix validation epoch loss to check epoch average
2025-02-17 21:45:04 +09:00
Kohya S.
6051fa8217
Merge pull request #1940 from rockerBOO/split-size-fix
...
Fix sizes for validation split
2025-02-17 21:42:10 +09:00
sdbds
aa36c48685
update for always use gemma2 mask
2025-02-17 19:00:18 +08:00
青龍聖者@bdsqlsz
bb7bae5dff
Merge pull request #13 from rockerBOO/lumina-cache-checkpointing
...
Lumina cache checkpointing
2025-02-17 15:43:54 +08:00
sdbds
3ce23b7f16
Merge branch 'lumina' of https://github.com/sdbds/sd-scripts into lumina
...
# Conflicts:
# library/lumina_models.py
2025-02-17 14:53:16 +08:00
sdbds
733fdc09c6
update
2025-02-17 14:52:48 +08:00
rockerBOO
f3a010978c
Clear sizes for validation reg images to be consistent
2025-02-16 22:28:34 -05:00
rockerBOO
3c7496ae3f
Fix sizes for validation split
2025-02-16 22:18:14 -05:00
青龍聖者@bdsqlsz
6965a0178a
Merge pull request #12 from rockerBOO/lumina-model-loading
...
Lumina 2 and Gemma 2 model loading
2025-02-17 00:47:08 +08:00
rockerBOO
4671e23778
Fix validation epoch loss to check epoch average
2025-02-16 01:42:44 -05:00
rockerBOO
16015635d2
Update metadata.resolution for Lumina 2
2025-02-16 01:36:29 -05:00
rockerBOO
60a76ebb72
Add caching gemma2, add gradient checkpointing, refactor lumina model code
2025-02-16 01:06:34 -05:00
rockerBOO
a00b06bc97
Lumina 2 and Gemma 2 model loading
2025-02-15 14:56:11 -05:00
Kohya S
63337d9fe4
Merge branch 'sd3' into val-loss-improvement
2025-02-15 21:41:07 +09:00