Kohya S
6f0e235f2c
Fix shift value in SD3 inference.
2024-07-11 08:00:45 +09:00
Kohya S
3d402927ef
WIP: update new latents caching
2024-07-09 23:15:38 +09:00
Kohya S
9dc7997803
fix typo
2024-07-09 20:37:00 +09:00
Kohya S
3ea4fce5e0
load models one by one
2024-07-08 22:04:43 +09:00
Kohya S
c9de7c4e9a
WIP: new latents caching
2024-07-08 19:48:28 +09:00
Kohya S
50e3d62474
fix to work T5XXL with fp16
2024-07-08 19:46:23 +09:00
Kohya S
ea18d5ba6d
Fix to work full_bf16 and full_fp16.
2024-06-29 17:45:50 +09:00
Kohya S
19086465e8
Fix fp16 mixed precision, model is in bf16 without full_bf16
2024-06-29 17:21:25 +09:00
Kohya S
66cf435479
re-fix assertion ref #1389
2024-06-27 13:14:09 +09:00
Kohya S
381598c8bb
fix resolution in metadata for sd3
2024-06-26 21:15:02 +09:00
Kohya S
828a581e29
fix assertion for experimental impl ref #1389
2024-06-26 20:43:31 +09:00
Kohya S
8f2ba27869
support text_encoder_batch_size for caching
2024-06-26 20:36:22 +09:00
Kohya S
0b3e4f7ab6
show file name if error in load_image ref #1385
2024-06-25 20:03:09 +09:00
Kohya S
4802e4aaec
workaround for long caption ref #1382
2024-06-24 23:13:14 +09:00
Kohya S
0fe4eafac9
fix to use zero for initial latent
2024-06-24 23:12:48 +09:00
Kohya S
d53ea22b2a
sd3 training
2024-06-23 23:38:20 +09:00
Kohya S
a518e3c819
Merge branch 'dev' into sd3
2024-06-23 14:12:07 +09:00
Kohya S
9dd1ee458c
Merge branch 'main' into dev
2024-06-23 14:11:51 +09:00
Kohya S
25f961bc77
fix to work cache_latents/text_encoder_outputs
2024-06-23 13:24:30 +09:00
Kohya S
e5268286bf
add sd3 models and inference script
2024-06-15 22:20:24 +09:00
Kohya S
56bb81c9e6
add grad_hook after restore state closes #1344
2024-06-12 21:39:35 +09:00
Kohya S
22413a5247
Merge pull request #1359 from kohya-ss/train_resume_step
...
Train resume step
2024-06-11 19:52:03 +09:00
Kohya S
18d7597b0b
update README
2024-06-11 19:51:30 +09:00
Kohya S
4a441889d4
Merge branch 'dev' into train_resume_step
2024-06-11 19:27:37 +09:00
Kohya S
3259928ce4
Merge branch 'dev' of https://github.com/kohya-ss/sd-scripts into dev
2024-06-09 19:26:42 +09:00
Kohya S
1a104dc75e
make forward/backward pathes same ref #1363
2024-06-09 19:26:36 +09:00
Kohya S
58fb64819a
set static graph flag when DDP ref #1363
2024-06-09 19:26:09 +09:00
Kohya S
5bfe5e411b
Merge pull request #1361 from shirayu/update/github_actions/crate-ci/typos-1.21.0
...
Bump crate-ci/typos from 1.19.0 to 1.21.0, fix typos, and updated _typos.toml (Close #1307 )
2024-06-06 21:23:24 +09:00
Yuta Hayashibe
4ecbac131a
Bump crate-ci/typos from 1.19.0 to 1.21.0, fix typos, and updated _typos.toml ( Close #1307 )
2024-06-05 16:31:55 +09:00
Kohya S
4dbcef429b
update for corner cases
2024-06-04 21:26:55 +09:00
Kohya S
321e24d83b
Merge pull request #1353 from KohakuBlueleaf/train_resume_step
...
Resume correct step for "resume from state" feature.
2024-06-04 19:30:11 +09:00
Kohya S
e5bab69e3a
fix alpha mask without disk cache closes #1351 , ref #1339
2024-06-02 21:11:40 +09:00
Kohaku-Blueleaf
3eb27ced52
Skip the final 1 step
2024-05-31 12:24:15 +08:00
Kohaku-Blueleaf
b2363f1021
Final implementation
2024-05-31 12:20:20 +08:00
Kohya S
0d96e10b3e
Merge pull request #1339 from kohya-ss/alpha-masked-loss
...
Alpha masked loss
2024-05-27 21:41:16 +09:00
Kohya S
fc85496f7e
update docs for masked loss
2024-05-27 21:25:06 +09:00
Kohya S
2870be9b52
Merge branch 'dev' into alpha-masked-loss
2024-05-27 21:08:43 +09:00
Kohya S
71ad3c0f45
Update masked_loss_README-ja.md
...
add sample images
2024-05-27 21:07:57 +09:00
Kohya S
ffce3b5098
Merge pull request #1349 from rockerBOO/patch-4
...
Update issue link
2024-05-27 21:00:46 +09:00
Kohya S
a4c3155148
add doc for mask loss
2024-05-27 20:59:40 +09:00
Kohya S
58cadf476b
Merge branch 'dev' into alpha-masked-loss
2024-05-27 20:02:32 +09:00
Dave Lage
d50c1b3c5c
Update issue link
2024-05-27 01:11:01 -04:00
Kohya S
e8cfd4ba1d
fix to work cond mask and alpha mask
2024-05-26 22:01:37 +09:00
Kohya S
fb12b6d8e5
Merge pull request #1347 from rockerBOO/lora-plus-log-info
...
Add LoRA+ LR Ratio info message to logger
2024-05-26 19:45:03 +09:00
rockerBOO
00513b9b70
Add LoRA+ LR Ratio info message to logger
2024-05-23 22:27:12 -04:00
Kohya S
da6fea3d97
simplify and update alpha mask to work with various cases
2024-05-19 21:26:18 +09:00
Kohya S
f2dd43e198
revert kwargs to explicit declaration
2024-05-19 19:23:59 +09:00
u-haru
db6752901f
画像のアルファチャンネルをlossのマスクとして使用するオプションを追加 ( #1223 )
...
* Add alpha_mask parameter and apply masked loss
* Fix type hint in trim_and_resize_if_required function
* Refactor code to use keyword arguments in train_util.py
* Fix alpha mask flipping logic
* Fix alpha mask initialization
* Fix alpha_mask transformation
* Cache alpha_mask
* Update alpha_masks to be on CPU
* Set flipped_alpha_masks to Null if option disabled
* Check if alpha_mask is None
* Set alpha_mask to None if option disabled
* Add description of alpha_mask option to docs
2024-05-19 19:07:25 +09:00
Kohya S
febc5c59fa
update README
2024-05-19 19:03:43 +09:00
Kohya S
4c798129b0
update README
2024-05-19 19:00:32 +09:00