Isotr0py
bb5ae389f7
fix DDP SDXL training
2023-12-12 19:58:44 +08:00
Kohya S
4a2cef887c
fix lllite training not working ref #913
2023-12-10 09:23:37 +09:00
Kohya S
42750f7846
fix error on pool_workaround in sdxl TE training ref #994
2023-12-10 09:18:33 +09:00
CjangCjengh
d31aa143f4
fix path error
2023-12-08 00:27:32 +08:00
CjangCjengh
710e777a92
fix path error
2023-12-08 00:22:13 +08:00
Kohya S
912dca8f65
fix duplicated sample gen for every epoch ref #907
2023-12-07 22:13:38 +09:00
Isotr0py
db84530074
Fix gradients synchronization for multi-GPUs training ( #989 )
...
* delete DDP wrapper
* fix train_db vae and train_network
* fix train_db vae and train_network unwrap
* network grad sync
---------
Co-authored-by: Kohya S <52813779+kohya-ss@users.noreply.github.com >
2023-12-07 22:01:42 +09:00
Kohya S
72bbaac96d
Merge pull request #985 from Disty0/dev
...
Update IPEX hijacks
2023-12-07 21:39:24 +09:00
Kohya S
5713d63dc5
add temporary workaround for playground-v2
2023-12-06 23:08:02 +09:00
CjangCjengh
d653e594c2
fix path error
2023-12-06 09:48:42 +08:00
Disty0
dd7bb33ab6
IPEX fix torch.UntypedStorage.is_cuda
2023-12-05 22:18:47 +03:00
Disty0
a9c6182b3f
Cleanup IPEX libs
2023-12-05 19:52:31 +03:00
Disty0
3d70137d31
Disable IPEX attention if the GPU supports 64 bit
2023-12-05 19:40:16 +03:00
Disty0
bce9a081db
Update IPEX hijacks
2023-12-05 14:17:31 +03:00
Kohya S
46cf41cc93
Merge pull request #961 from rockerBOO/attention-processor
...
Add attention processor
2023-12-03 21:24:12 +09:00
Kohya S
81a440c8e8
Merge pull request #955 from xzuyn/paged_adamw
...
Add PagedAdamW
2023-12-03 21:22:38 +09:00
Kohya S
f24a3b5282
show seed in generating samples
2023-12-03 21:15:30 +09:00
Kohya S
383b4a2c3e
Merge pull request #907 from shirayu/add_option_sample_at_first
...
Add option --sample_at_first
2023-12-03 21:00:32 +09:00
Kohya S
df59822a27
Merge pull request #906 from shirayu/accept_scheduler_designation_in_training
...
Accept sampler designation in sampling of training
2023-12-03 20:46:16 +09:00
Kohya S
0908c5414d
Merge pull request #978 from kohya-ss/dev
...
Dev
2023-12-03 18:27:29 +09:00
Kohya S
ee46134fa7
update readme
2023-12-03 18:24:50 +09:00
Kohya S
39bb319d4c
fix to work with cfg scale=1
2023-11-29 12:42:12 +09:00
Furqanil Taqwa
1bdd83a85f
remove unnecessary debug print
2023-11-28 17:26:27 +07:00
Furqanil Taqwa
1624c239c2
added keep_tokens_separator to dynamically keep token for being shuffled
2023-11-28 17:23:55 +07:00
Furqanil Taqwa
4a913ce61e
initialize keep_tokens_separator to dataset config
2023-11-28 17:22:35 +07:00
Kohya S
764e333fa2
make slicing vae compatible with latest diffusers
2023-11-26 18:12:04 +09:00
Kohya S
c61e3bf4c9
make separate U-Net for inference
2023-11-26 18:11:30 +09:00
Kohya S
fc8649d80f
Merge pull request #934 from feffy380/fix-minsnr-vpred-zsnr
...
Fix min-snr-gamma for v-prediction and ZSNR.
2023-11-25 21:19:39 +09:00
Kohya S
0fb9ecf1f3
format by black, add ja comment
2023-11-25 21:05:55 +09:00
Kohya S
97958400fb
Merge pull request #936 from wkpark/model_util-update
...
use **kwargs and change svd() calling convention to make svd() reusable
2023-11-25 21:01:14 +09:00
Kohya S
6d6d86260b
add Deep Shrink
2023-11-23 19:40:48 +09:00
rockerBOO
c856ea4249
Add attention processor
2023-11-19 12:11:36 -05:00
Kohya S
d0923d6710
add caption_separator option
2023-11-19 21:44:52 +09:00
Kohya S
f312522cef
Merge pull request #913 from KohakuBlueleaf/custom-seperator
...
Add custom seperator for shuffle caption
2023-11-19 21:32:01 +09:00
xzuyn
da5a144589
Add PagedAdamW
2023-11-18 07:47:27 -05:00
Won-Kyu Park
2c1e669bd8
add min_diff, clamp_quantile args
...
based on https://github.com/bmaltais/kohya_ss/pull/1332 a9ec90c40a
2023-11-10 02:35:55 +09:00
Won-Kyu Park
e20e9f61ac
use **kwargs and change svd() calling convention to make svd() reusable
...
* add required attributes to model_org, model_tuned, save_to
* set "*_alpha" using str(float(foo))
2023-11-10 02:35:10 +09:00
feffy380
6b3148fd3f
Fix min-snr-gamma for v-prediction and ZSNR.
...
This fixes min-snr for vpred+zsnr by dividing directly by SNR+1.
The old implementation did it in two steps: (min-snr/snr) * (snr/(snr+1)), which causes division by zero when combined with --zero_terminal_snr
2023-11-07 23:02:25 +01:00
Kohya S
95ae56bd22
Update README.md
2023-11-05 21:10:26 +09:00
Kohya S
990192d077
Merge pull request #927 from kohya-ss/dev
...
Dev
2023-11-05 19:31:41 +09:00
Kohya S
f3e69531c3
update readme
2023-11-05 19:30:52 +09:00
Kohya S
0cb3272bda
update readme
2023-11-05 19:26:35 +09:00
Kohya S
6231aa91e2
common lr logging, set default None to ddp_timeout
2023-11-05 19:09:17 +09:00
Kohaku-Blueleaf
489b728dbc
Fix typo again
2023-10-30 20:19:51 +08:00
Kohaku-Blueleaf
583e2b2d01
Fix typo
2023-10-30 20:02:04 +08:00
Kohaku-Blueleaf
5dc2a0d3fd
Add custom seperator
2023-10-30 19:55:30 +08:00
Yuta Hayashibe
2c731418ad
Added sample_images() for --sample_at_first
2023-10-29 22:08:42 +09:00
Yuta Hayashibe
5c150675bf
Added --sample_at_first description
2023-10-29 21:46:47 +09:00
Yuta Hayashibe
fea810b437
Added --sample_at_first to generate sample images before training
2023-10-29 21:44:57 +09:00
Kohya S
96d877be90
support separate LR for Text Encoder for SD1/2
2023-10-29 21:30:32 +09:00