Furqanil Taqwa
4a913ce61e
initialize keep_tokens_separator to dataset config
2023-11-28 17:22:35 +07:00
Kohya S
764e333fa2
make slicing vae compatible with latest diffusers
2023-11-26 18:12:04 +09:00
Kohya S
c61e3bf4c9
make separate U-Net for inference
2023-11-26 18:11:30 +09:00
Kohya S
fc8649d80f
Merge pull request #934 from feffy380/fix-minsnr-vpred-zsnr
...
Fix min-snr-gamma for v-prediction and ZSNR.
2023-11-25 21:19:39 +09:00
Kohya S
6d6d86260b
add Deep Shrink
2023-11-23 19:40:48 +09:00
rockerBOO
c856ea4249
Add attention processor
2023-11-19 12:11:36 -05:00
Kohya S
f312522cef
Merge pull request #913 from KohakuBlueleaf/custom-seperator
...
Add custom seperator for shuffle caption
2023-11-19 21:32:01 +09:00
xzuyn
da5a144589
Add PagedAdamW
2023-11-18 07:47:27 -05:00
feffy380
6b3148fd3f
Fix min-snr-gamma for v-prediction and ZSNR.
...
This fixes min-snr for vpred+zsnr by dividing directly by SNR+1.
The old implementation did it in two steps: (min-snr/snr) * (snr/(snr+1)), which causes division by zero when combined with --zero_terminal_snr
2023-11-07 23:02:25 +01:00
Kohya S
6231aa91e2
common lr logging, set default None to ddp_timeout
2023-11-05 19:09:17 +09:00
Kohaku-Blueleaf
489b728dbc
Fix typo again
2023-10-30 20:19:51 +08:00
Kohaku-Blueleaf
583e2b2d01
Fix typo
2023-10-30 20:02:04 +08:00
Kohaku-Blueleaf
5dc2a0d3fd
Add custom seperator
2023-10-30 19:55:30 +08:00
Yuta Hayashibe
fea810b437
Added --sample_at_first to generate sample images before training
2023-10-29 21:44:57 +09:00
Yuta Hayashibe
40d917b0fe
Removed incorrect comments
2023-10-29 21:02:44 +09:00
Yuta Hayashibe
cf876fcdb4
Accept --ss to set sample_sampler dynamically
2023-10-29 20:15:04 +09:00
Yuta Hayashibe
291c29caaf
Added a function line_to_prompt_dict() and removed duplicated initializations
2023-10-29 19:57:25 +09:00
Yuta Hayashibe
01e00ac1b0
Make a function get_my_scheduler()
2023-10-29 19:46:02 +09:00
Kohya S
a9ed4ed8a8
Merge pull request #900 from xzuyn/paged_adamw_32bit
...
Add PagedAdamW32bit
2023-10-29 15:01:55 +09:00
Kohya S
9d6a5a0c79
Merge pull request #899 from shirayu/use_moving_average
...
Show moving average loss in the progress bar
2023-10-29 14:37:58 +09:00
Kohya S
fb97a7aab1
Merge pull request #898 from shirayu/update_repare_buckets_latents
...
Fix a typo and add assertions in making buckets
2023-10-29 14:29:53 +09:00
Kohaku-Blueleaf
1cefb2a753
Better implementation for te autocast ( #895 )
...
* Better implementation for te
* Fix some misunderstanding
* as same as unet, add explicit convert
* Better cache TE and TE lr
* Fix with list
* Add timeout settings
* Fix arg style
2023-10-28 15:49:59 +09:00
xzuyn
d8f68674fb
Update train_util.py
2023-10-27 07:05:53 -04:00
Yuta Hayashibe
0d21925bdf
Use @property
2023-10-27 18:14:27 +09:00
Yuta Hayashibe
3d2bb1a8f1
Add LossRecorder and use moving average in all places
2023-10-27 17:49:49 +09:00
Yuta Hayashibe
837a4dddb8
Added assertions
2023-10-26 13:34:36 +09:00
青龍聖者@bdsqlsz
202f2c3292
Debias Estimation loss ( #889 )
...
* update for bnb 0.41.1
* fixed generate_controlnet_subsets_config for training
* Revert "update for bnb 0.41.1"
This reverts commit 70bd3612d86539363c5c
2023-10-23 22:59:14 +09:00
Isotr0py
592014923f
Support JPEG-XL on windows
2023-10-04 21:48:25 +08:00
Yuta Hayashibe
27f9b6ffeb
updated typos to v1.16.15 and fix typos
2023-10-01 21:51:24 +09:00
Disty0
209eafb631
IPEX attention optimizations
2023-09-28 14:02:25 +03:00
Kohya S
624edf428f
Merge pull request #825 from Disty0/dev
...
Intel ARC support with IPEX
2023-09-24 14:29:03 +09:00
青龍聖者@bdsqlsz
d5be8125b0
update bitsandbytes for 0.41.1 and fixed bugs with generate_controlnet_subsets_config for training ( #823 )
...
* update for bnb 0.41.1
* fixed generate_controlnet_subsets_config for training
* Revert "update for bnb 0.41.1"
This reverts commit 70bd3612d8
2023-09-24 10:51:47 +09:00
Disty0
b99cd2a920
Update getDeviceIdListForCard
2023-09-20 17:16:06 +03:00
Disty0
b64389c8a9
Intel ARC support with IPEX
2023-09-19 18:05:05 +03:00
Kohya S
90c47140b8
add support model without position_ids
2023-09-13 17:59:34 +09:00
Kohya S
360af27749
fix ControlNetDataset not working
2023-09-03 12:27:58 +09:00
Kohya S
0ee75fd75d
fix typos, add comments etc.
2023-09-03 12:24:15 +09:00
Kohya S
2eae9b66d0
Merge pull request #798 from vvern999/vvern999-patch-1
...
add input perturbation noise
2023-09-03 10:51:23 +09:00
Kohya S
f6d417e26d
Merge pull request #791 from Isotr0py/dev
...
Intergrate fp16/bf16 support to sdxl model loading
2023-09-03 10:35:09 +09:00
Kohya S
948cf17499
add caption_prefix/suffix to dataset
2023-09-02 16:17:12 +09:00
Kohya S
497051c14b
Merge pull request #786 from Isotr0py/jxl
...
Support JPEG XL
2023-09-02 15:30:07 +09:00
Kohya S
c06a86706a
support diffusers' new VAE
2023-09-02 14:54:42 +09:00
vvern999
e0beb6a999
add input perturbation noise
...
from https://arxiv.org/abs/2301.11706
2023-09-02 07:33:27 +03:00
Kohya S
7e850f3b7e
Merge branch 'main' into sdxl
2023-09-01 07:59:26 +09:00
Isotr0py
2e0942d5c8
delet missed line
2023-08-27 20:45:40 +08:00
Isotr0py
6155f9c171
intergrate fp16/bf16 to model loading
2023-08-27 19:16:23 +08:00
Isotr0py
5d88351bb5
support jpeg xl
2023-08-25 11:07:02 +08:00
Kohya S
1161a5c6da
fix debug_dataset for controlnet dataset
2023-08-20 17:39:48 +09:00
Kohya S
e191892824
fix bucketing doesn't work in controlnet training
2023-08-20 12:24:40 +09:00
Kohya S
3f7235c36f
add lora controlnet train/gen temporarily
2023-08-17 10:08:02 +09:00
