Kohya S
696dd7f668
Fix dtype issue in PyTorch 2.0 for generating samples in training sdxl network
2024-01-22 12:43:37 +09:00
Kohya S
e0a3c69223
update readme
2024-01-20 18:47:10 +09:00
Kohya S
c59249a664
Add options to reduce memory usage in extract_lora_from_models.py closes #1059
2024-01-20 18:45:54 +09:00
Kohya S
fef172966f
Add network_multiplier for dataset and train LoRA
2024-01-20 16:24:43 +09:00
Kohya S
5a1ebc4c7c
format by black
2024-01-20 13:10:45 +09:00
Kohya S
2a0f45aea9
update readme
2024-01-20 11:08:20 +09:00
Kohya S
1f77bb6e73
fix to work sample generation in fp8 ref #1057
2024-01-20 10:57:42 +09:00
Kohya S
a7ef6422b6
fix to work with torch 2.0
2024-01-20 10:00:30 +09:00
Kohaku-Blueleaf
9cfa68c92f
[Experimental Feature] FP8 weight dtype for base model when running train_network (or sdxl_train_network) ( #1057 )
...
* Add fp8 support
* remove some debug prints
* Better implementation for te
* Fix some misunderstanding
* as same as unet, add explicit convert
* better impl for convert TE to fp8
* fp8 for not only unet
* Better cache TE and TE lr
* match arg name
* Fix with list
* Add timeout settings
* Fix arg style
* Add custom seperator
* Fix typo
* Fix typo again
* Fix dtype error
* Fix gradient problem
* Fix req grad
* fix merge
* Fix merge
* Resolve merge
* arrangement and document
* Resolve merge error
* Add assert for mixed precision
2024-01-20 09:46:53 +09:00
Kohya S
0395a35543
Merge branch 'main' into dev
2024-01-17 21:39:13 +09:00
Kohya S
987d4a969d
update readme
2024-01-17 21:38:49 +09:00
Kohya S
976d092c68
fix text encodes are on gpu even when not trained
2024-01-17 21:31:50 +09:00
Kohya S
e6b15c7e4a
Merge pull request #1053 from akx/sdpa
...
Fix typo `--spda` (it's `--sdpa`)
2024-01-16 21:50:45 +09:00
Aarni Koskela
ef50436464
Fix typo --spda (it's --sdpa)
2024-01-16 14:32:48 +02:00
Kohya S
26d35794e3
Merge pull request #1052 from kohya-ss/dev
...
merge dev
2024-01-15 21:39:02 +09:00
Kohya S
dcf0eeb5b6
update readme
2024-01-15 21:35:26 +09:00
Kohya S
32b759a328
Add wandb_run_name parameter to init_kwargs #1032
2024-01-14 22:02:03 +09:00
Kohya S
09ef3ffa8b
Merge branch 'main' into dev
2024-01-14 21:49:25 +09:00
Kohya S
aab265e431
Fix an issue with saving as diffusers sd1/2 model close #1033
2024-01-04 21:43:50 +09:00
Kohya S
716bad188b
Update dependencies ref #1024
2024-01-04 19:53:25 +09:00
Kohya S
4f93bf10f0
Merge pull request #1032 from hopl1t/wandb_session_name_support
...
Added cli argument for wandb session name
2024-01-04 11:10:31 +09:00
Kohya S
07bf2a21ac
Merge pull request #1024 from p1atdev/main
...
Add support for `torch.compile`
2024-01-04 10:49:52 +09:00
Kohya S
8ac2d2a92f
Merge pull request #1030 from Disty0/dev
...
Update IPEX Libs
2024-01-04 10:46:07 +09:00
Kohya S
76aee71257
Merge branch 'main' into dev
2024-01-04 10:42:16 +09:00
Kohya S
1db5d790ed
Merge pull request #1029 from kohya-ss/dependabot/github_actions/crate-ci/typos-1.16.26
...
Bump crate-ci/typos from 1.16.15 to 1.16.26
2024-01-04 10:41:07 +09:00
Kohya S
663b481029
fix TI training with full_fp16/bf16 ref #1019
2024-01-03 23:22:00 +09:00
Kohya S
1ab6493268
Merge branch 'main' into dev
2024-01-03 21:36:31 +09:00
Nir Weingarten
ab716302e4
Added cli argument for wandb session name
2024-01-03 11:52:38 +02:00
Disty0
b9d2181192
Cleanup
2024-01-02 11:51:29 +03:00
Disty0
49148eb36e
Disable Diffusers slicing if device is not XPU
2024-01-02 11:50:08 +03:00
Disty0
479bac447e
Fix typo
2024-01-01 12:51:23 +03:00
Disty0
15d5e78ac2
Update IPEX Libs
2024-01-01 12:44:26 +03:00
dependabot[bot]
fd7f27f044
Bump crate-ci/typos from 1.16.15 to 1.16.26
...
Bumps [crate-ci/typos](https://github.com/crate-ci/typos ) from 1.16.15 to 1.16.26.
- [Release notes](https://github.com/crate-ci/typos/releases )
- [Changelog](https://github.com/crate-ci/typos/blob/master/CHANGELOG.md )
- [Commits](https://github.com/crate-ci/typos/compare/v1.16.15...v1.16.26 )
---
updated-dependencies:
- dependency-name: crate-ci/typos
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
2024-01-01 01:28:55 +00:00
Plat
62e7516537
feat: support torch.compile
2023-12-27 02:17:24 +09:00
Plat
20296b4f0e
chore: bump eniops version due to support torch.compile
2023-12-27 02:17:24 +09:00
Kohya S
5cae6db804
Fix to work with DDP TextualInversionTrainer ref #1019
2023-12-24 22:05:56 +09:00
Kohya S
1a36f9dc65
Merge pull request #1020 from kohya-ss/dev
...
Fix convert_diffusers20_original_sd.py and add metadata & variant options
2023-12-24 21:48:25 +09:00
Kohya S
c2497877ca
Merge branch 'main' into dev
2023-12-24 21:46:05 +09:00
Kohya S
3b5c1a1d4b
Fix issue with tools/convert_diffusers20_original_sd.py
2023-12-24 21:45:51 +09:00
Kohya S
9a2e385f12
Merge pull request #1016 from Disty0/dev
...
Fix convert_diffusers20_original_sd.py and add --variant option for loading
2023-12-24 21:41:12 +09:00
Disty0
7080e1a11c
Fix convert_diffusers20_original_sd.py and add metadata & variant options
2023-12-22 22:40:03 +03:00
Kohya S
0a52b83c6a
Merge pull request #1012 from kohya-ss/dev
...
merge dev to main
2023-12-21 22:18:39 +09:00
Kohya S
11ed8e2a6d
update readme
2023-12-21 22:16:55 +09:00
Kohya S
bb20c09a9a
update readme
2023-12-21 22:10:47 +09:00
Kohya S
04ef8d395f
speed up nan replace in sdxl training ref #1009
2023-12-21 21:44:03 +09:00
Kohya S
0676f1a86f
Merge pull request #1009 from liubo0902/main
...
speed up latents nan replace
2023-12-21 21:37:16 +09:00
Kohya S
6b7823df07
Merge branch 'main' into dev
2023-12-21 21:33:43 +09:00
Kohya S
2186e417ba
fix size of bucket < min_size ref #1008
2023-12-20 22:12:21 +09:00
Kohya S
1519e3067c
Merge pull request #1008 from Cauldrath/zero_height_error
...
Fix zero height buckets
2023-12-20 22:09:04 +09:00
Kohya S
35e5424255
Merge pull request #1007 from Disty0/dev
...
IPEX fix SDPA
2023-12-20 21:53:11 +09:00
