terracottahaniwa
734d2e5b2b
Support Lora Block Weight (LBW) to svd_merge_lora.py ( #1575 )
...
* support lora block weight
* solve license incompatibility
* Fix issue: lbw index calculation
2024-09-13 20:45:35 +09:00
Kohya S
3387dc7306
formatting, update README
2024-09-13 19:45:42 +09:00
Kohya S
57ae44eb61
refactor to make safer
2024-09-13 19:45:00 +09:00
Maru-mee
1d7118a622
Support : OFT merge to base model ( #1580 )
...
* Support : OFT merge to base model
* Fix typo
* Fix typo_2
* Delete unused parameter 'eye'
2024-09-13 19:01:36 +09:00
Kohya S.
de25945a93
Merge pull request #1550 from kohya-ss/dependabot/github_actions/crate-ci/typos-1.24.3
...
Bump crate-ci/typos from 1.19.0 to 1.24.3
2024-09-07 10:50:46 +09:00
dependabot[bot]
1bcf8d600b
Bump crate-ci/typos from 1.19.0 to 1.24.3
...
Bumps [crate-ci/typos](https://github.com/crate-ci/typos ) from 1.19.0 to 1.24.3.
- [Release notes](https://github.com/crate-ci/typos/releases )
- [Changelog](https://github.com/crate-ci/typos/blob/master/CHANGELOG.md )
- [Commits](https://github.com/crate-ci/typos/compare/v1.19.0...v1.24.3 )
---
updated-dependencies:
- dependency-name: crate-ci/typos
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2024-09-01 01:33:04 +00:00
Kohya S.
f8f5b16958
Merge pull request #1540 from kohya-ss/dependabot/pip/opencv-python-4.8.1.78
...
Bump opencv-python from 4.7.0.68 to 4.8.1.78
2024-08-31 21:37:07 +09:00
Kohya S.
826ab5ce2e
Merge pull request #1532 from nandometzger/main
...
Update train_util.py, bug fix
2024-08-31 21:36:33 +09:00
dependabot[bot]
3a6154b7b0
Bump opencv-python from 4.7.0.68 to 4.8.1.78
...
Bumps [opencv-python](https://github.com/opencv/opencv-python ) from 4.7.0.68 to 4.8.1.78.
- [Release notes](https://github.com/opencv/opencv-python/releases )
- [Commits](https://github.com/opencv/opencv-python/commits )
---
updated-dependencies:
- dependency-name: opencv-python
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
2024-08-31 06:21:16 +00:00
Nando Metzger
2a3aefb4e4
Update train_util.py, bug fix
2024-08-30 08:15:05 +02:00
Kohya S
25f961bc77
fix to work cache_latents/text_encoder_outputs
2024-06-23 13:24:30 +09:00
Kohya S
71e2c91330
Merge pull request #1230 from kohya-ss/dependabot/github_actions/crate-ci/typos-1.19.0
...
Bump crate-ci/typos from 1.17.2 to 1.19.0
2024-04-07 21:14:18 +09:00
Kohya S
bfb352bc43
change huber_schedule from exponential to snr
2024-04-07 21:07:52 +09:00
Kohya S
c973b29da4
update readme
2024-04-07 20:51:52 +09:00
Kohya S
683f3d6ab3
Merge pull request #1212 from kohya-ss/dev
...
Version 0.8.6
2024-04-07 20:42:41 +09:00
Kohya S
dfa30790a9
update readme
2024-04-07 20:34:26 +09:00
Kohya S
d30ebb205c
update readme, add metadata for network module
2024-04-07 14:58:17 +09:00
kabachuha
90b18795fc
Add option to use Scheduled Huber Loss in all training pipelines to improve resilience to data corruption ( #1228 )
...
* add huber loss and huber_c compute to train_util
* add reduction modes
* add huber_c retrieval from timestep getter
* move get timesteps and huber to own function
* add conditional loss to all training scripts
* add cond loss to train network
* add (scheduled) huber_loss to args
* fixup twice timesteps getting
* PHL-schedule should depend on noise scheduler's num timesteps
* *2 multiplier to huber loss cause of 1/2 a^2 conv.
The Taylor expansion of sqrt near zero gives 1/2 a^2, which differs from a^2 of the standard MSE loss. This change scales them better against one another
* add option for smooth l1 (huber / delta)
* unify huber scheduling
* add snr huber scheduler
---------
Co-authored-by: Kohya S <52813779+kohya-ss@users.noreply.github.com >
2024-04-07 13:54:21 +09:00
Kohya S
089727b5ee
update readme
2024-04-07 12:42:49 +09:00
Kohya S
921036dd91
Merge pull request #1240 from kohya-ss/verify-command-line-args
...
verify command line args if wandb is enabled
2024-04-07 12:27:03 +09:00
ykume
cd587ce62c
verify command line args if wandb is enabled
2024-04-05 08:23:03 +09:00
Kohya S
b748b48dbb
fix attention couple+deep shink cause error in some reso
2024-04-03 12:43:08 +09:00
dependabot[bot]
80e9f72234
Bump crate-ci/typos from 1.17.2 to 1.19.0
...
Bumps [crate-ci/typos](https://github.com/crate-ci/typos ) from 1.17.2 to 1.19.0.
- [Release notes](https://github.com/crate-ci/typos/releases )
- [Changelog](https://github.com/crate-ci/typos/blob/master/CHANGELOG.md )
- [Commits](https://github.com/crate-ci/typos/compare/v1.17.2...v1.19.0 )
---
updated-dependencies:
- dependency-name: crate-ci/typos
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
2024-04-01 01:50:22 +00:00
Kohya S
2258a1b753
add save/load hook to remove U-Net/TEs from state
2024-03-31 15:50:35 +09:00
Kohya S
059ee047f3
fix typo
2024-03-30 23:02:24 +09:00
Kohya S
2c2ca9d726
update tagger doc
2024-03-30 22:55:56 +09:00
Kohya S
f5323e3c4b
update tagger doc
2024-03-30 22:10:37 +09:00
Kohya S
cae5aa0a56
update wd14 tagger and doc
2024-03-30 21:48:22 +09:00
Kohya S
6ba84288d9
Merge pull request #1216 from Disty0/dev
...
Rating support for WD Tagger
2024-03-30 18:50:49 +09:00
Kohya S
434dc408f9
update readme
2024-03-30 17:12:36 +09:00
Kohya S
ae3f625739
Merge branch 'dev' of https://github.com/kohya-ss/sd-scripts into dev
2024-03-30 14:57:43 +09:00
Kohya S
f1f30ab418
fix to work with num_beams>1 closes #1149
2024-03-30 14:57:39 +09:00
Disty0
bc586ce190
Add --use_rating_tags and --character_tags_first for WD Tagger
2024-03-29 13:56:42 +03:00
Disty0
4012fd24f6
IPEX fix pin_memory
2024-03-28 21:08:16 +03:00
Disty0
954731d564
fix typo
2024-03-27 22:00:59 +03:00
Disty0
dd9763be31
Rating support for WD Tagger
2024-03-27 21:53:40 +03:00
Kohya S
b86af6798d
Merge pull request #1213 from Disty0/dev
...
Add OpenVINO and ROCm ONNX Runtime for WD14
2024-03-27 23:15:33 +09:00
Disty0
6f7e93d5cc
Add OpenVINO and ROCm ONNX Runtime for WD14
2024-03-27 03:21:13 +03:00
Kohya S
6c08e97e1f
update readme
2024-03-26 20:48:08 +09:00
Kohya S
78e0a7630c
Merge pull request #1206 from kohya-ss/dataset-cache
...
Add metadata caching for DreamBooth dataset
2024-03-26 19:49:23 +09:00
Kohya S
c86e356013
Merge branch 'dev' into dataset-cache
2024-03-26 19:43:40 +09:00
Kohya S
5a2afb3588
Merge pull request #1207 from kohya-ss/masked-loss
...
Add masked loss
2024-03-26 19:41:31 +09:00
Kohya S
ab1e389347
Merge branch 'dev' into masked-loss
2024-03-26 19:39:30 +09:00
Kohya S
ea05e3fd5b
Merge pull request #1139 from kohya-ss/deep-speed
...
Deep speed
2024-03-26 19:33:57 +09:00
Kohya S
a2b8531627
make each script consistent, fix to work w/o DeepSpeed
2024-03-25 22:28:46 +09:00
Kohya S
c24422fb9d
Merge branch 'dev' into deep-speed
2024-03-25 22:11:05 +09:00
Kohya S
9c4492b58a
fix pytorch version 2.1.1 to 2.1.2
2024-03-24 23:17:25 +09:00
Kohya S
9bbb28c361
update PyTorch version and reorganize dependencies
2024-03-24 22:06:37 +09:00
Kohya S
1648ade6da
format by black
2024-03-24 20:55:48 +09:00
Kohya S
993b2ab4c1
Merge branch 'dev' into deep-speed
2024-03-24 18:45:59 +09:00
