172 Commits

Author	SHA1	Message	Date
Kohya S	ca44e3e447	reduce VRAM usage, instead of increasing main RAM usage	2024-10-27 10:19:05 +09:00
Kohya S	56b4ea963e	Fix LoRA metadata hash calculation bug in svd_merge_lora.py, sdxl_merge_lora.py, and resize_lora.py closes #1722	2024-10-26 22:01:10 +09:00
Kohya S	9c757c2fba	fix SDXL block index to match LBW	2024-09-19 21:14:57 +09:00
Kohya S	b755ebd0a4	add LBW support for SDXL merge LoRA	2024-09-13 21:29:31 +09:00
Kohya S	f4a0bea6dc	format by black	2024-09-13 21:26:06 +09:00
terracottahaniwa	734d2e5b2b	Support Lora Block Weight (LBW) to svd_merge_lora.py (#1575) ... * support lora block weight * solve license incompatibility * Fix issue: lbw index calculation	2024-09-13 20:45:35 +09:00
Kohya S	3387dc7306	formatting, update README	2024-09-13 19:45:42 +09:00
Kohya S	57ae44eb61	refactor to make safer	2024-09-13 19:45:00 +09:00
Maru-mee	1d7118a622	Support : OFT merge to base model (#1580) ... * Support : OFT merge to base model * Fix typo * Fix typo_2 * Delete unused parameter 'eye'	2024-09-13 19:01:36 +09:00
Kohya S	b748b48dbb	fix attention couple+deep shink cause error in some reso	2024-04-03 12:43:08 +09:00
Yuta Hayashibe	5d5f39b6e6	Replaced print with logger	2024-02-25 01:24:11 +09:00
Kohya S	8b7c14246a	some log output to print	2024-02-24 20:50:00 +09:00
Kohya S	52b3799989	fix format, add new conv rank to metadata comment	2024-02-24 20:49:41 +09:00
Kohya S	0e703608f9	Merge branch 'dev' into resize_lora-add-rank-for-conv	2024-02-24 20:09:38 +09:00
Kohya S	fb9110bac1	format by black	2024-02-24 20:00:57 +09:00
Kohya S	86279c8855	Merge branch 'dev' into DyLoRA-xl	2024-02-24 19:18:36 +09:00
tamlog06	a6f1ed2e14	fix dylora create_modules error	2024-02-18 13:20:47 +00:00
Kohya S	baa0e97ced	Merge branch 'dev' into dev_device_support	2024-02-17 11:54:07 +09:00
Kohya S	cbe9c5dc06	supprt deep shink with regional lora, add prompter module	2024-02-12 14:17:27 +09:00
Kohya S	358ca205a3	Merge branch 'dev' into dev_device_support	2024-02-12 13:01:54 +09:00
Yuta Hayashibe	5f6bf29e52	Replace print with logger if they are logs (#905) ... * Add get_my_logger() * Use logger instead of print * Fix log level * Removed line-breaks for readability * Use setup_logging() * Add rich to requirements.txt * Make simple * Use logger instead of print --------- Co-authored-by: Kohya S <52813779+kohya-ss@users.noreply.github.com>	2024-02-04 18:14:34 +09:00
mgz	1492bcbfa2	add --new_conv_rank option ... update script to also take a separate conv rank value	2024-02-03 23:18:55 -06:00
mgz	bf2de5620c	fix formatting in resize_lora.py	2024-02-03 20:09:37 -06:00
Disty0	a6a2b5a867	Fix IPEX support and add XPU device to device_utils	2024-01-31 17:32:37 +03:00
Kohya S	2ca4d0c831	Merge pull request #1054 from akx/mps ... Device support improvements (MPS)	2024-01-31 21:30:12 +09:00
mgz	d4b9568269	fix broken import in svd_merge_lora script ... remove missing import, and remove unused imports	2024-01-28 11:59:07 -06:00
Aarni Koskela	478156b4f7	Refactor device determination to function; add MPS fallback	2024-01-23 14:29:03 +02:00
Kohya S	c59249a664	Add options to reduce memory usage in extract_lora_from_models.py closes #1059	2024-01-20 18:45:54 +09:00
Kohya S	0fb9ecf1f3	format by black, add ja comment	2023-11-25 21:05:55 +09:00
Won-Kyu Park	2c1e669bd8	add min_diff, clamp_quantile args ... based on https://github.com/bmaltais/kohya_ss/pull/1332 a9ec90c40a	2023-11-10 02:35:55 +09:00
Won-Kyu Park	e20e9f61ac	use **kwargs and change svd() calling convention to make svd() reusable ... * add required attributes to model_org, model_tuned, save_to * set "*_alpha" using str(float(foo))	2023-11-10 02:35:10 +09:00
Kohya S	8b79e3b06c	fix typos	2023-10-09 18:00:45 +09:00
Kohya S	66741c035c	add OFT	2023-10-09 17:59:24 +09:00
laksjdjf	14aa2923cf	Support concat LoRA	2023-09-28 14:39:32 +09:00
Kohya S	1e395ed285	Merge branch 'main' into sdxl	2023-09-24 17:51:08 +09:00
Kohya S	7e736da30c	update versions of accelerate and diffusers	2023-09-24 17:46:57 +09:00
Kohya S	477b5260aa	fix sai metadata for sdxl closes #824	2023-09-24 14:47:13 +09:00
Kohya S	f2491ee0ac	change block name doesn't contain '.' at end	2023-09-24 12:10:56 +09:00
Kohya S	1f169ee7fb	Merge pull request #760 from Symbiomatrix/bugfix1 ... Update resize_lora.py	2023-09-24 11:59:18 +09:00
Kohya S	66817992c1	revert formatting	2023-09-24 11:50:44 +09:00
Kohya S	8052bcd5cd	format by black	2023-09-24 11:26:28 +09:00
Kohya S	55886a0116	add .pt and .pth for available extension	2023-09-24 11:25:54 +09:00
jvkap	a0e05fa291	Update resize_lora.py	2023-09-11 11:41:33 -03:00
jvkap	e33c007cd0	Update resize_lora.py	2023-09-11 11:29:06 -03:00
Kohya S	207fc8b256	fix to work regional LoRA	2023-09-03 17:50:27 +09:00
Kohya S	0ee75fd75d	fix typos, add comments etc.	2023-09-03 12:24:15 +09:00
Kohya S	3d12cdc643	fix typo	2023-08-25 21:18:09 +09:00
Kohya S	526488feaa	alternative impl of ControlNet-LLLite training	2023-08-25 21:16:11 +09:00
Kohya S	6d5cffaee9	add multiplier, steps range	2023-08-22 08:17:21 +09:00
Kohya S	e191892824	fix bucketing doesn't work in controlnet training	2023-08-20 12:24:40 +09:00