2032 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Kohya S	34e7f509c4	docs: update README for huber loss	2024-12-01 21:36:24 +09:00
Kohya S.	bdf9a8cc29	Merge pull request #1815 from kohya-ss/flux-huber-loss ... Flux huber loss	2024-12-01 21:29:53 +09:00
Kohya S	1476040787	fix: update help text for huber loss parameters in train_util.py	2024-12-01 21:26:39 +09:00
Kohya S	cc11989755	fix: refactor huber-loss calculation in multiple training scripts	2024-12-01 21:20:28 +09:00
Kohya S	0fe6320f09	fix flux_train.py is not working	2024-12-01 14:13:37 +09:00
Kohya S	14f642f88b	fix: huber_schedule exponential not working on sd3_train.py	2024-12-01 13:30:35 +09:00
Kohya S.	a5a27fe4c3	Merge pull request #1808 from recris/huber-loss-flux ... Implement pseudo Huber loss for Flux and SD3	2024-12-01 13:15:33 +09:00
recris	7b61e9eb58	Fix issues found in review (pt 2)	2024-11-30 11:36:40 +00:00
Kohya S	9c885e549d	fix: improve pos_embed handling for oversized images and update resolution_area_to_latent_size, when sample image size > train image size	2024-11-30 18:25:50 +09:00
rockerBOO	4f7f248071	Bump typos action	2024-11-29 16:28:51 -05:00
rockerBOO	89825d6898	Run typos workflows once where appropriate	2024-11-29 16:27:13 -05:00
rockerBOO	dd3b846b54	Install pytorch first to pin version	2024-11-29 16:18:05 -05:00
rockerBOO	e59e276fb9	Add dadaptation	2024-11-29 16:03:29 -05:00
rockerBOO	2dd063a679	add torch torchvision accelerate versions	2024-11-29 15:57:31 -05:00
rockerBOO	c7cadbc8c7	Add pytest testing	2024-11-29 15:52:03 -05:00
rockerBOO	6593cfbec1	Fix d * lr step log	2024-11-29 14:16:24 -05:00
rockerBOO	87f5224e2d	Support d*lr for ProdigyPlus optimizer	2024-11-29 14:16:00 -05:00
rockerBOO	928b9393da	Allow unknown schedule-free optimizers to continue to module loader	2024-11-29 14:12:34 -05:00
minux302	f40632bac6	rm abundant arg	2024-11-30 00:15:47 +09:00
minux302	be5860f8e2	add schnell option to load_cn	2024-11-30 00:08:21 +09:00
minux302	575f583fd9	add README	2024-11-29 23:55:52 +09:00
minux302	9dff44d785	fix device	2024-11-29 14:40:38 +00:00
recris	740ec1d526	Fix issues found in review	2024-11-28 20:38:32 +00:00
recris	420a180d93	Implement pseudo Huber loss for Flux and SD3	2024-11-27 18:37:09 +00:00
minux302	0b5229a955	save cn	2024-11-21 15:55:27 +00:00
kohya-ss	2a61fc0784	docs: fix typo from block_to_swap to blocks_to_swap in README	2024-11-20 21:20:35 +09:00
minux302	31ca899b6b	fix depth value	2024-11-18 13:03:28 +00:00
minux302	4dd4cd6ec8	work cn load and validation	2024-11-18 12:47:01 +00:00
minux302	35778f0218	fix sample_images type	2024-11-17 11:09:05 +00:00
minux302	b2660bbe74	train run	2024-11-17 10:24:57 +00:00
Kohya S	2a188f07e6	Fix to work DOP with bock swap	2024-11-17 16:12:10 +09:00
minux302	e358b118af	fix dataloader	2024-11-16 14:49:29 +09:00
minux302	42f6edf3a8	fix for adding controlnet	2024-11-15 23:48:51 +09:00
minux302	ccfaa001e7	add flux controlnet base module	2024-11-15 20:21:28 +09:00
Kohya S.	0047bb1fc3	Merge pull request #1779 from kohya-ss/faster-block-swap ... Improve block swap speed and apply to LoRA	2024-11-14 19:47:10 +09:00
Kohya S	fd2d879ac8	docs: update README	2024-11-14 19:43:08 +09:00
Kohya S	5c5b544b91	refactor: remove unused prepare_split_model method from FluxNetworkTrainer	2024-11-14 19:35:43 +09:00
Kohya S	2bb0f547d7	update grad hook creation to fix TE lr in sd3 fine tuning	2024-11-14 19:33:12 +09:00
Kohya S	2cb7a6db02	feat: add block swap for FLUX.1/SD3 LoRA training	2024-11-12 21:39:13 +09:00
Kohya S	17cf249d76	Merge branch 'sd3' into faster-block-swap	2024-11-12 08:49:15 +09:00
Kohya S	cde90b8903	feat: implement block swapping for FLUX.1 LoRA (WIP)	2024-11-12 08:49:05 +09:00
Kohya S	3fe94b058a	update comment	2024-11-12 08:09:07 +09:00
Kohya S.	92482c7a07	Merge pull request #1774 from sdbds/avif_get_imagesize ... Support avif get image size	2024-11-12 08:02:16 +09:00
Kohya S	7feaae5f06	Merge branch 'sd3' into faster-block-swap	2024-11-11 21:16:01 +09:00
Kohya S	02bd76e6c7	Refactor block swapping to utilize custom offloading utilities	2024-11-11 21:15:36 +09:00
sdbds	26bd4540a6	init	2024-11-11 09:25:28 +08:00
Kohya S	8fac3c3b08	update README	2024-11-09 19:56:02 +09:00
Kohya S.	2a2042a762	Merge pull request #1770 from feffy380/fix-size-from-cache ... fix: sort order when getting image size from cache file	2024-11-09 19:51:03 +09:00
feffy380	b3248a8eef	fix: sort order when getting image size from cache file	2024-11-07 14:31:05 +01:00
Kohya S	186aa5b97d	fix illeagal block is swapped #1764	2024-11-07 22:16:05 +09:00