866 Commits

Author	SHA1	Message	Date
rockerBOO	e0f1ae0f2c	Fix default initialization	2025-05-07 23:41:48 -04:00
rockerBOO	19b67643e4	Revert "Fix default initialization" ... This reverts commit 554674909a.	2025-05-07 23:33:54 -04:00
rockerBOO	554674909a	Fix default initialization	2025-05-07 23:33:08 -04:00
rockerBOO	ef8371243b	Add lowrank SVD for PiSSA. Implement URAE conversion	2025-05-07 23:26:26 -04:00
rockerBOO	d0eb3b5c79	Merge branch 'sd3' into flux-lora-init	2025-05-07 23:23:12 -04:00
Kohya S	fd3a445769	fix: revert default emb guidance scale and CFG scale for FLUX.1 sampling	2025-04-27 22:50:27 +09:00
Kohya S	629073cd9d	Add guidance scale for prompt param and flux sampling	2025-04-16 21:50:36 +09:00
Kohya S	06df0377f9	Merge branch 'sd3' into flux-sample-cfg	2025-04-16 21:27:08 +09:00
rockerBOO	adb0e54093	Fix GGPO variables. Fix no _org lora values. ... - Add pythonpath = . to pytest to get the current directory - Fix device of LoRA after PiSSA initialization to return to proper device	2025-04-10 21:59:39 -04:00
rockerBOO	7dd00204eb	Revert "Merge branch 'sd3' into flux-lora-init" ... This reverts commit 67f8e17a46, reversing changes made to 9d7e2dd7c9.	2025-04-10 21:38:05 -04:00
rockerBOO	67f8e17a46	Merge branch 'sd3' into flux-lora-init	2025-04-10 21:15:22 -04:00
rockerBOO	9d7e2dd7c9	Fix LoRA dtype when saving PiSSA ... Change lora_util to network_utils to match terms.	2025-04-10 20:59:47 -04:00
Kohya S.	c56dc90b26	Merge pull request #1992 from rockerBOO/flux-ip-noise-gamma ... Add IP noise gamma for Flux	2025-04-06 21:29:26 +09:00
Kohya S.	606e6875d2	Merge pull request #2022 from LexSong/fix-resize-issue ... Fix size parameter types and improve resize_image interpolation	2025-04-05 19:28:25 +09:00
rockerBOO	5f927444d0	Merge branch 'sd3' into flux-lora-init	2025-04-04 15:54:15 -04:00
rockerBOO	87fe284a76	Properly move original model weights to device, offload org lora weights to CPU	2025-04-03 20:32:34 -04:00
Kohya S	f1423a7229	fix: add resize_interpolation parameter to FineTuningDataset constructor	2025-04-03 21:48:51 +09:00
Lex Song	b822b7e60b	Fix the interpolation logic error in resize_image() ... The original code had a mistake. It used 'lanczos' when the image got smaller (width > resized_width and height > resized_height) and 'area' when it stayed the same or got bigger. This was the wrong way. 'area' is better for big shrinking.	2025-04-02 22:04:37 +08:00
Lex Song	ede3470260	Ensure all size parameters are integers to prevent type errors	2025-04-02 03:50:33 +08:00
Kohya S	b3c56b22bd	Merge branch 'dev' into sd3	2025-03-31 22:05:40 +09:00
Kohya S	583ab27b3c	doc: update license information in jpeg_xl_util.py	2025-03-31 22:02:25 +09:00
Kohya S	1f432e2c0e	use PIL for lanczos and box	2025-03-30 20:40:29 +09:00
Kohya S.	93a4efabb5	Merge branch 'sd3' into resize-interpolation	2025-03-30 19:30:56 +09:00
rockerBOO	da47d17231	Make sure on better device (cuda if available) for initialization	2025-03-25 20:43:10 -04:00
rockerBOO	54d4de0e72	Autocast shouldn't be on dtype float32	2025-03-25 19:05:03 -04:00
rockerBOO	c5c07a40c5	Move test util to library	2025-03-25 18:41:58 -04:00
rockerBOO	0ad3b3c2bd	Update initialization, add lora_util, add tests	2025-03-25 18:22:07 -04:00
rockerBOO	85928dd3b0	Add initialization URAE, PiSSA for flux	2025-03-24 04:08:08 -04:00
rockerBOO	e8b3254858	Add flux_train_utils tests for get get_noisy_model_input_and_timesteps	2025-03-20 15:01:15 -04:00
rockerBOO	16cef81aea	Refactor sigmas and timesteps	2025-03-20 14:32:56 -04:00
rockerBOO	f974c6b257	change order to match upstream	2025-03-19 14:27:43 -04:00
rockerBOO	5d5a7d2acf	Fix IP noise calculation	2025-03-19 13:50:04 -04:00
rockerBOO	1eddac26b0	Separate random to a variable, and make sure on device	2025-03-19 00:49:42 -04:00
rockerBOO	8e6817b0c2	Remove double noise	2025-03-19 00:45:13 -04:00
rockerBOO	d93ad90a71	Add perturbation on noisy_model_input if needed	2025-03-19 00:37:27 -04:00
rockerBOO	7197266703	Perturbed noise should be separate of input noise	2025-03-19 00:25:51 -04:00
rockerBOO	b81bcd0b01	Move IP noise gamma to noise creation to remove complexity and align noise for target loss	2025-03-18 21:36:55 -04:00
rockerBOO	6f4d365775	zeros_like because we are adding	2025-03-18 18:53:34 -04:00
rockerBOO	a4f3a9fc1a	Use ones_like	2025-03-18 18:44:21 -04:00
rockerBOO	b425466e7b	Fix IP noise gamma to use random values	2025-03-18 18:42:35 -04:00
rockerBOO	c8be141ae0	Apply IP gamma to noise fix	2025-03-18 15:42:18 -04:00
rockerBOO	0b25a05e3c	Add IP noise gamma for Flux	2025-03-18 15:40:40 -04:00
Disty0	620a06f517	Check for uppercase file extension too	2025-03-17 17:44:29 +03:00
Disty0	564ec5fb7f	use extend instead of +=	2025-03-17 17:41:03 +03:00
Disty0	7e90cdd47a	use bytearray and add typing hints	2025-03-17 17:26:08 +03:00
Kohya S	272f4c3775	Merge branch 'sd3' into sd3_safetensors_merge	2025-02-28 23:52:36 +09:00
Disty0	2f69f4dbdb	fix typo	2025-02-27 00:30:19 +03:00
Disty0	9a415ba965	JPEG XL support	2025-02-27 00:21:57 +03:00
Kohya S	ec350c83eb	Merge branch 'dev' into sd3	2025-02-26 21:17:29 +09:00
Kohya S	1fcac98280	Merge branch 'sd3' into val-loss-improvement	2025-02-26 21:09:10 +09:00