2099 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
rockerBOO	d93ad90a71	Add perturbation on noisy_model_input if needed	2025-03-19 00:37:27 -04:00
rockerBOO	7197266703	Perturbed noise should be separate of input noise	2025-03-19 00:25:51 -04:00
rockerBOO	b81bcd0b01	Move IP noise gamma to noise creation to remove complexity and align noise for target loss	2025-03-18 21:36:55 -04:00
rockerBOO	6f4d365775	zeros_like because we are adding	2025-03-18 18:53:34 -04:00
rockerBOO	a4f3a9fc1a	Use ones_like	2025-03-18 18:44:21 -04:00
rockerBOO	b425466e7b	Fix IP noise gamma to use random values	2025-03-18 18:42:35 -04:00
rockerBOO	c8be141ae0	Apply IP gamma to noise fix	2025-03-18 15:42:18 -04:00
rockerBOO	0b25a05e3c	Add IP noise gamma for Flux	2025-03-18 15:40:40 -04:00
Kohya S	3d79239be4	docs: update README to include recent improvements in validation loss calculation	2025-02-26 21:21:04 +09:00
Kohya S	ec350c83eb	Merge branch 'dev' into sd3	2025-02-26 21:17:29 +09:00
Kohya S.	49651892ce	Merge pull request #1903 from kohya-ss/val-loss-improvement ... Val loss improvement	2025-02-26 21:15:14 +09:00
Kohya S	1fcac98280	Merge branch 'sd3' into val-loss-improvement	2025-02-26 21:09:10 +09:00
Kohya S.	b286304e5f	Merge pull request #1953 from Disty0/dev ... Update IPEX libs	2025-02-26 21:03:09 +09:00
Kohya S	ae409e83c9	fix: FLUX/SD3 network training not working without caching latents closes #1954	2025-02-26 20:56:32 +09:00
Disty0	f68702f71c	Update IPEX libs	2025-02-25 21:27:41 +03:00
Kohya S.	6e90c0f86c	Merge pull request #1909 from rockerBOO/progress_bar ... Move progress bar to account for sampling image first	2025-02-24 18:57:44 +09:00
Kohya S	67fde015f7	Merge branch 'dev' into sd3	2025-02-24 18:56:15 +09:00
Kohya S.	386b7332c6	Merge pull request #1918 from tsukimiya/fix_vperd_warning ... Remove v-pred warning.	2025-02-24 18:55:25 +09:00
Kohya S	905f081798	Merge branch 'dev' into sd3	2025-02-24 18:54:28 +09:00
Kohya S.	59ae9ea20c	Merge pull request #1945 from yidiq7/dev ... Remove position_ids for V2	2025-02-24 18:53:46 +09:00
Kohya S	efb2a128cd	fix wandb val logging	2025-02-21 22:07:35 +09:00
Yidi	13df47516d	Remove position_ids for V2 ... The postions_ids cause errors for the newer version of transformer. This has already been fixed in convert_ldm_clip_checkpoint_v1() but not in v2. The new code applies the same fix to convert_ldm_clip_checkpoint_v2().	2025-02-20 04:49:51 -05:00
Kohya S	4a36996134	modify log step calculation	2025-02-18 22:05:08 +09:00
Kohya S	dc7d5fb459	Merge branch 'sd3' into val-loss-improvement	2025-02-18 21:34:30 +09:00
Kohya S.	894037f2c6	Merge pull request #1943 from rockerBOO/validation-split-test ... Fix validation split and add test	2025-02-18 21:30:32 +09:00
rockerBOO	9436b41061	Fix validation split and add test	2025-02-17 14:28:41 -05:00
Kohya S.	7c22e12a39	Merge pull request #1938 from rockerBOO/validation-epoch-loss-recorder ... Fix validation epoch loss to check epoch average	2025-02-17 21:45:04 +09:00
Kohya S.	6051fa8217	Merge pull request #1940 from rockerBOO/split-size-fix ... Fix sizes for validation split	2025-02-17 21:42:10 +09:00
rockerBOO	f3a010978c	Clear sizes for validation reg images to be consistent	2025-02-16 22:28:34 -05:00
rockerBOO	3c7496ae3f	Fix sizes for validation split	2025-02-16 22:18:14 -05:00
rockerBOO	4671e23778	Fix validation epoch loss to check epoch average	2025-02-16 01:42:44 -05:00
Kohya S	63337d9fe4	Merge branch 'sd3' into val-loss-improvement	2025-02-15 21:41:07 +09:00
Kohya S.	ee295c7d9f	Merge pull request #1935 from rockerBOO/validation-epoch-fix ... Fix validation epoch divergence	2025-02-15 21:39:28 +09:00
rockerBOO	ab88b431b0	Fix validation epoch divergence	2025-02-14 11:14:38 -05:00
Kohya S	76b761943b	fix: simplify validation step condition in NetworkTrainer	2025-02-11 21:53:57 +09:00
Kohya S	cd80752175	fix: remove unused parameter 'accelerator' from encode_images_to_latents method	2025-02-11 21:42:58 +09:00
Kohya S	177203818a	fix: unpause training progress bar after vaidation	2025-02-11 21:42:46 +09:00
Kohya S	344845b429	fix: validation with block swap	2025-02-09 21:25:40 +09:00
Kohya S	0911683717	set python random state	2025-02-09 20:53:49 +09:00
Kohya S	a24db1d532	fix: validation timestep generation fails on SD/SDXL training	2025-02-04 22:02:42 +09:00
Kohya S	c5b803ce94	rng state management: Implement functions to get and set RNG states for consistent validation	2025-02-04 21:59:09 +09:00
tsukimiya	4a71687d20	不要な警告の削除 ... (おそらく be14c06267 の修正漏れ )	2025-02-04 00:42:27 +09:00
rockerBOO	de830b8941	Move progress bar to account for sampling image first	2025-01-29 00:02:45 -05:00
Kohya S	45ec02b2a8	use same noise for every validation	2025-01-27 22:10:38 +09:00
Kohya S	42c0a9e1fc	Merge branch 'sd3' into val-loss-improvement	2025-01-27 22:06:18 +09:00
Kohya S	0778dd9b1d	fix Text Encoder only LoRA training	2025-01-27 22:03:42 +09:00
Kohya S	0750859133	validation: Implement timestep-based validation processing	2025-01-27 21:56:59 +09:00
Kohya S	29f31d005f	add network.train()/eval() for validation	2025-01-27 21:35:43 +09:00
Kohya S	b6a3093216	call optimizer eval/train fn before/after validation	2025-01-27 21:22:11 +09:00
Kohya S	86a2f3fd26	Fix gradient handling when Text Encoders are trained	2025-01-27 21:10:52 +09:00