rockerBOO
ee8ceee178
Add device consistency validation for CDC transformation
...
- Check that noise and CDC matrices are on same device
- Automatically transfer noise if device mismatch detected
- Warn user when device transfer occurs
- Add tests to verify device handling
2025-10-09 18:28:51 -04:00
rockerBOO
ce17007e1a
Add warning throttling for CDC shape mismatches
...
- Track warned samples in global set to prevent log spam
- Each sample only warned once per training session
- Prevents thousands of duplicate warnings during training
- Add tests to verify throttling behavior
2025-10-09 18:28:50 -04:00
rockerBOO
88af20881d
Fix: Enable gradient flow through CDC noise transformation
...
- Remove @torch.no_grad() decorator from compute_sigma_t_x()
- Gradients now properly flow through CDC transformation during training
- Add comprehensive gradient flow tests for fast/slow paths and fallback
- All 25 CDC tests passing
2025-10-09 18:28:50 -04:00
rockerBOO
f552f9a3bd
Add CDC-FM (Carré du Champ Flow Matching) support
...
Implements geometry-aware noise generation for FLUX training based on
arXiv:2510.05930v1.
2025-10-09 18:28:47 -04:00
Kohya S
8783f8aed3
feat: faster safetensors load and split safetensor utils
2025-09-13 19:51:38 +09:00
rockerBOO
c149cf283b
Add parser args for other trainers.
2025-08-03 00:58:25 -04:00
rockerBOO
056472c2fc
Add tests
2025-08-02 21:16:56 -04:00
Kohya S
6731d8a57f
fix: update system prompt handling
2025-06-29 22:21:48 +09:00
Kohya S
078ee28a94
feat: add more workaround for 'gated repo' error on github actions
2025-06-29 22:06:19 +09:00
Kohya S
5034c6f813
feat: add workaround for 'gated repo' error on github actions
2025-06-29 22:00:58 +09:00
Kohya S
935e0037dc
feat: update lumina system prompt handling
2025-06-29 21:33:09 +09:00
rockerBOO
1db78559a6
Merge branch 'sd3' into update-sd3
2025-06-16 16:43:34 -04:00
rockerBOO
d94bed645a
Add lumina tests and fix image masks
2025-06-09 21:14:51 -04:00
rockerBOO
0145efc2f2
Merge branch 'sd3' into lumina
2025-06-09 18:13:06 -04:00
rockerBOO
e4d6923409
Add tests for syntax checking training scripts
2025-06-03 16:12:02 -04:00
rockerBOO
89f0d27a59
Set sigmoid_scale to default 1.0
2025-03-20 15:10:33 -04:00
rockerBOO
d40f5b1e4e
Revert "Scale sigmoid to default 1.0"
...
This reverts commit 8aa126582e
2025-03-20 15:09:50 -04:00
rockerBOO
8aa126582e
Scale sigmoid to default 1.0
2025-03-20 15:09:11 -04:00
rockerBOO
e8b3254858
Add flux_train_utils tests for get get_noisy_model_input_and_timesteps
2025-03-20 15:01:15 -04:00
rockerBOO
9647f1e324
Fix validation block swap. Add custom offloading tests
2025-02-27 20:36:36 -05:00
rockerBOO
9436b41061
Fix validation split and add test
2025-02-17 14:28:41 -05:00
rockerBOO
3e5d89c76c
Add more resources
2024-12-02 13:51:57 -05:00
rockerBOO
63738ecb07
Add tests documentation
2024-12-02 13:48:30 -05:00
rockerBOO
c7cadbc8c7
Add pytest testing
2024-11-29 15:52:03 -05:00
