rockerBOO e03200bdba Optimize: Cache CDC shapes in memory to eliminate I/O bottleneck ...

- Cache all shapes during GammaBDataset initialization
- Eliminates file I/O on every training step (9.5M accesses/sec)
- Reduces get_shape() from file operation to dict lookup
- Memory overhead: ~126 bytes/sample (~12.6 MB per 100k images)

2025-10-09 18:28:50 -04:00

..

ipex

Update IPEX libs

2025-06-13 16:25:16 +03:00

__init__.py

Proposed file structure rework and required file changes

2022-12-18 15:24:46 -05:00

adafactor_fused.py

add stochastic rounding, fix single block

2024-08-21 21:04:10 +09:00

attention_processors.py

update diffusers to 1.16 | train_network

2023-06-01 20:39:26 +09:00

attention.py

feat: add multi backend attention and related update for HI2.1 models and scripts

2025-09-20 19:45:33 +09:00

cdc_fm.py

Optimize: Cache CDC shapes in memory to eliminate I/O bottleneck

2025-10-09 18:28:50 -04:00

chroma_models.py

feat: implement modulation vector extraction for Chroma and update related methods

2025-07-30 21:34:49 +09:00

config_util.py

feat: update lumina system prompt handling

2025-06-29 21:33:09 +09:00

custom_offloading_utils.py

Update library/custom_offloading_utils.py

2025-09-21 13:29:58 +09:00

custom_train_functions.py

Fix training, validation split, revert to using upstream implemenation

2025-01-03 15:20:25 -05:00

deepspeed_utils.py

update deepspeed wrapper

2025-04-24 11:26:36 +08:00

device_utils.py

Merge branch 'sd3' into feat-hunyuan-image-2.1-inference

2025-09-13 20:13:58 +09:00

flux_models.py

feat: implement modulation vector extraction for Chroma and update related methods

2025-07-30 21:34:49 +09:00

flux_train_utils.py

Add CDC-FM (Carré du Champ Flow Matching) support

2025-10-09 18:28:47 -04:00

flux_utils.py

feat: faster safetensors load and split safetensor utils

2025-09-13 19:51:38 +09:00

fp8_optimization_utils.py

fix: block-wise scaling is overwritten by per-tensor scaling

2025-09-21 13:10:41 +09:00

huggingface_util.py

Replace print with logger if they are logs (#905)

2024-02-04 18:14:34 +09:00

hunyuan_image_models.py

feat: add multi backend attention and related update for HI2.1 models and scripts

2025-09-20 19:45:33 +09:00

hunyuan_image_modules.py

feat: add multi backend attention and related update for HI2.1 models and scripts

2025-09-20 19:45:33 +09:00

hunyuan_image_text_encoder.py

fix: --fp8_vl to work

2025-09-18 23:46:18 +09:00

hunyuan_image_utils.py

fix: remove print statement for guidance rescale in AdaptiveProjectedGuidance

2025-09-21 13:09:38 +09:00

hunyuan_image_vae.py

feat: add vae_chunk_size argument for memory-efficient VAE decoding and processing

2025-09-21 11:09:37 +09:00

hypernetwork.py

update diffusers to 1.16 | train_network

2023-06-01 20:39:26 +09:00

jpeg_xl_util.py

doc: update license information in jpeg_xl_util.py

2025-03-31 22:02:25 +09:00

lora_utils.py

feat: block-wise fp8 quantization

2025-09-18 21:20:54 +09:00

lpw_stable_diffusion.py

Replace print with logger if they are logs (#905)

2024-02-04 18:14:34 +09:00

lumina_models.py

Add lumina tests and fix image masks

2025-06-09 21:14:51 -04:00

lumina_train_util.py

feat: faster safetensors load and split safetensor utils

2025-09-13 19:51:38 +09:00

lumina_util.py

feat: faster safetensors load and split safetensor utils

2025-09-13 19:51:38 +09:00

model_util.py

feat: update libraries, remove warnings

2025-08-16 20:07:03 +09:00

original_unet.py

feat: update libraries, remove warnings

2025-08-16 20:07:03 +09:00

safetensors_utils.py

Update library/safetensors_utils.py

2025-09-13 20:03:55 +09:00

sai_model_spec.py

feat: block swap for inference and initial impl for HunyuanImage LoRA (not working)

2025-09-11 22:15:22 +09:00

sd3_models.py

Fix validation block swap. Add custom offloading tests

2025-02-27 20:36:36 -05:00

sd3_train_utils.py

Add lumina tests and fix image masks

2025-06-09 21:14:51 -04:00

sd3_utils.py

feat: faster safetensors load and split safetensor utils

2025-09-13 19:51:38 +09:00

sdxl_lpw_stable_diffusion.py

sample generation in SDXL ControlNet training

2024-09-30 23:39:32 +09:00

sdxl_model_util.py

use original ControlNet instead of Diffusers

2024-09-29 23:07:34 +09:00

sdxl_original_control_net.py

use original ControlNet instead of Diffusers

2024-09-29 23:07:34 +09:00

sdxl_original_unet.py

use original ControlNet instead of Diffusers

2024-09-29 23:07:34 +09:00

sdxl_train_util.py

Merge branch 'dev' into sd3

2025-09-29 21:02:02 +09:00

slicing_vae.py

Replace print with logger if they are logs (#905)

2024-02-04 18:14:34 +09:00

strategy_base.py

feat: add vae_chunk_size argument for memory-efficient VAE decoding and processing

2025-09-21 11:09:37 +09:00

strategy_flux.py

Support SD3.5M multi resolutional training

2024-10-31 19:58:22 +09:00

strategy_hunyuan_image.py

feat: HunyuanImage LoRA training

2025-09-12 21:40:42 +09:00

strategy_lumina.py

fix: update system prompt handling

2025-06-29 22:21:48 +09:00

strategy_sd3.py

Support SD3.5M multi resolutional training

2024-10-31 19:58:22 +09:00

strategy_sd.py

Fix training, validation split, revert to using upstream implemenation

2025-01-03 15:20:25 -05:00

strategy_sdxl.py

support weighted captions for SD/SDXL

2024-10-11 08:48:55 +09:00

train_util.py

Add CDC-FM (Carré du Champ Flow Matching) support

2025-10-09 18:28:47 -04:00

utils.py

feat: faster safetensors load and split safetensor utils

2025-09-13 19:51:38 +09:00