Kohya S a437949d47 feat: Add support for Safetensors format in caching strategies (WIP) ...

- Introduced Safetensors output format for various caching strategies including Hunyuan, Lumina, SD, SDXL, and SD3.
- Updated methods to handle loading and saving of tensors in Safetensors format.
- Enhanced output validation to check for required tensors in both NPZ and Safetensors formats.
- Modified dataset argument parser to include `--cache_format` option for selecting between NPZ and Safetensors formats.
- Updated caching logic to accommodate partial loading and merging of existing Safetensors files.

2026-03-22 21:15:12 +09:00

..

ipex

Update IPEX libs

2025-06-13 16:25:16 +03:00

__init__.py

Proposed file structure rework and required file changes

2022-12-18 15:24:46 -05:00

adafactor_fused.py

add stochastic rounding, fix single block

2024-08-21 21:04:10 +09:00

anima_models.py

fix: cast input tensor to float32 for improved numerical stability in residual connections

2026-02-23 21:12:57 +09:00

anima_train_utils.py

Add/modify some implementation for anima (#2261)

2026-02-13 08:15:06 +09:00

anima_utils.py

Add/modify some implementation for anima (#2261)

2026-02-13 08:15:06 +09:00

attention_processors.py

update diffusers to 1.16 | train_network

2023-06-01 20:39:26 +09:00

attention.py

Add/modify some implementation for anima (#2261)

2026-02-13 08:15:06 +09:00

chroma_models.py

feat: implement modulation vector extraction for Chroma and update related methods

2025-07-30 21:34:49 +09:00

config_util.py

Add skip_image_resolution to deduplicate multi-resolution dataset (#2273)

2026-03-19 08:43:39 +09:00

custom_offloading_utils.py

Add/modify some implementation for anima (#2261)

2026-02-13 08:15:06 +09:00

custom_train_functions.py

Fix training, validation split, revert to using upstream implemenation

2025-01-03 15:20:25 -05:00

deepspeed_utils.py

fix: str is not "no" to str != "no"

2026-02-16 07:58:15 +09:00

device_utils.py

Merge branch 'sd3' into feat-hunyuan-image-2.1-inference

2025-09-13 20:13:58 +09:00

flux_models.py

feat: implement modulation vector extraction for Chroma and update related methods

2025-07-30 21:34:49 +09:00

flux_train_utils.py

Add/modify some implementation for anima (#2261)

2026-02-13 08:15:06 +09:00

flux_utils.py

feat: faster safetensors load and split safetensor utils

2025-09-13 19:51:38 +09:00

fp8_optimization_utils.py

Add/modify some implementation for anima (#2261)

2026-02-13 08:15:06 +09:00

huggingface_util.py

Replace print with logger if they are logs (#905)

2024-02-04 18:14:34 +09:00

hunyuan_image_models.py

feat: add multi backend attention and related update for HI2.1 models and scripts

2025-09-20 19:45:33 +09:00

hunyuan_image_modules.py

feat: add multi backend attention and related update for HI2.1 models and scripts

2025-09-20 19:45:33 +09:00

hunyuan_image_text_encoder.py

fix: --fp8_vl to work

2025-09-18 23:46:18 +09:00

hunyuan_image_utils.py

fix: remove print statement for guidance rescale in AdaptiveProjectedGuidance

2025-09-21 13:09:38 +09:00

hunyuan_image_vae.py

feat: add vae_chunk_size argument for memory-efficient VAE decoding and processing

2025-09-21 11:09:37 +09:00

hypernetwork.py

update diffusers to 1.16 | train_network

2023-06-01 20:39:26 +09:00

jpeg_xl_util.py

doc: update license information in jpeg_xl_util.py

2025-03-31 22:02:25 +09:00

lora_utils.py

feat: Support LoKr/LoHa for SDXL and Anima (#2275)

2026-02-23 22:09:00 +09:00

lpw_stable_diffusion.py

Replace print with logger if they are logs (#905)

2024-02-04 18:14:34 +09:00

lumina_models.py

Fix bug and optimization Lumina training

2026-02-12 22:52:28 +07:00

lumina_train_util.py

Fix bug and optimization Lumina training

2026-02-12 22:52:28 +07:00

lumina_util.py

feat: faster safetensors load and split safetensor utils

2025-09-13 19:51:38 +09:00

model_util.py

feat: update libraries, remove warnings

2025-08-16 20:07:03 +09:00

original_unet.py

feat: update libraries, remove warnings

2025-08-16 20:07:03 +09:00

qwen_image_autoencoder_kl.py

Add/modify some implementation for anima (#2261)

2026-02-13 08:15:06 +09:00

safetensors_utils.py

Add/modify some implementation for anima (#2261)

2026-02-13 08:15:06 +09:00

sai_model_spec.py

Add/modify some implementation for anima (#2261)

2026-02-13 08:15:06 +09:00

sd3_models.py

Fix validation block swap. Add custom offloading tests

2025-02-27 20:36:36 -05:00

sd3_train_utils.py

Add lumina tests and fix image masks

2025-06-09 21:14:51 -04:00

sd3_utils.py

feat: faster safetensors load and split safetensor utils

2025-09-13 19:51:38 +09:00

sdxl_lpw_stable_diffusion.py

sample generation in SDXL ControlNet training

2024-09-30 23:39:32 +09:00

sdxl_model_util.py

use original ControlNet instead of Diffusers

2024-09-29 23:07:34 +09:00

sdxl_original_control_net.py

use original ControlNet instead of Diffusers

2024-09-29 23:07:34 +09:00

sdxl_original_unet.py

use original ControlNet instead of Diffusers

2024-09-29 23:07:34 +09:00

sdxl_train_util.py

Merge branch 'dev' into sd3

2025-09-29 21:02:02 +09:00

slicing_vae.py

Replace print with logger if they are logs (#905)

2024-02-04 18:14:34 +09:00

strategy_anima.py

feat: Add support for Safetensors format in caching strategies (WIP)

2026-03-22 21:15:12 +09:00

strategy_base.py

feat: Add support for Safetensors format in caching strategies (WIP)

2026-03-22 21:15:12 +09:00

strategy_flux.py

feat: Add support for Safetensors format in caching strategies (WIP)

2026-03-22 21:15:12 +09:00

strategy_hunyuan_image.py

feat: Add support for Safetensors format in caching strategies (WIP)

2026-03-22 21:15:12 +09:00

strategy_lumina.py

feat: Add support for Safetensors format in caching strategies (WIP)

2026-03-22 21:15:12 +09:00

strategy_sd3.py

feat: Add support for Safetensors format in caching strategies (WIP)

2026-03-22 21:15:12 +09:00

strategy_sd.py

feat: Add support for Safetensors format in caching strategies (WIP)

2026-03-22 21:15:12 +09:00

strategy_sdxl.py

feat: Add support for Safetensors format in caching strategies (WIP)

2026-03-22 21:15:12 +09:00

train_util.py

feat: Add support for Safetensors format in caching strategies (WIP)

2026-03-22 21:15:12 +09:00

utils.py

feat: faster safetensors load and split safetensor utils

2025-09-13 19:51:38 +09:00