Commit Graph

  • 1bba7acd9a Add block swap in sample image timestep loop rockerBOO 2025-02-28 14:11:53 -05:00
  • d6f7e2e20c Fix block swap for sample images rockerBOO 2025-02-28 14:08:27 -05:00
  • 272f4c3775 Merge branch 'sd3' into sd3_safetensors_merge Kohya S 2025-02-28 23:52:36 +09:00
  • 734333d0c9 feat: enhance merging logic for safetensors models to handle key prefixes correctly Kohya S 2025-02-28 23:52:29 +09:00
  • 9647f1e324 Fix validation block swap. Add custom offloading tests rockerBOO 2025-02-27 20:36:36 -05:00
  • 42fe22f5a2 Enable block swap for Lumina rockerBOO 2025-02-27 03:21:24 -05:00
  • ce2610d29b Change system prompt to inject Prompt Start special token rockerBOO 2025-02-27 02:47:04 -05:00
  • 0886d976f1 Add block swap rockerBOO 2025-02-27 02:31:50 -05:00
  • 542f980443 Fix sample norms in batches rockerBOO 2025-02-27 00:00:20 -05:00
  • 70403f6977 fix cache text encoder outputs if not using disk. small cleanup/alignment rockerBOO 2025-02-26 23:33:50 -05:00
  • 7b83d50dc0 Merge branch 'sd3' into lumina rockerBOO 2025-02-26 22:13:56 -05:00
  • 2f69f4dbdb fix typo Disty0 2025-02-27 00:30:19 +03:00
  • 9a415ba965 JPEG XL support Disty0 2025-02-27 00:21:57 +03:00
  • 3d79239be4 docs: update README to include recent improvements in validation loss calculation Kohya S 2025-02-26 21:21:04 +09:00
  • ec350c83eb Merge branch 'dev' into sd3 Kohya S 2025-02-26 21:17:29 +09:00
  • 49651892ce Merge pull request #1903 from kohya-ss/val-loss-improvement Kohya S. 2025-02-26 21:15:14 +09:00
  • 1fcac98280 Merge branch 'sd3' into val-loss-improvement Kohya S 2025-02-26 21:09:10 +09:00
  • b286304e5f Merge pull request #1953 from Disty0/dev Kohya S. 2025-02-26 21:03:09 +09:00
  • ae409e83c9 fix: FLUX/SD3 network training not working without caching latents closes #1954 Kohya S 2025-02-26 20:56:32 +09:00
  • 5228db1548 feat: add script to merge multiple safetensors files into a single file for SD3 Kohya S 2025-02-26 20:50:58 +09:00
  • f4a0047865 feat: support metadata loading in MemoryEfficientSafeOpen Kohya S 2025-02-26 20:50:44 +09:00
  • a1a5627b13 fix shift sdbds 2025-02-26 11:35:38 +08:00
  • ce37c08b9a clean code and add finetune code sdbds 2025-02-26 11:20:03 +08:00
  • f68702f71c Update IPEX libs Disty0 2025-02-25 21:27:41 +03:00
  • 5f9047c8cf add truncation when > max_length sdbds 2025-02-26 01:00:35 +08:00
  • 6e90c0f86c Merge pull request #1909 from rockerBOO/progress_bar Kohya S. 2025-02-24 18:57:44 +09:00
  • 67fde015f7 Merge branch 'dev' into sd3 Kohya S 2025-02-24 18:56:15 +09:00
  • 386b7332c6 Merge pull request #1918 from tsukimiya/fix_vperd_warning Kohya S. 2025-02-24 18:55:25 +09:00
  • 905f081798 Merge branch 'dev' into sd3 Kohya S 2025-02-24 18:54:28 +09:00
  • 59ae9ea20c Merge pull request #1945 from yidiq7/dev Kohya S. 2025-02-24 18:53:46 +09:00
  • fc772affbe 1、Implement cfg_trunc calculation directly using timesteps, without intermediate steps. sdbds 2025-02-24 14:10:24 +08:00
  • 653621de57 Merge pull request #15 from rockerBOO/samples-training 青龍聖者@bdsqlsz 2025-02-24 11:24:53 +08:00
  • 2c94d17f05 Fix typo rockerBOO 2025-02-23 20:21:06 -05:00
  • 48e7da2d4a Add sample batch size for Lumina rockerBOO 2025-02-23 20:19:24 -05:00
  • ba725a84e9 Set default discrete_flow_shift to 6.0. Remove default system prompt. rockerBOO 2025-02-23 18:01:09 -05:00
  • 42a801514c Fix system prompt in datasets rockerBOO 2025-02-23 13:48:37 -05:00
  • 6d7bec8a37 Remove non-used code rockerBOO 2025-02-23 01:46:47 -05:00
  • 025cca699b Fix samples, LoRA training. Add system prompt, use_flash_attn rockerBOO 2025-02-23 01:29:18 -05:00
  • efb2a128cd fix wandb val logging Kohya S 2025-02-21 22:07:35 +09:00
  • 13df47516d Remove position_ids for V2 Yidi 2025-02-20 04:49:51 -05:00
  • 7f2747176b Use resize_image where resizing is required rockerBOO 2025-02-19 14:20:24 -05:00
  • ca1c129ffd Fix metadata rockerBOO 2025-02-14 16:18:24 -05:00
  • 545425c13e Typo rockerBOO 2025-02-14 14:24:25 -05:00
  • 7729c4c8f9 Add metadata rockerBOO 2025-02-14 14:18:53 -05:00
  • d0128d18be Add resize interpolation CLI option rockerBOO 2025-02-14 14:14:57 -05:00
  • 58e9e146a3 Add resize interpolation configuration rockerBOO 2025-02-14 14:02:21 -05:00
  • f3a85060ef Merge branch 'sd3' into new_cache new_cache Kohya S 2025-02-19 21:13:08 +09:00
  • 6597631b90 Merge pull request #14 from rockerBOO/samples-attention 青龍聖者@bdsqlsz 2025-02-19 13:08:00 +08:00
  • 4a36996134 modify log step calculation Kohya S 2025-02-18 22:05:08 +09:00
  • dc7d5fb459 Merge branch 'sd3' into val-loss-improvement Kohya S 2025-02-18 21:34:30 +09:00
  • 894037f2c6 Merge pull request #1943 from rockerBOO/validation-split-test Kohya S. 2025-02-18 21:30:32 +09:00
  • bd16bd13ae Remove unused attention, fix typo rockerBOO 2025-02-18 01:21:18 -05:00
  • 98efbc3bb7 Add documentation to model, use SDPA attention, sample images rockerBOO 2025-02-18 00:58:53 -05:00
  • 9436b41061 Fix validation split and add test rockerBOO 2025-02-17 14:28:41 -05:00
  • 1aa2f00e85 Fix validation epoch loss to check epoch average rockerBOO 2025-02-16 01:42:44 -05:00
  • 3ed7606f88 Clear sizes for validation reg images to be consistent rockerBOO 2025-02-16 22:28:34 -05:00
  • 3365cfadd7 Fix sizes for validation split rockerBOO 2025-02-16 22:18:14 -05:00
  • 44782dd790 Fix validation epoch divergence rockerBOO 2025-02-14 11:14:38 -05:00
  • 7c22e12a39 Merge pull request #1938 from rockerBOO/validation-epoch-loss-recorder Kohya S. 2025-02-17 21:45:04 +09:00
  • 6051fa8217 Merge pull request #1940 from rockerBOO/split-size-fix Kohya S. 2025-02-17 21:42:10 +09:00
  • aa36c48685 update for always use gemma2 mask sdbds 2025-02-17 19:00:18 +08:00
  • bb7bae5dff Merge pull request #13 from rockerBOO/lumina-cache-checkpointing 青龍聖者@bdsqlsz 2025-02-17 15:43:54 +08:00
  • 3ce23b7f16 Merge branch 'lumina' of https://github.com/sdbds/sd-scripts into lumina sdbds 2025-02-17 14:53:16 +08:00
  • 733fdc09c6 update sdbds 2025-02-17 14:52:48 +08:00
  • f3a010978c Clear sizes for validation reg images to be consistent rockerBOO 2025-02-16 22:28:34 -05:00
  • 3c7496ae3f Fix sizes for validation split rockerBOO 2025-02-16 22:18:14 -05:00
  • 6965a0178a Merge pull request #12 from rockerBOO/lumina-model-loading 青龍聖者@bdsqlsz 2025-02-17 00:47:08 +08:00
  • 4671e23778 Fix validation epoch loss to check epoch average rockerBOO 2025-02-16 01:42:44 -05:00
  • 16015635d2 Update metadata.resolution for Lumina 2 rockerBOO 2025-02-16 01:36:29 -05:00
  • 60a76ebb72 Add caching gemma2, add gradient checkpointing, refactor lumina model code rockerBOO 2025-02-16 01:06:34 -05:00
  • a00b06bc97 Lumina 2 and Gemma 2 model loading rockerBOO 2025-02-15 14:56:11 -05:00
  • 63337d9fe4 Merge branch 'sd3' into val-loss-improvement Kohya S 2025-02-15 21:41:07 +09:00
  • ee295c7d9f Merge pull request #1935 from rockerBOO/validation-epoch-fix Kohya S. 2025-02-15 21:39:28 +09:00
  • 7323ee1b9d update lora_lumina sdbds 2025-02-15 17:10:34 +08:00
  • c0caf33e3f update sdbds 2025-02-15 16:38:59 +08:00
  • ab88b431b0 Fix validation epoch divergence rockerBOO 2025-02-14 11:14:38 -05:00
  • d154e76c45 init sdbds 2025-02-12 16:30:05 +08:00
  • 76b761943b fix: simplify validation step condition in NetworkTrainer Kohya S 2025-02-11 21:53:57 +09:00
  • cd80752175 fix: remove unused parameter 'accelerator' from encode_images_to_latents method Kohya S 2025-02-11 21:42:58 +09:00
  • 177203818a fix: unpause training progress bar after vaidation Kohya S 2025-02-11 21:42:46 +09:00
  • 344845b429 fix: validation with block swap Kohya S 2025-02-09 21:25:40 +09:00
  • 0911683717 set python random state Kohya S 2025-02-09 20:53:49 +09:00
  • a24db1d532 fix: validation timestep generation fails on SD/SDXL training Kohya S 2025-02-04 22:02:42 +09:00
  • c5b803ce94 rng state management: Implement functions to get and set RNG states for consistent validation Kohya S 2025-02-04 21:59:09 +09:00
  • 4a71687d20 不要な警告の削除 tsukimiya 2025-02-04 00:42:27 +09:00
  • de830b8941 Move progress bar to account for sampling image first rockerBOO 2025-01-29 00:02:45 -05:00
  • 45ec02b2a8 use same noise for every validation Kohya S 2025-01-27 22:10:38 +09:00
  • 42c0a9e1fc Merge branch 'sd3' into val-loss-improvement Kohya S 2025-01-27 22:06:18 +09:00
  • 0778dd9b1d fix Text Encoder only LoRA training Kohya S 2025-01-27 22:03:42 +09:00
  • 0750859133 validation: Implement timestep-based validation processing Kohya S 2025-01-27 21:56:59 +09:00
  • 29f31d005f add network.train()/eval() for validation Kohya S 2025-01-27 21:35:43 +09:00
  • b6a3093216 call optimizer eval/train fn before/after validation Kohya S 2025-01-27 21:22:11 +09:00
  • 86a2f3fd26 Fix gradient handling when Text Encoders are trained Kohya S 2025-01-27 21:10:52 +09:00
  • 532f5c58a6 formatting Kohya S 2025-01-27 20:50:42 +09:00
  • 59b3b94faf README.md: Update limitation for validation loss support to include schedule-free optimizer Kohya S 2025-01-26 21:52:58 +09:00
  • f1ac81e07a Merge pull request #1899 from kohya-ss/val-loss Kohya S. 2025-01-26 21:32:29 +09:00
  • e8529613d8 README.md: Update recent updates section to include validation loss support for training scripts Kohya S 2025-01-26 21:27:22 +09:00
  • 58b82a576e Fix to work with validation dataset Kohya S 2025-01-26 21:21:21 +09:00
  • b833d47afe Merge pull request #1864 from rockerBOO/validation-loss-upstream Kohya S. 2025-01-26 21:08:14 +09:00
  • 23ce75cf95 Merge branch 'dev' into sd3 Kohya S 2025-01-26 21:05:29 +09:00