Commit Graph

  • 6acdbed967 Merge branch 'dev' into sd3 Kohya S 2025-01-26 21:04:05 +09:00
  • c04e5dfe92 Fix loss recorder on 0. Fix validation for cached runs. Assert on validation dataset rockerBOO 2025-01-23 09:57:24 -05:00
  • 6e3c1d0b58 Merge pull request #1879 from kohya-ss/dev v0.9.0 Kohya S. 2025-01-17 23:25:56 +09:00
  • 345daaa986 update README for merging Kohya S 2025-01-17 23:22:38 +09:00
  • b489082495 Disable repeats for validation datasets rockerBOO 2025-01-12 16:42:04 -05:00
  • 25929dd0d7 Remove Validating... print to fix output layout rockerBOO 2025-01-12 15:38:57 -05:00
  • ee9265cf26 Fix validate_every_n_steps for gradient accumulation rockerBOO 2025-01-12 14:56:35 -05:00
  • 0456858992 Fix validate_every_n_steps always running first step rockerBOO 2025-01-12 14:47:49 -05:00
  • 2bbb40ce51 Fix regularization images with validation rockerBOO 2025-01-12 14:29:50 -05:00
  • 4c61adc996 Add divergence to logs rockerBOO 2025-01-12 13:18:26 -05:00
  • 264167fa16 Apply is_training_dataset only to DreamBoothDataset. Add validation_split check and warning rockerBOO 2025-01-09 12:43:58 -05:00
  • d6f158ddf6 Fix incorrect destructoring for load_abritrary_dataset rockerBOO 2025-01-08 18:48:05 -05:00
  • 1e61392cf2 Revert bucket_reso_steps to correct 64 rockerBOO 2025-01-08 18:43:26 -05:00
  • 9fde0d7972 Handle tuple return from generate_dataset_group_by_blueprint rockerBOO 2025-01-08 18:38:20 -05:00
  • 556f3f1696 Fix documentation, remove unused function, fix bucket reso for sd1.5, fix multiple datasets rockerBOO 2025-01-08 13:41:15 -05:00
  • 1231f5114c Remove unused train_util code, fix accelerate.log for wandb, add init_trackers library code rockerBOO 2025-01-07 22:31:41 -05:00
  • 742bee9738 Set validation steps in multiple lines for readability rockerBOO 2025-01-06 17:34:23 -05:00
  • fcb2ff010c Clean up some validation help documentation rockerBOO 2025-01-06 11:39:32 -05:00
  • f8850296c8 Fix validate epoch, cleanup imports rockerBOO 2025-01-06 11:34:10 -05:00
  • c64d1a22fc Add validate_every_n_epochs, change name validate_every_n_steps rockerBOO 2025-01-06 11:30:21 -05:00
  • 1c63e7cc49 Cleanup unused code and formatting rockerBOO 2025-01-06 11:07:47 -05:00
  • f4840ef29e Revert train_db.py rockerBOO 2025-01-06 10:52:07 -05:00
  • bbf6bbd5ea Use self.get_noise_pred_and_target and drop fixed timesteps rockerBOO 2025-01-06 10:48:38 -05:00
  • a9c5aa1f93 add CFG to FLUX.1 sample image Kohya S 2025-01-05 22:28:51 +09:00
  • 1c0ae306e5 Add missing functions for training batch rockerBOO 2025-01-03 15:43:02 -05:00
  • 1f9ba40b8b Add step break for validation epoch. Remove unused variable rockerBOO 2025-01-03 15:32:07 -05:00
  • 695f38962c Move get_huber_threshold_if_needed rockerBOO 2025-01-03 15:25:12 -05:00
  • 0522070d19 Fix training, validation split, revert to using upstream implemenation rockerBOO 2025-01-03 15:20:25 -05:00
  • 6604b36044 Remove duplicate assignment rockerBOO 2025-01-03 02:04:59 -05:00
  • 58bfa36d02 Add seed help clarifying info rockerBOO 2025-01-03 02:00:28 -05:00
  • fbfc2753eb Update text for train/reg with repeats rockerBOO 2025-01-03 01:53:12 -05:00
  • c8c3569df2 Cleanup order, types, print to logger rockerBOO 2025-01-03 01:26:45 -05:00
  • 534059dea5 Typos and lingering is_train rockerBOO 2025-01-03 01:18:15 -05:00
  • 7470173044 Remove defunct code for train_controlnet.py rockerBOO 2025-01-03 01:13:57 -05:00
  • d23c7322ee Merge remote-tracking branch 'hina/feature/val-loss' into validation-loss-upstream rockerBOO 2025-01-03 00:48:08 -05:00
  • 7f6e124c7c Merge branch 'gesen2egee/val' into validation-loss-upstream rockerBOO 2025-01-02 23:04:38 -05:00
  • 449c1c5c50 Adding modified train_util and config_util rockerBOO 2025-01-02 15:59:20 -05:00
  • 8743532963 val gesen2egee 2024-03-10 04:37:16 +08:00
  • cb89e0284e Change val latent loss compare Hina Chen 2024-12-28 11:57:04 +08:00
  • 64bd5317dc Split val latents/batch and pick up val latents shape size which equal to training batch. Hina Chen 2024-12-28 11:42:15 +08:00
  • 62164e5792 Change val loss calculate method Hina Chen 2024-12-27 17:28:05 +08:00
  • 05bb9183fa Add Validation loss for LoRA training Hina Chen 2024-12-27 16:47:59 +08:00
  • e89653975d update requirements.txt and README to include RAdamScheduleFree optimizer support Kohya S 2024-12-15 19:39:47 +09:00
  • f2d38e6cda Merge pull request #1830 from nhamanasu/sd3 Kohya S. 2024-12-15 19:28:21 +09:00
  • d3305f975e Merge pull request #1828 from rockerBOO/workflow-security-audit Kohya S. 2024-12-15 18:55:37 +09:00
  • 8e378cf03d add RAdamScheduleFree support nhamanasu 2024-12-11 19:43:44 +09:00
  • 3cb8cb2d4f Prevent git credentials from leaking into other actions rockerBOO 2024-12-09 15:20:04 -05:00
  • f2322a23e2 feat: update fine tuning dataset Kohya S 2024-12-09 20:52:18 +09:00
  • 70423ec61d Merge branch 'sd3' into new_cache Kohya S 2024-12-09 18:36:10 +09:00
  • e425996a59 feat: unify ControlNet model name option and deprecate old training script Kohya S 2024-12-07 17:28:19 +09:00
  • abff4b0ec7 Unify controlnet parameters name and change scripts name. (#1821) 青龍聖者@bdsqlsz 2024-12-07 16:12:46 +08:00
  • 2be336688d Merge pull request #1817 from rockerBOO/workflow-tests-fixes Kohya S. 2024-12-07 16:57:36 +09:00
  • 6bee18db4f fix: resolve model corruption issue with pos_embed when using --enable_scaled_pos_embed Kohya S 2024-12-07 15:12:27 +09:00
  • 28e9352cc5 feat: Florence-2 captioninig (WIP) Kohya S 2024-12-05 22:04:37 +09:00
  • b72b9eaf11 Merge branch 'sd3' into new_cache Kohya S 2024-12-04 20:44:42 +09:00
  • 8b36d907d8 feat: support block_to_swap for FLUX.1 ControlNet training Kohya S 2024-12-03 08:43:26 +09:00
  • 3e5d89c76c Add more resources rockerBOO 2024-12-02 13:51:57 -05:00
  • 2610e96e9e Pytest rockerBOO 2024-12-02 13:49:58 -05:00
  • 63738ecb07 Add tests documentation rockerBOO 2024-12-02 13:48:30 -05:00
  • 5ab00f9b49 Update workflow tests with cleanup and documentation rockerBOO 2024-12-02 13:39:51 -05:00
  • e369b9a252 docs: update README with FLUX.1 ControlNet training details and improve argument help text kohya-ss 2024-12-02 23:38:54 +09:00
  • 09a3740f6c Merge pull request #1813 from minux302/flux-controlnet Kohya S. 2024-12-02 23:32:16 +09:00
  • e3fd6c52a0 Merge pull request #1812 from rockerBOO/tests Kohya S. 2024-12-02 21:38:43 +09:00
  • 1dc873d9b4 update README and clean up code for schedulefree optimizer Kohya S 2024-12-01 22:00:44 +09:00
  • 14c9ba925f Merge pull request #1811 from rockerBOO/schedule-free-prodigy Kohya S. 2024-12-01 21:51:25 +09:00
  • 34e7f509c4 docs: update README for huber loss Kohya S 2024-12-01 21:36:24 +09:00
  • bdf9a8cc29 Merge pull request #1815 from kohya-ss/flux-huber-loss Kohya S. 2024-12-01 21:29:53 +09:00
  • 1476040787 fix: update help text for huber loss parameters in train_util.py flux-huber-loss Kohya S 2024-12-01 21:26:39 +09:00
  • cc11989755 fix: refactor huber-loss calculation in multiple training scripts Kohya S 2024-12-01 21:20:28 +09:00
  • 0fe6320f09 fix flux_train.py is not working Kohya S 2024-12-01 14:13:37 +09:00
  • 14f642f88b fix: huber_schedule exponential not working on sd3_train.py Kohya S 2024-12-01 13:30:35 +09:00
  • a5a27fe4c3 Merge pull request #1808 from recris/huber-loss-flux Kohya S. 2024-12-01 13:15:33 +09:00
  • fa3f8a321f Bump crate-ci/typos from 1.24.3 to 1.28.1 dependabot/github_actions/crate-ci/typos-1.28.1 dependabot[bot] 2024-12-01 01:26:43 +00:00
  • 7b61e9eb58 Fix issues found in review (pt 2) recris 2024-11-30 11:36:40 +00:00
  • 9c885e549d fix: improve pos_embed handling for oversized images and update resolution_area_to_latent_size, when sample image size > train image size Kohya S 2024-11-30 18:25:50 +09:00
  • 4f7f248071 Bump typos action rockerBOO 2024-11-29 16:28:51 -05:00
  • 89825d6898 Run typos workflows once where appropriate rockerBOO 2024-11-29 16:27:13 -05:00
  • dd3b846b54 Install pytorch first to pin version rockerBOO 2024-11-29 16:18:05 -05:00
  • e59e276fb9 Add dadaptation rockerBOO 2024-11-29 16:03:29 -05:00
  • 2dd063a679 add torch torchvision accelerate versions rockerBOO 2024-11-29 15:57:31 -05:00
  • c7cadbc8c7 Add pytest testing rockerBOO 2024-11-29 15:52:03 -05:00
  • 6593cfbec1 Fix d * lr step log rockerBOO 2024-11-21 14:41:37 -05:00
  • 87f5224e2d Support d*lr for ProdigyPlus optimizer rockerBOO 2024-11-20 11:57:15 -05:00
  • 928b9393da Allow unknown schedule-free optimizers to continue to module loader rockerBOO 2024-11-20 11:15:30 -05:00
  • f40632bac6 rm abundant arg minux302 2024-11-30 00:15:47 +09:00
  • be5860f8e2 add schnell option to load_cn minux302 2024-11-30 00:08:21 +09:00
  • 575f583fd9 add README minux302 2024-11-29 23:55:52 +09:00
  • 9dff44d785 fix device minux302 2024-11-29 14:40:38 +00:00
  • 744cf03136 fix to work Kohya S 2024-11-29 21:59:25 +09:00
  • 740ec1d526 Fix issues found in review recris 2024-11-28 20:38:32 +00:00
  • 2238b94e7b support new metadata in wd14tagger (WIP), fix typo Kohya S 2024-11-28 21:05:17 +09:00
  • 420a180d93 Implement pseudo Huber loss for Flux and SD3 recris 2024-11-27 18:11:51 +00:00
  • 665c04e649 Merge branch 'sd3' into new_cache Kohya S 2024-11-27 12:57:32 +09:00
  • 3677094256 Text Encoder cache (WIP) Kohya S 2024-11-27 12:57:04 +09:00
  • 0b5229a955 save cn minux302 2024-11-21 15:55:27 +00:00
  • 2a61fc0784 docs: fix typo from block_to_swap to blocks_to_swap in README kohya-ss 2024-11-20 21:20:35 +09:00
  • 31ca899b6b fix depth value minux302 2024-11-18 13:03:28 +00:00
  • 4dd4cd6ec8 work cn load and validation minux302 2024-11-18 12:47:01 +00:00
  • 35778f0218 fix sample_images type minux302 2024-11-17 11:09:05 +00:00
  • b2660bbe74 train run minux302 2024-11-17 10:24:57 +00:00