Commit Graph

Select branches

Hide Pull Requests

copilot/fix-2142

dependabot/github_actions/crate-ci/typos-1.28.1

dev

dual_reso_unet_hires_fix

feat-extract-flux-lora-from-weights-with-key-prefix

feat-flux-chroma-fp8-scaled

feat-safetensors-cache

feature-chroma

fix-chroma-training-withtout-te-cache

fix-hf-upload

flexible-zero-slicing

flux-huber-loss

free-u

galore

main

multi_embeds

new_cache

no-grad-block-swap

nw_application_weights

resume-step-and-epoch

scheduler-free-opt

sd3

stable-cascade

vae_batch_size_sdxl_train

wuerstchen

#1

#1000

#1003

#1007

#1008

#1009

#1011

#1011

#1012

#1013

#1016

#102

#1020

#1024

#1029

#103

#1030

#1032

#104

#1042

#1044

#1052

#1053

#1054

#1055

#1055

#1056

#1057

#106

#1060

#1061

#1064

#1067

#1068

#1068

#107

#1079

#1084

#1085

#1086

#1087

#1092

#1094

#1096

#1096

#11

#110

#1100

#1101

#1102

#1103

#1103

#1104

#1106

#1113

#1114

#1116

#1117

#1126

#113

#1130

#1136

#1137

#1139

#114

#1142

#1145

#1145

#1146

#1148

#1151

#1151

#1155

#1155

#1162

#1165

#1167

#1168

#1170

#1174

#1175

#1177

#1178

#1181

#1181

#1187

#1189

#1192

#120

#1200

#1202

#1204

#1205

#1206

#1207

#121

#1212

#1213

#1216

#1223

#1228

#1230

#1231

#1231

#1233

#1240

#1246

#1246

#1250

#1259

#1266

#1267

#1267

#1270

#1277

#1278

#1279

#1279

#128

#1284

#1285

#129

#1291

#13

#1303

#1303

#1307

#1312

#1313

#1315

#1319

#1322

#1327

#1331

#1338

#1338

#1339

#1340

#1340

#1341

#1341

#1347

#1349

#1353

#1359

#1360

#1361

#1363

#1371

#1372

#1372

#1374

#1376

#1376

#1378

#1378

#1381

#1381

#1383

#1383

#1387

#1391

#1391

#1393

#1394

#1395

#1395

#1396

#1396

#1397

#1397

#140

#1405

#1406

#1406

#1409

#1413

#1417

#1426

#1427

#1427

#1429

#1433

#144

#1452

#1461

#1468

#1468

#1469

#147

#148

#1482

#1500

#1501

#1501

#1505

#1508

#152

#1525

#1529

#153

#1532

#154

#1540

#1541

#1550

#1564

#1564

#157

#1573

#1573

#1575

#1576

#158

#1580

#159

#1592

#16

#1600

#1605

#1606

#1606

#1615

#1619

#1620

#1628

#1632

#1637

#1637

#1640

#1646

#1648

#165

#1655

#166

#1660

#1661

#1664

#1664

#1668

#1671

#1677

#1677

#168

#1686

#1690

#171

#1710

#1713

#1713

#1714

#1715

#1717

#1719

#173

#173

#174

#1741

#1741

#1747

#176

#1768

#1769

#177

#1770

#1774

#1779

#178

#1784

#1784

#179

#1799

#1808

#1811

#1812

#1813

#1814

#1814

#1815

#1817

#1821

#1828

#1830

#1838

#1838

#184

#1850

#1850

#1856

#1858

#1864

#1865

#1865

#1866

#1867

#1867

#187

#1870

#1870

#1873

#1873

#1879

#1883

#1883

#189

#1893

#1893

#1894

#1894

#1895

#1895

#1898

#1899

#190

#1900

#1900

#1901

#1901

#1903

#1904

#1904

#1906

#1906

#1908

#1908

#1909

#1910

#1910

#1913

#1918

#1927

#1935

#1936

#1938

#1940

#1943

#1945

#1950

#1950

#1951

#1951

#1953

#1955

#196

#1960

#1961

#1964

#1966

#1971

#1974

#198

#1985

#1988

#1988

#1991

#1991

#1992

#2

#200

#2000

#2000

#2001

#2001

#2002

#2002

#2003

#2007

#2007

#2008

#2010

#2010

#2015

#2018

#2019

#2019

#202

#2022

#2026

#2028

#2032

#2032

#2035

#2036

#2037

#2037

#2042

#2045

#2045

#2046

#2046

#2047

#2047

#2053

#2056

#2056

#2057

#2059

#2060

#2061

#2061

#2064

#2065

#2066

#207

#2070

#2072

#2073

#2074

#208

#2080

#2080

#2086

#2088

#209

#2096

#2096

#2097

#2097

#2098

#2105

#2106

#2107

#2108

#2109

#2109

#2115

#212

#2121

#2129

#2129

#2136

#2136

#2138

#2141

#2141

#2143

#2146

#2147

#2148

#2153

#2157

#2158

#2159

#2159

#2160

#2165

#2167

#2168

#2172

#2172

#2174

#2175

#2178

#2180

#2180

#2184

#2185

#2186

#2187

#2187

#2188

#2188

#219

#2190

#2191

#2192

#2193

#2194

#2196

#2198

#2199

#22

#2200

#2203

#2203

#2207

#2208

#2208

#221

#2210

#2210

#2212

#2213

#2215

#2216

#2217

#2217

#222

#2221

#2221

#2222

#2222

#2223

#2223

#2224

#2225

#2226

#223

#2231

#2231

#2232

#2238

#2238

#2240

#2246

#2251

#2252

#2253

#2254

#2255

#2260

#2261

#2262

#2263

#2264

#2267

#2268

#2269

#227

#2270

#2272

#2273

#2274

#2275

#2276

#2277

#2280

#2281

#2283

#2284

#2285

#2288

#2289

#2290

#2290

#2291

#2294

#2296

#2297

#2298

#2299

#2300

#2301

#2302

#2303

#2304

#2305

#2307

#2309

#2309

#2310

#2311

#2312

#233

#233

#236

#240

#241

#243

#246

#247

#25

#255

#261

#264

#267

#269

#271

#272

#276

#278

#283

#288

#29

#290

#292

#3

#305

#306

#308

#31

#310

#322

#327

#328

#332

#333

#336

#339

#348

#349

#350

#352

#353

#355

#357

#360

#364

#373

#374

#381

#387

#388

#392

#400

#408

#413

#416

#42

#423

#424

#427

#428

#429

#43

#431

#433

#434

#435

#436

#437

#444

#445

#447

#448

#453

#454

#455

#457

#458

#459

#463

#465

#465

#467

#468

#468

#471

#472

#472

#475

#477

#478

#480

#483

#484

#489

#49

#491

#493

#495

#5

#501

#504

#507

#509

#51

#510

#514

#515

#52

#521

#527

#528

#530

#533

#534

#534

#537

#538

#54

#541

#542

#545

#55

#551

#553

#554

#559

#560

#562

#569

#57

#580

#581

#585

#589

#590

#594

#6

#604

#604

#605

#609

#610

#615

#618

#62

#621

#621

#623

#626

#628

#630

#631

#639

#639

#641

#644

#645

#658

#663

#666

#666

#67

#672

#676

#687

#687

#688

#69

#692

#693

#694

#7

#70

#71

#714

#716

#717

#72

#720

#722

#733

#736

#736

#74

#741

#744

#75

#750

#755

#760

#768

#77

#770

#774

#776

#783

#786

#787

#79

#791

#792

#792

#793

#798

#799

#8

#800

#802

#803

#804

#808

#815

#823

#825

#83

#830

#831

#832

#832

#839

#84

#841

#844

#846

#847

#848

#850

#851

#853

#853

#856

#858

#859

#864

#865

#867

#872

#878

#889

#893

#895

#898

#899

#90

#90

#900

#902

#905

#906

#907

#909

#913

#914

#919

#92

#927

#933

#933

#934

#936

#947

#949

#95

#955

#956

#956

#959

#959

#96

#961

#963

#963

#964

#964

#967

#967

#97

#970

#970

#975

#977

#978

#985

#986

#987

#987

#989

#991

#991

#993

#993

#996

#998

v0.1.0

v0.10.0

v0.10.1

v0.10.2

v0.2.0

v0.3.0

v0.3.1

v0.3.2

v0.4.0

v0.4.1

v0.4.2

v0.4.3

v0.4.4

v0.4.5

v0.5.1

v0.5.2

v0.5.3

v0.5.4

v0.6.0

v0.6.1

v0.6.2

v0.6.3

v0.6.4

v0.6.5

v0.6.6

v0.7.0

v0.7.1

v0.8.0

v0.8.1

v0.8.2

v0.8.3

v0.8.4

v0.8.5

v0.8.6

v0.8.7

v0.8.8

v0.9.0

v0.9.1

Mono Color

• bee8cee7e8 update README for fused optimizer Kohya S 2024-05-12 15:08:52 +09:00
• f3d2cf22ff update README for fused optimizer Kohya S 2024-05-12 15:03:02 +09:00
• 6dbc23cf63 Merge branch 'dev' into fused-backward-pass Kohya S 2024-05-12 14:21:56 +09:00
• c1ba0b4356 update readme Kohya S 2024-05-12 14:21:10 +09:00
• 607e041f3d chore: Refactor optimizer group Kohya S 2024-05-12 14:16:41 +09:00
• 793aeb94da fix get_trainable_params in controlnet-llite training AngelBottomless 2024-05-07 18:21:31 +09:00
• b56d5f7801 add experimental option to fuse params to optimizer groups Kohya S 2024-05-06 21:35:39 +09:00
• 017b82ebe3 update help message for fused_backward_pass Kohya S 2024-05-06 15:05:42 +09:00
• 2a359e0a41 Merge pull request #1259 from 2kpr/fused_backward_pass Kohya S 2024-05-06 15:01:56 +09:00
• 3fd8cdc55d fix dylora loraplus Kohya S 2024-05-06 14:03:19 +09:00
• c1ef6dcabc fix to work with wrapped optimizer by accelerate Kohya S 2024-05-06 13:17:14 +09:00
• 7fe81502d0 update loraplus on dylora/lofa_fa Kohya S 2024-05-06 11:09:32 +09:00
• 5fe9ded188 simplify codes for schedule free optimizer Kohya S 2024-05-04 21:03:47 +09:00
• c68712635c Support new optimizer Schedule free (#1250) 青龍聖者@bdsqlsz 2024-05-04 17:56:27 +08:00
• 52e64c69cf add debug log Kohya S 2024-05-04 18:43:52 +09:00
• 58c2d856ae support block dim/lr for sdxl Kohya S 2024-05-03 22:18:20 +09:00
• 8db0cadcee Add caption_separator to output for subset Dave Lage 2024-05-02 18:08:28 -04:00
• dbb7bb288e Fix caption_separator missing in subset schema Dave Lage 2024-05-02 17:39:35 -04:00
• 969f82ab47 move loraplus args from args to network_args, simplify log lr desc Kohya S 2024-04-29 20:04:25 +09:00
• 834445a1d6 Merge pull request #1233 from rockerBOO/lora-plus Kohya S 2024-04-29 18:05:12 +09:00
• fdbb03c360 removed unnecessary torch import on line 115 frodo821 2024-04-23 14:29:05 +09:00
• 040e26ff1d Regenerate failed file If a latent file fails to load, print out the path and the error, then return false to regenerate it Cauldrath 2024-04-21 13:46:31 -04:00
• 0540c33aca pop weights if available #1247 Kohya S 2024-04-21 17:45:29 +09:00
• 52652cba1a disable main process check for deepspeed #1247 Kohya S 2024-04-21 17:41:32 +09:00
• 5cb145d13b Update train_util.py 青龍聖者@bdsqlsz 2024-04-20 21:56:24 +08:00
• b886d0a359 Cleaned typing to be in line with accelerate hyperparameters type resctrictions Maatra 2024-04-20 14:36:47 +01:00
• 4477116a64 fix train controlnet 青龍聖者@bdsqlsz 2024-04-20 21:26:09 +08:00
• 2c9db5d9f2 passing filtered hyperparameters to accelerate Maatra 2024-04-20 14:11:43 +01:00
• fc374375de Allow negative learning rate This can be used to train away from a group of images you don't want As this moves the model away from a point instead of towards it, the change in the model is unbounded So, don't set it too low. -4e-7 seemed to work well. Cauldrath 2024-04-18 23:29:01 -04:00
• feefcf256e Display name of error latent file When trying to load stored latents, if an error occurs, this change will tell you what file failed to load Currently it will just tell you that something failed without telling you which file Cauldrath 2024-04-18 23:15:36 -04:00
• 64916a35b2 add disable_mmap to args Zovjsra 2024-04-16 16:40:08 +08:00
• 4f203ce40d Fused backward pass 2kpr 2024-04-14 09:56:58 -05:00
• 68467bdf4d Fix unset or invalid LR from making a param_group rockerBOO 2024-04-11 17:33:19 -04:00
• fde8026c2d Update config_util.py gesen2egee 2024-04-11 11:29:26 +08:00
• 89ad69b6a0 Update train_util.py gesen2egee 2024-04-11 08:42:31 +08:00
• 459b12539b Update config_util.py gesen2egee 2024-04-11 01:52:14 +08:00
• 3b251b758d Update config_util.py gesen2egee 2024-04-11 01:50:32 +08:00
• 229c5a38ef Update train_util.py gesen2egee 2024-04-11 01:45:49 +08:00
• 36d4023431 Update config_util.py gesen2egee 2024-04-11 01:39:17 +08:00
• 086f6000f2 Merge branch 'main' into val gesen2egee 2024-04-11 01:14:46 +08:00
• 75833e84a1 Fix default LR, Add overall LoRA+ ratio, Add log rockerBOO 2024-04-08 19:23:02 -04:00
• faadc350a4 use skip_first_batches to skip, close pillow image resume-step-and-epoch Kohya S 2024-04-08 23:28:38 +09:00
• 6d9338f8b5 Merge branch 'dev' into resume-step-and-epoch Kohya S 2024-04-08 12:50:18 +09:00
• 71e2c91330 Merge pull request #1230 from kohya-ss/dependabot/github_actions/crate-ci/typos-1.19.0 Kohya S 2024-04-07 21:14:18 +09:00
• bfb352bc43 change huber_schedule from exponential to snr v0.8.7 Kohya S 2024-04-07 21:07:52 +09:00
• c973b29da4 update readme Kohya S 2024-04-07 20:51:52 +09:00
• 683f3d6ab3 Merge pull request #1212 from kohya-ss/dev v0.8.6 Kohya S 2024-04-07 20:42:41 +09:00
• dfa30790a9 update readme Kohya S 2024-04-07 20:34:26 +09:00
• 5f0eebaa56 experimenal impl to restore step/ecoch in resuming Kohya S 2024-04-07 18:18:03 +09:00
• d30ebb205c update readme, add metadata for network module Kohya S 2024-04-07 14:58:17 +09:00
• 90b18795fc Add option to use Scheduled Huber Loss in all training pipelines to improve resilience to data corruption (#1228) kabachuha 2024-04-07 07:54:21 +03:00
• 089727b5ee update readme Kohya S 2024-04-07 12:42:49 +09:00
• 921036dd91 Merge pull request #1240 from kohya-ss/verify-command-line-args Kohya S 2024-04-07 12:27:03 +09:00
• cd587ce62c verify command line args if wandb is enabled ykume 2024-04-05 08:23:03 +09:00
• 1933ab4b48 Fix default_lr being applied rockerBOO 2024-04-03 12:46:34 -04:00
• b748b48dbb fix attention couple+deep shink cause error in some reso Kohya S 2024-04-03 12:43:08 +09:00
• c7691607ea Add LoRA-FA for LoRA+ rockerBOO 2024-04-01 15:43:04 -04:00
• f99fe281cb Add LoRA+ support rockerBOO 2024-04-01 15:38:26 -04:00
• 80e9f72234 Bump crate-ci/typos from 1.17.2 to 1.19.0 dependabot[bot] 2024-04-01 01:50:22 +00:00
• 2258a1b753 add save/load hook to remove U-Net/TEs from state Kohya S 2024-03-31 15:50:35 +09:00
• 059ee047f3 fix typo Kohya S 2024-03-30 23:02:24 +09:00
• 2c2ca9d726 update tagger doc Kohya S 2024-03-30 22:55:56 +09:00
• f5323e3c4b update tagger doc Kohya S 2024-03-30 22:10:37 +09:00
• cae5aa0a56 update wd14 tagger and doc Kohya S 2024-03-30 21:48:22 +09:00
• 6ba84288d9 Merge pull request #1216 from Disty0/dev Kohya S 2024-03-30 18:50:49 +09:00
• 434dc408f9 update readme Kohya S 2024-03-30 17:12:36 +09:00
• ae3f625739 Merge branch 'dev' of https://github.com/kohya-ss/sd-scripts into dev Kohya S 2024-03-30 14:57:43 +09:00
• f1f30ab418 fix to work with num_beams>1 closes #1149 Kohya S 2024-03-30 14:57:39 +09:00
• bc586ce190 Add --use_rating_tags and --character_tags_first for WD Tagger Disty0 2024-03-29 13:56:42 +03:00
• 4012fd24f6 IPEX fix pin_memory Disty0 2024-03-28 21:08:16 +03:00
• 954731d564 fix typo Disty0 2024-03-27 22:00:59 +03:00
• dd9763be31 Rating support for WD Tagger Disty0 2024-03-27 21:53:40 +03:00
• b86af6798d Merge pull request #1213 from Disty0/dev Kohya S 2024-03-27 23:15:33 +09:00
• 6f7e93d5cc Add OpenVINO and ROCm ONNX Runtime for WD14 Disty0 2024-03-27 03:21:13 +03:00
• 6c08e97e1f update readme Kohya S 2024-03-26 20:48:08 +09:00
• 78e0a7630c Merge pull request #1206 from kohya-ss/dataset-cache Kohya S 2024-03-26 19:49:23 +09:00
• c86e356013 Merge branch 'dev' into dataset-cache Kohya S 2024-03-26 19:43:40 +09:00
• 5a2afb3588 Merge pull request #1207 from kohya-ss/masked-loss Kohya S 2024-03-26 19:41:31 +09:00
• ab1e389347 Merge branch 'dev' into masked-loss Kohya S 2024-03-26 19:39:30 +09:00
• ea05e3fd5b Merge pull request #1139 from kohya-ss/deep-speed Kohya S 2024-03-26 19:33:57 +09:00
• a2b8531627 make each script consistent, fix to work w/o DeepSpeed Kohya S 2024-03-25 22:28:46 +09:00
• c24422fb9d Merge branch 'dev' into deep-speed Kohya S 2024-03-25 22:11:05 +09:00
• 9c4492b58a fix pytorch version 2.1.1 to 2.1.2 Kohya S 2024-03-24 23:17:25 +09:00
• 9bbb28c361 update PyTorch version and reorganize dependencies Kohya S 2024-03-24 22:06:37 +09:00
• 1648ade6da format by black Kohya S 2024-03-24 20:55:48 +09:00
• 993b2ab4c1 Merge branch 'dev' into deep-speed Kohya S 2024-03-24 18:45:59 +09:00
• 8d5858826f Merge branch 'dev' into masked-loss Kohya S 2024-03-24 18:19:53 +09:00
• 025347214d refactor metadata caching for DreamBooth dataset Kohya S 2024-03-24 18:09:32 +09:00
• ae97c8bfd1 [Experimental] Add cache mechanism for dataset groups to avoid long waiting time for initilization (#1178) Kohaku-Blueleaf 2024-03-24 14:40:18 +08:00
• 381c44955e update readme and typing hint Kohya S 2024-03-24 11:27:18 +09:00
• ad97410ba5 Merge pull request #1205 from feffy380/patch-1 Kohya S 2024-03-24 11:14:07 +09:00
• 691f04322a update readme Kohya S 2024-03-24 11:10:26 +09:00
• 79d1c12ab0 disable sample_every_n_xxx if value less than 1 ref #1202 Kohya S 2024-03-24 11:06:37 +09:00
• 0c7baea88c register reg images with correct subset feffy380 2024-03-23 17:28:02 +01:00
• f4a4c11cd3 support multiline captions ref #1155 Kohya S 2024-03-23 18:51:37 +09:00
• 594c7f7050 format by black Kohya S 2024-03-23 16:11:31 +09:00
• d17c0f5084 update dataset config doc Kohya S 2024-03-21 08:31:29 +09:00
• a35e7bd595 Merge pull request #1200 from BootsofLagrangian/deep-speed Kohya S 2024-03-20 21:32:35 +09:00
• d9456020d7 Fix most of ZeRO stage uses optimizer partitioning - we have to prepare optimizer and ds_model at the same time. - pull/1139#issuecomment-1986790007 BootsofLagrangian 2024-03-20 20:52:59 +09:00
• 5095f29e7c fix hf upload #1196 fix-hf-upload Kohya S 2024-03-20 18:46:13 +09:00