Commit Graph

Select branches

Hide Pull Requests

copilot/fix-2142

dependabot/github_actions/crate-ci/typos-1.28.1

dev

dual_reso_unet_hires_fix

feat-extract-flux-lora-from-weights-with-key-prefix

feat-flux-chroma-fp8-scaled

feat-safetensors-cache

feature-chroma

fix-chroma-training-withtout-te-cache

fix-hf-upload

flexible-zero-slicing

flux-huber-loss

free-u

galore

main

multi_embeds

new_cache

no-grad-block-swap

nw_application_weights

resume-step-and-epoch

scheduler-free-opt

sd3

stable-cascade

vae_batch_size_sdxl_train

wuerstchen

#1

#1000

#1003

#1007

#1008

#1009

#1011

#1011

#1012

#1013

#1016

#102

#1020

#1024

#1029

#103

#1030

#1032

#104

#1042

#1044

#1052

#1053

#1054

#1055

#1055

#1056

#1057

#106

#1060

#1061

#1064

#1067

#1068

#1068

#107

#1079

#1084

#1085

#1086

#1087

#1092

#1094

#1096

#1096

#11

#110

#1100

#1101

#1102

#1103

#1103

#1104

#1106

#1113

#1114

#1116

#1117

#1126

#113

#1130

#1136

#1137

#1139

#114

#1142

#1145

#1145

#1146

#1148

#1151

#1151

#1155

#1155

#1162

#1165

#1167

#1168

#1170

#1174

#1175

#1177

#1178

#1181

#1181

#1187

#1189

#1192

#120

#1200

#1202

#1204

#1205

#1206

#1207

#121

#1212

#1213

#1216

#1223

#1228

#1230

#1231

#1231

#1233

#1240

#1246

#1246

#1250

#1259

#1266

#1267

#1267

#1270

#1277

#1278

#1279

#1279

#128

#1284

#1285

#129

#1291

#13

#1303

#1303

#1307

#1312

#1313

#1315

#1319

#1322

#1327

#1331

#1338

#1338

#1339

#1340

#1340

#1341

#1341

#1347

#1349

#1353

#1359

#1360

#1361

#1363

#1371

#1372

#1372

#1374

#1376

#1376

#1378

#1378

#1381

#1381

#1383

#1383

#1387

#1391

#1391

#1393

#1394

#1395

#1395

#1396

#1396

#1397

#1397

#140

#1405

#1406

#1406

#1409

#1413

#1417

#1426

#1427

#1427

#1429

#1433

#144

#1452

#1461

#1468

#1468

#1469

#147

#148

#1482

#1500

#1501

#1501

#1505

#1508

#152

#1525

#1529

#153

#1532

#154

#1540

#1541

#1550

#1564

#1564

#157

#1573

#1573

#1575

#1576

#158

#1580

#159

#1592

#16

#1600

#1605

#1606

#1606

#1615

#1619

#1620

#1628

#1632

#1637

#1637

#1640

#1646

#1648

#165

#1655

#166

#1660

#1661

#1664

#1664

#1668

#1671

#1677

#1677

#168

#1686

#1690

#171

#1710

#1713

#1713

#1714

#1715

#1717

#1719

#173

#173

#174

#1741

#1741

#1747

#176

#1768

#1769

#177

#1770

#1774

#1779

#178

#1784

#1784

#179

#1799

#1808

#1811

#1812

#1813

#1814

#1814

#1815

#1817

#1821

#1828

#1830

#1838

#1838

#184

#1850

#1850

#1856

#1858

#1864

#1865

#1865

#1866

#1867

#1867

#187

#1870

#1870

#1873

#1873

#1879

#1883

#1883

#189

#1893

#1893

#1894

#1894

#1895

#1895

#1898

#1899

#190

#1900

#1900

#1901

#1901

#1903

#1904

#1904

#1906

#1906

#1908

#1908

#1909

#1910

#1910

#1913

#1918

#1927

#1935

#1936

#1938

#1940

#1943

#1945

#1950

#1950

#1951

#1951

#1953

#1955

#196

#1960

#1961

#1964

#1966

#1971

#1974

#198

#1985

#1988

#1988

#1991

#1991

#1992

#2

#200

#2000

#2000

#2001

#2001

#2002

#2002

#2003

#2007

#2007

#2008

#2010

#2010

#2015

#2018

#2019

#2019

#202

#2022

#2026

#2028

#2032

#2032

#2035

#2036

#2037

#2037

#2042

#2045

#2045

#2046

#2046

#2047

#2047

#2053

#2056

#2056

#2057

#2059

#2060

#2061

#2061

#2064

#2065

#2066

#207

#2070

#2072

#2073

#2074

#208

#2080

#2080

#2086

#2088

#209

#2096

#2096

#2097

#2097

#2098

#2105

#2106

#2107

#2108

#2109

#2109

#2115

#212

#2121

#2129

#2129

#2136

#2136

#2138

#2141

#2141

#2143

#2146

#2147

#2148

#2153

#2157

#2158

#2159

#2159

#2160

#2165

#2167

#2168

#2172

#2172

#2174

#2175

#2178

#2180

#2180

#2184

#2185

#2186

#2187

#2187

#2188

#2188

#219

#2190

#2191

#2192

#2193

#2194

#2196

#2198

#2199

#22

#2200

#2203

#2203

#2207

#2208

#2208

#221

#2210

#2210

#2212

#2213

#2215

#2216

#2217

#2217

#222

#2221

#2221

#2222

#2222

#2223

#2223

#2224

#2225

#2226

#223

#2231

#2231

#2232

#2238

#2238

#2240

#2246

#2251

#2252

#2253

#2254

#2255

#2260

#2261

#2262

#2263

#2264

#2267

#2268

#2269

#227

#2270

#2272

#2273

#2274

#2275

#2276

#2277

#2280

#2281

#2283

#2284

#2285

#2288

#2289

#2290

#2290

#2291

#2294

#2296

#2297

#2298

#2299

#2300

#2301

#2302

#2303

#2304

#2305

#2307

#2309

#2309

#2310

#2311

#2312

#233

#233

#236

#240

#241

#243

#246

#247

#25

#255

#261

#264

#267

#269

#271

#272

#276

#278

#283

#288

#29

#290

#292

#3

#305

#306

#308

#31

#310

#322

#327

#328

#332

#333

#336

#339

#348

#349

#350

#352

#353

#355

#357

#360

#364

#373

#374

#381

#387

#388

#392

#400

#408

#413

#416

#42

#423

#424

#427

#428

#429

#43

#431

#433

#434

#435

#436

#437

#444

#445

#447

#448

#453

#454

#455

#457

#458

#459

#463

#465

#465

#467

#468

#468

#471

#472

#472

#475

#477

#478

#480

#483

#484

#489

#49

#491

#493

#495

#5

#501

#504

#507

#509

#51

#510

#514

#515

#52

#521

#527

#528

#530

#533

#534

#534

#537

#538

#54

#541

#542

#545

#55

#551

#553

#554

#559

#560

#562

#569

#57

#580

#581

#585

#589

#590

#594

#6

#604

#604

#605

#609

#610

#615

#618

#62

#621

#621

#623

#626

#628

#630

#631

#639

#639

#641

#644

#645

#658

#663

#666

#666

#67

#672

#676

#687

#687

#688

#69

#692

#693

#694

#7

#70

#71

#714

#716

#717

#72

#720

#722

#733

#736

#736

#74

#741

#744

#75

#750

#755

#760

#768

#77

#770

#774

#776

#783

#786

#787

#79

#791

#792

#792

#793

#798

#799

#8

#800

#802

#803

#804

#808

#815

#823

#825

#83

#830

#831

#832

#832

#839

#84

#841

#844

#846

#847

#848

#850

#851

#853

#853

#856

#858

#859

#864

#865

#867

#872

#878

#889

#893

#895

#898

#899

#90

#90

#900

#902

#905

#906

#907

#909

#913

#914

#919

#92

#927

#933

#933

#934

#936

#947

#949

#95

#955

#956

#956

#959

#959

#96

#961

#963

#963

#964

#964

#967

#967

#97

#970

#970

#975

#977

#978

#985

#986

#987

#987

#989

#991

#991

#993

#993

#996

#998

v0.1.0

v0.10.0

v0.10.1

v0.10.2

v0.2.0

v0.3.0

v0.3.1

v0.3.2

v0.4.0

v0.4.1

v0.4.2

v0.4.3

v0.4.4

v0.4.5

v0.5.1

v0.5.2

v0.5.3

v0.5.4

v0.6.0

v0.6.1

v0.6.2

v0.6.3

v0.6.4

v0.6.5

v0.6.6

v0.7.0

v0.7.1

v0.8.0

v0.8.1

v0.8.2

v0.8.3

v0.8.4

v0.8.5

v0.8.6

v0.8.7

v0.8.8

v0.9.0

v0.9.1

Mono Color

• c8af252a44 refactor Robert 2025-04-22 16:19:14 +08:00
• 7f984f4775 # saibit 2025-04-22 16:15:12 +08:00
• d33d5eccd1 # saibit 2025-04-22 16:12:06 +08:00
• 7c61c0dfe0 Add autocast warpper for forward functions in deepspeed_utils.py to try aligning precision when using mixed precision in training process saibit 2025-04-22 16:06:55 +08:00
• 26db64be17 fix: update hf_hub_download parameters to fix wd14 tagger regression Glen 2025-04-19 11:54:12 -06:00
• 629073cd9d Add guidance scale for prompt param and flux sampling Kohya S 2025-04-16 21:50:36 +09:00
• 06df0377f9 Merge branch 'sd3' into flux-sample-cfg Kohya S 2025-04-16 21:27:08 +09:00
• 176baa6b95 doc: update sd3 and sdxl training guides Kohya S 2025-04-16 12:32:43 +09:00
• b1bbd4576c doc: update sd3 LoRA, sdxl LoRA advanced Kohya S 2025-04-14 21:53:21 +09:00
• ceb19bebf8 update docs. sdxl is transltaed, flux.1 is corrected Kohya S 2025-04-13 22:06:58 +09:00
• 8f5a2eba3d Add documentation for LoRA training scripts for SD1/2, SDXL, FLUX.1 and SD3/3.5 models Kohya S 2025-04-11 08:07:24 +09:00
• dbd835ee4b train: Optimize VAE encoding by handling batch sizes for images vae_batch_size_sdxl_train kohya-ss 2025-04-08 21:57:16 +09:00
• 5a18a03ffc Merge branch 'dev' into sd3 Kohya S 2025-04-07 21:55:17 +09:00
• 572cc3efb8 Merge branch 'main' into dev Kohya S 2025-04-07 21:48:45 +09:00
• 52c8dec953 Merge pull request #2015 from DKnight54/uncache_vae_batch Kohya S. 2025-04-07 21:48:02 +09:00
• 4589262f8f README.md: Update recent updates section to include IP noise gamma feature for FLUX.1 Kohya S 2025-04-06 21:34:27 +09:00
• c56dc90b26 Merge pull request #1992 from rockerBOO/flux-ip-noise-gamma Kohya S. 2025-04-06 21:29:26 +09:00
• 7f93e21f30 fix typo sdbds 2025-04-06 16:21:48 +08:00
• 9f1892cc8e Merge branch 'sd3' into lumina 青龍聖者@bdsqlsz 2025-04-06 16:13:43 +08:00
• 1a4f1ff0f1 Merge branch 'lumina' of https://github.com/sdbds/sd-scripts into lumina sdbds 2025-04-06 16:09:37 +08:00
• 00e12eed65 update for lost change sdbds 2025-04-06 16:09:29 +08:00
• ee0f754b08 Merge pull request #2028 from rockerBOO/patch-5 Kohya S. 2025-04-05 20:15:13 +09:00
• 606e6875d2 Merge pull request #2022 from LexSong/fix-resize-issue Kohya S. 2025-04-05 19:28:25 +09:00
• fd36fd1aa9 Fix resize PR link Dave Lage 2025-04-03 16:09:45 -04:00
• 92845e8806 Merge pull request #2026 from kohya-ss/fix-finetune-dataset-resize-interpolation Kohya S. 2025-04-03 21:52:14 +09:00
• f1423a7229 fix: add resize_interpolation parameter to FineTuningDataset constructor Kohya S 2025-04-03 21:48:51 +09:00
• b822b7e60b Fix the interpolation logic error in resize_image() Lex Song 2025-04-02 03:32:36 +08:00
• ede3470260 Ensure all size parameters are integers to prevent type errors Lex Song 2025-04-02 03:28:58 +08:00
• b3c56b22bd Merge branch 'dev' into sd3 Kohya S 2025-03-31 22:05:40 +09:00
• 583ab27b3c doc: update license information in jpeg_xl_util.py Kohya S 2025-03-31 22:02:25 +09:00
• aa5978dffd Merge pull request #1955 from Disty0/dev Kohya S. 2025-03-31 22:00:31 +09:00
• aaa26bb882 docs: update README to include LoRA-GGPO details for FLUX.1 training Kohya S 2025-03-30 21:18:05 +09:00
• d0b5c0e5cf chore: formatting, add TODO comment Kohya S 2025-03-30 21:15:37 +09:00
• 59d98e45a9 Merge pull request #1974 from rockerBOO/lora-ggpo Kohya S. 2025-03-30 21:07:31 +09:00
• 3149b2771f Merge pull request #2018 from kohya-ss/resize-interpolation-small-fix Kohya S. 2025-03-30 20:52:25 +09:00
• 96a133c998 README.md: update recent updates section to include new interpolation method for resizing images Kohya S 2025-03-30 20:45:06 +09:00
• 1f432e2c0e use PIL for lanczos and box Kohya S 2025-03-30 20:40:29 +09:00
• 9e9a13aa8a Merge pull request #1936 from rockerBOO/resize-interpolation Kohya S. 2025-03-30 20:37:34 +09:00
• 93a4efabb5 Merge branch 'sd3' into resize-interpolation Kohya S. 2025-03-30 19:30:56 +09:00
• 381303d64f Update train_network.py DKnight54 2025-03-29 02:26:18 +08:00
• 0181b7a042 Remove progress bar avg norms rockerBOO 2025-03-27 03:28:33 -04:00
• 182544dcce Remove pertubation seed rockerBOO 2025-03-26 14:23:04 -04:00
• e64dc05c2a Supplement the input parameters to correctly convert the flux model to BFL format; fixes #1996 laolongboy 2025-03-24 23:33:25 +08:00
• 8ebe858f89 Merge branch 'dev' into sd3 Kohya S 2025-03-24 22:02:16 +09:00
• a0f11730f7 Merge pull request #1966 from sdbds/faster_fix_sdxl Kohya S. 2025-03-24 21:53:42 +09:00
• 30008168e3 Merge pull request #24 from rockerBOO/lumina-fix-max-norms 青龍聖者@bdsqlsz 2025-03-22 14:59:10 +08:00
• 1481217eb2 Merge pull request #25 from rockerBOO/lumina-fix-non-cache-image-vae-encode 青龍聖者@bdsqlsz 2025-03-22 14:58:52 +08:00
• 61f7283167 Fix non-cache vae encode rockerBOO 2025-03-21 20:38:43 -04:00
• 2ba1cc7791 Fix max norms not applying to noise rockerBOO 2025-03-21 20:17:22 -04:00
• 6364379f17 Merge branch 'dev' into sd3 Kohya S 2025-03-21 22:07:50 +09:00
• 5253a38783 Merge branch 'main' into dev Kohya S 2025-03-21 22:07:03 +09:00
• 8f4ee8fc34 doc: update README for latest v0.9.1 Kohya S 2025-03-21 22:05:48 +09:00
• 367f348430 Merge pull request #1964 from Nekotekina/main Kohya S. 2025-03-21 21:59:03 +09:00
• 89f0d27a59 Set sigmoid_scale to default 1.0 rockerBOO 2025-03-20 15:10:33 -04:00
• d40f5b1e4e Revert "Scale sigmoid to default 1.0" rockerBOO 2025-03-20 15:09:50 -04:00
• 8aa126582e Scale sigmoid to default 1.0 rockerBOO 2025-03-20 15:09:11 -04:00
• e8b3254858 Add flux_train_utils tests for get get_noisy_model_input_and_timesteps rockerBOO 2025-03-20 15:01:15 -04:00
• 16cef81aea Refactor sigmas and timesteps rockerBOO 2025-03-20 14:32:56 -04:00
• d151833526 docs: update README with recent changes and specify version for pytorch-optimizer Kohya S 2025-03-20 22:05:29 +09:00
• 936d333ff4 Merge pull request #1985 from gesen2egee/pytorch-optimizer Kohya S. 2025-03-20 22:01:03 +09:00
• f974c6b257 change order to match upstream rockerBOO 2025-03-19 14:27:43 -04:00
• 5d5a7d2acf Fix IP noise calculation rockerBOO 2025-03-19 13:50:04 -04:00
• 1eddac26b0 Separate random to a variable, and make sure on device rockerBOO 2025-03-19 00:49:42 -04:00
• 8e6817b0c2 Remove double noise rockerBOO 2025-03-19 00:45:13 -04:00
• d93ad90a71 Add perturbation on noisy_model_input if needed rockerBOO 2025-03-19 00:37:27 -04:00
• 7197266703 Perturbed noise should be separate of input noise rockerBOO 2025-03-19 00:25:51 -04:00
• 5b210ad717 update prodigyopt and prodigy-plus-schedule-free gesen2egee 2025-03-19 10:49:06 +08:00
• b81bcd0b01 Move IP noise gamma to noise creation to remove complexity and align noise for target loss rockerBOO 2025-03-18 21:36:55 -04:00
• 6f4d365775 zeros_like because we are adding rockerBOO 2025-03-18 18:53:34 -04:00
• a4f3a9fc1a Use ones_like rockerBOO 2025-03-18 18:44:21 -04:00
• b425466e7b Fix IP noise gamma to use random values rockerBOO 2025-03-18 18:42:35 -04:00
• c8be141ae0 Apply IP gamma to noise fix rockerBOO 2025-03-18 15:42:18 -04:00
• 0b25a05e3c Add IP noise gamma for Flux rockerBOO 2025-03-18 15:40:40 -04:00
• 3647d065b5 Cache weight norms estimate on initialization. Move to update norms every step rockerBOO 2025-03-18 14:25:09 -04:00
• 620a06f517 Check for uppercase file extension too Disty0 2025-03-17 17:44:29 +03:00
• 564ec5fb7f use extend instead of += Disty0 2025-03-17 17:41:03 +03:00
• 7e90cdd47a use bytearray and add typing hints Disty0 2025-03-17 17:26:08 +03:00
• c898e4e536 fix: optimize weight device swapping with no_grad context kohya-ss 2025-03-17 21:28:02 +09:00
• e5b5c7e1db Update requirements.txt gesen2egee 2025-03-15 13:29:32 +08:00
• 7482784f74 Merge pull request #23 from rockerBOO/lumina-lora 青龍聖者@bdsqlsz 2025-03-09 21:04:45 +08:00
• ea53290f62 Add LoRA-GGPO for Flux rockerBOO 2025-03-06 00:00:38 -05:00
• 75933d70a1 Merge pull request #1960 from kohya-ss/sd3_safetensors_merge Kohya S. 2025-03-05 23:28:38 +09:00
• aa2bde7ece docs: add utility script for merging SD3 weights into a single .safetensors file Kohya S 2025-03-05 23:24:52 +09:00
• e8c15c7167 Remove log rockerBOO 2025-03-04 02:30:08 -05:00
• 9fe8a47080 Undo dropout after up rockerBOO 2025-03-04 02:28:56 -05:00
• 1f22a94cfe Update embedder_dims, add more flexible caption extension rockerBOO 2025-03-04 02:21:05 -05:00
• 5e45df722d update gemma2 train attention layer sdbds 2025-03-04 08:07:33 +08:00
• 09c4710d1e Merge pull request #22 from rockerBOO/sage_attn 青龍聖者@bdsqlsz 2025-03-03 10:26:02 +08:00
• 3f49053c90 fatser fix bug for SDXL super SD1.5 assert cant use 32 sdbds 2025-03-02 19:32:06 +08:00
• dfe1ab6c50 Merge pull request #21 from rockerBOO/lumina-torch-dynamo-gemma2 青龍聖者@bdsqlsz 2025-03-02 18:31:13 +08:00
• b6e4194ea5 Merge pull request #20 from rockerBOO/lumina-system-prompt-special-token 青龍聖者@bdsqlsz 2025-03-02 18:30:49 +08:00
• b5d1f1caea Merge pull request #19 from rockerBOO/lumina-block-swap 青龍聖者@bdsqlsz 2025-03-02 18:30:37 +08:00
• d6c3e6346e Merge pull request #18 from rockerBOO/fix-sample-batch-norms 青龍聖者@bdsqlsz 2025-03-02 18:30:24 +08:00
• 800d068e37 Merge pull request #17 from rockerBOO/lumina-cache-text-encoder-outputs 青龍聖者@bdsqlsz 2025-03-02 18:30:08 +08:00
• 3817b65b45 Merge pull request #16 from rockerBOO/lumina 青龍聖者@bdsqlsz 2025-03-02 18:29:44 +08:00
• a69884a209 Add Sage Attention for Lumina rockerBOO 2025-03-01 20:37:45 -05:00
• acdca2abb7 Fix [occasionally] missing text encoder attn modules Ivan Chikish 2025-03-01 17:06:17 +03:00
• ba5251168a fix: save tensors as is dtype, add save_precision option Kohya S 2025-03-01 10:31:39 +09:00
• cad182d29a fix torch compile/dynamo for Gemma2 rockerBOO 2025-02-28 18:30:16 -05:00
• a2daa87007 Add block swap for uncond (neg) for sample images rockerBOO 2025-02-28 14:22:39 -05:00