diffusers
[WIP][Training] Flux Control LoRA training script
#10130
Merged
Overview
Commits
102
Changes
View On GitHub

[WIP][Training] Flux Control LoRA training script #10130

sayakpaul merged 102 commits into main from flux-control-lora-training-script
sayakpaul
a-r-r-o-w update
28296791
a-r-r-o-w Merge branch 'main' into flux-new
be67dbde
yiyixuxu add
f56ffb1d
a-r-r-o-w update
7e4df06b
a-r-r-o-w Merge remote-tracking branch 'origin/flux-fill-yiyi' into flux-new
9ea52da4
a-r-r-o-w add control-lora conversion script; make flux loader handle norms; fi…
217e90cb
a-r-r-o-w control lora updates
b4f1cbf2
a-r-r-o-w remove copied-from
414b30b3
a-r-r-o-w create separate pipelines for flux control
6b02ac20
a-r-r-o-w make fix-copies
3169bf5e
a-r-r-o-w update docs
f7f006db
a-r-r-o-w add tests
8bb940ed
a-r-r-o-w fix
9e615fdf
a-r-r-o-w Merge branch 'main' into flux-new
6d168dbd
a-r-r-o-w Apply suggestions from code review
89fd9707
a-r-r-o-w remove control lora changes
73cfc519
a-r-r-o-w apply suggestions from review
c94966f9
a-r-r-o-w Revert "remove control lora changes"
cfe13e79
a-r-r-o-w update
0c959a7e
a-r-r-o-w update
6ef2c8b8
a-r-r-o-w improve log messages
42970ee1
a-r-r-o-w Merge branch 'main' into flux-control-lora
2ec93ba8
sayakpaul Merge branch 'main' into flux-control-lora
993f3d3a
sayakpaul updates.
6523fa65
sayakpaul updates
81ab40b0
sayakpaul Merge branch 'main' into flux-control-lora
4432e730
sayakpaul Merge branch 'main' into flux-control-lora
0f747c05
sayakpaul Merge branch 'flux-control-lora' into sayak-flux-control-lora
6d0c6dcc
sayakpaul support register_config.
16336193
sayakpaul fix
b9039b18
sayakpaul fix
5f94d746
sayakpaul fix
bd31651a
a-r-r-o-w Merge branch 'main' into flux-control-lora
e18b7add
sayakpaul updates
f54ec56f
sayakpaul updates
80324051
sayakpaul updates
6b70bf77
sayakpaul fix-copies
3726e2d0
sayakpaul Merge branch 'main' into flux-control-lora
b6ca9d91
sayakpaul fix
908d151d
sayakpaul Merge branch 'main' into flux-control-lora
6af20971
a-r-r-o-w apply suggestions from review
07d44e7a
a-r-r-o-w add tests
b66e6910
a-r-r-o-w remove conversion script; enable on-the-fly conversion
66d74660
a-r-r-o-w Merge branch 'main' into flux-control-lora
d827d1ef
sayakpaul bias -> lora_bias.
64c821b8
sayakpaul fix-copies
30a89a6a
sayakpaul peft.py
bca1eaa0
sayakpaul Merge branch 'main' into flux-control-lora
6ce181be
a-r-r-o-w fix lora conversion
e7df1978
sayakpaul changes
5fd9fda9
sayakpaul fix-copies
a8c50ba7
sayakpaul updates for tests
b12f797b
sayakpaul fix
f9bd3eb6
sayakpaul Merge branch 'main' into flux-control-lora
6b35c92b
sayakpaul alpha_pattern.
84c168c2
sayakpaul Merge branch 'main' into flux-control-lora
118ed9bb
sayakpaul add a test for varied lora ranks and alphas.
be1d788b
sayakpaul revert changes in num_channels_latents = self.transformer.config.in_c…
5b1bcd89
sayakpaul revert moe
cde01e38
sayakpaul Merge branch 'main' into flux-control-lora
79af91d1
sayakpaul Merge branch 'main' into flux-control-lora
4b3efccc
sayakpaul add a sanity check on unexpected keys when loading norm layers.
f688ecf9
sayakpaul contro lora.
eac6fd14
sayakpaul fixes
a6158d7e
sayakpaul sayakpaul added training
HuggingFaceDocBuilderDev
sayakpaul fixes
90708fac
sayakpaul Merge branch 'flux-control-lora' into flux-control-lora-training-script
8765e1b8
sayakpaul Merge branch 'main' into flux-control-lora
d6518b70
sayakpaul Merge branch 'main' into flux-control-lora-training-script
9a83eff9
sayakpaul fixes
ecbc4cb0
sayakpaul tests
55058e2e
sayakpaul reviewer feedback
a8bd03b4
sayakpaul fix
49c02420
sayakpaul proper peft version for lora_bias
8b050eab
sayakpaul fix-copies
3204627a
sayakpaul Merge branch 'flux-control-lora' into flux-control-lora-training-script
6ce2307d
sayakpaul updates
1330d17f
sayakpaul updates
9007de0b
sayakpaul Merge branch 'main' into flux-control-lora-training-script
67bc7e49
sayakpaul updates
7521fec6
a-r-r-o-w Merge branch 'main' into flux-control-lora
2b9bfa35
a-r-r-o-w remove debug code
130e592e
a-r-r-o-w update docs
b20ec7d9
sayakpaul Merge branch 'main' into flux-control-lora
79d023ae
sayakpaul integration tests
d1715d3c
sayakpaul Merge branch 'flux-control-lora' into flux-control-lora-training-script
eb862de6
sayakpaul nis
cbad4b3c
sayakpaul fuse and unload.
cd7c1554
sayakpaul fix
25616e2e
sayakpaul add slices.
0b83debe
sayakpaul Merge branch 'flux-control-lora' into flux-control-lora-training-script
4d10b338
sayakpaul more updates.
b06376f9
sayakpaul button up readme
7d63a2a7
sayakpaul train()
9d90c513
sayakpaul add full fine-tuning version.
f46330bf
sayakpaul fixes
f188e807
yiyixuxu yiyixuxu requested a review from a-r-r-o-w a-r-r-o-w 1 year ago
sayakpaul Merge branch 'main' into flux-control-lora-training-script
6c1a60f7
a-r-r-o-w
sayakpaul
sayakpaul sayakpaul marked this pull request as ready for review 1 year ago
sayakpaul
sayakpaul Merge branch 'main' into flux-control-lora-training-script
2610e6a7
a-r-r-o-w
a-r-r-o-w approved these changes on 2024-12-11
sayakpaul Merge branch 'main' into flux-control-lora-training-script
ecc16ed5
sayakpaul
sayakpaul commented on 2024-12-12
sayakpaul Apply suggestions from code review
7dfe3781
sayakpaul set_grads_to_none remove.
f1d9550c
sayakpaul readme
02016caf
sayakpaul
a-r-r-o-w
a-r-r-o-w approved these changes on 2024-12-12
sayakpaul Merge branch 'main' into flux-control-lora-training-script
64814c99
sayakpaul
sayakpaul sayakpaul merged 8170dc36 into main 1 year ago
sayakpaul sayakpaul deleted the flux-control-lora-training-script branch 1 year ago
Adenialzz
sayakpaul
Adenialzz

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
training
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum