diffusers
[Flux] Add advanced training script + support textual inversion inference
#9434
Merged
Merged
[Flux] Add advanced training script + support textual inversion inference #9434
linoytsaban
merged
129 commits into
huggingface:main
from
linoytsaban:dreambooth-lora-flux-exploration
add ostris trainer to README & add cache latents of vae
90686c2e
add ostris trainer to README & add cache latents of vae
7b12ed2c
style
17dca18c
Merge branch 'main' into dreambooth-lora
de24a4f8
readme
8b314e9a
Merge branch 'main' into dreambooth-lora
a59b063a
add test for latent caching
df54cd8d
add ostris noise scheduler
e0e03199
style
18aa3697
fix import
f97d53d0
style
0156becd
fix tests
c4c2c48d
style
d514c7ba
Merge branch 'main' into dreambooth-lora
7ee60411
--change upcasting of transformer?
d5c2a36a
Merge branch 'main' into dreambooth-lora
e760cda8
Merge branch 'main' into dreambooth-lora
f78ba777
Merge branch 'main' into dreambooth-lora
1b195933
update readme according to main
fbacbb56
Merge branch 'main' into dreambooth-lora
23f0636d
add pivotal tuning for CLIP
44c534ef
fix imports, encode_prompt call,add TextualInversionLoaderMixin to Fl…
087b9825
TextualInversionLoaderMixin support for FluxPipeline for inference
d9c3e45a
Merge branch 'huggingface:main' into dreambooth-lora-flux-exploration
5f9b74f7
Merge branch 'huggingface:main' into dreambooth-lora-flux-exploration
f14617b3
move changes to advanced flux script, revert canonical
b4328f86
Merge remote-tracking branch 'origin/dreambooth-lora-flux-exploration…
6254d04c
add latent caching to canonical script
7b7a6718
revert changes to canonical script to keep it separate from https://g…
2bb4ce1b
revert changes to canonical script to keep it separate from https://g…
dc9be5b9
Merge branch 'main' into dreambooth-lora-flux-exploration
70982953
style
a25cb907
remove redundant line and change code block placement to align with l…
fd75b678
add initializer_token arg
238ed704
add transformer frac for range support from pure textual inversion to…
4bf3a138
support pure textual inversion - wip
62b8ab8a
adjustments to support pure textual inversion and transformer optimiz…
30cc6517
fix logic when using initializer token
35ac0f73
fix pure_textual_inversion_condition
7e914891
fix ti/pivotal loading of last validation run
8775bea3
Merge branch 'main' into dreambooth-lora-flux-exploration
1cfcfc11
remove embeddings loading for ti in final training run (to avoid addi…
00bbb58e
support pivotal for t5
67e1bf78
adapt pivotal for T5 encoder
e00b30fd
Merge branch 'main' into dreambooth-lora-flux-exploration
dd327f34
adapt pivotal for T5 encoder and support in flux pipeline
f4d6e9af
Merge remote-tracking branch 'origin/dreambooth-lora-flux-exploration…
6f5460bb
t5 pivotal support + support fo pivotal for clip only or both
a01e566d
Merge branch 'main' into dreambooth-lora-flux-exploration
887cc9d5
fix param chaining
f74c4be6
fix param chaining
c597bd86
Merge branch 'main' into dreambooth-lora-flux-exploration
250025f6
README first draft
81fe4079
readme
c086a14c
readme
549d3d05
Merge branch 'main' into dreambooth-lora-flux-exploration
f356a431
linoytsaban
changed the title
readme
983bab84
Merge remote-tracking branch 'origin/dreambooth-lora-flux-exploration…
e253478c
Merge branch 'main' into dreambooth-lora-flux-exploration
c9694194
Merge remote-tracking branch 'origin/dreambooth-lora-flux-exploration…
d42379da
style
aefa48ab
Merge remote-tracking branch 'origin/dreambooth-lora-flux-exploration…
d966f050
fix import
ae10674d
style
dcd0e71a
add fix from https://github.com/huggingface/diffusers/pull/9419
99b75217
Merge remote-tracking branch 'origin/dreambooth-lora-flux-exploration…
46943abb
add to readme, change function names
57fb65b2
apolinario
commented
on 2024-09-30
apolinario
commented
on 2024-09-30
Merge branch 'main' into dreambooth-lora-flux-exploration
4faa6cf6
te lr changes
571e49c4
readme
94dbe85b
change concept tokens logic
5e751d49
fix indices
d9ed2b18
Merge branch 'main' into dreambooth-lora-flux-exploration
9e5c04f8
change arg name
b686d041
style
3881dbb8
dummy test
b3e5caad
Merge remote-tracking branch 'origin/dreambooth-lora-flux-exploration…
7db17988
revert dummy test
ca668b66
reorder pivoting
7fcdc0d7
Merge branch 'main' into dreambooth-lora-flux-exploration
8247860a
Merge branch 'main' into dreambooth-lora-flux-exploration
83bcec06
add warning in case the token abstraction is not the instance prompt
8cb79713
experimental - wip - specific block training
b75b3e61
Merge branch 'main' into dreambooth-lora-flux-exploration
9a83f272
Merge branch 'main' into dreambooth-lora-flux-exploration
f110e4ef
Merge remote-tracking branch 'origin/dreambooth-lora-flux-exploration…
cc6f7a03
fix documentation and token abstraction processing
03a6b5b5
remove transformer block specification feature (for now)
749e8573
Merge branch 'main' into dreambooth-lora-flux-exploration
de3e2a55
Merge branch 'main' into dreambooth-lora-flux-exploration
b791e13d
style
c8ddd83c
Merge branch 'main' into dreambooth-lora-flux-exploration
defac210
fix copies
43c2cd55
fix indexing issue when --initializer_concept has different amounts
2ac68983
add if TextualInversionLoaderMixin to all flux pipelines
d2cd0bf7
style
f1879bf8
fix import
20762bc4
Merge remote-tracking branch 'origin/dreambooth-lora-flux-exploration…
7399abd4
Merge branch 'main' into dreambooth-lora-flux-exploration
7366127b
fix imports
0e6d31e5
Merge remote-tracking branch 'origin/dreambooth-lora-flux-exploration…
cd327927
address review comments - remove necessary prints & comments, use pin…
08aafc07
style
c5b24229
logger info fix
4b117194
Merge remote-tracking branch 'origin/dreambooth-lora-flux-exploration…
9373c0a4
make lora target modules configurable and change the default
6e2cb756
make lora target modules configurable and change the default
717b5ade
style
0fde49a3
Merge branch 'main' into dreambooth-lora-flux-exploration
fbbe9c4d
Merge branch 'main' into dreambooth-lora-flux-exploration
366a35e1
make lora target modules configurable and change the default, add not…
e4fe609e
style
3d0955bc
Merge branch 'main' into dreambooth-lora-flux-exploration
452cef40
Merge branch 'main' into dreambooth-lora-flux-exploration
f62af612
sayakpaul
approved these changes
on 2024-10-15
Merge branch 'main' into dreambooth-lora-flux-exploration
a4429e05
Merge branch 'main' into dreambooth-lora-flux-exploration
c41dfff2
add tests
cb265adb
style
61426f0c
fix repo id
03f19f67
yiyixuxu
approved these changes
on 2024-10-16
Merge branch 'main' into dreambooth-lora-flux-exploration
b1b21286
Merge branch 'main' into dreambooth-lora-flux-exploration
bfb07418
add updated requirements for advanced flux
bd2be329
fix indices of t5 pivotal tuning embeddings
69d28b52
Merge branch 'main' into dreambooth-lora-flux-exploration
450f0721
fix path in test
31de7526
remove `pin_memory`
5dfd685c
Merge branch 'main' into dreambooth-lora-flux-exploration
9bdb6a1d
fix filename of embedding
9093a4bb
fix filename of embedding
f1b08cb0
apolinario
approved these changes
on 2024-10-17
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub