[LoRA] add LoRA support to HiDream and fine-tuning script #11281
linoytsaban
merged
102 commits into
huggingface:main
from
linoytsaban:hi-dream
initial commit
b8b6465e
initial commit
d728168a
initial commit
0fa09932
initial commit
5ecf0ed8
initial commit
911c30e9
initial commit
b7fffee0
Merge branch 'main' into hi-dream
fde5eeb5
sayakpaul
commented
on 2025-04-10
sayakpaul
commented
on 2025-04-10
sayakpaul
commented
on 2025-04-10
sayakpaul
commented
on 2025-04-10
sayakpaul
commented
on 2025-04-10
bghira
commented
on 2025-04-12
Update examples/dreambooth/train_dreambooth_lora_hidream.py
02de3ce0
Merge branch 'main' into hi-dream
4e08343a
move prompt embeds, pooled embeds outside
5257b468
Update examples/dreambooth/train_dreambooth_lora_hidream.py
e9b4ad20
Update examples/dreambooth/train_dreambooth_lora_hidream.py
677bab17
Merge branch 'main' into hi-dream
dafc5fe3
Merge remote-tracking branch 'origin/hi-dream' into hi-dream
139568ae
fix import
31aa0a2d
fix import and tokenizer 4, text encoder 4 loading
de1654a9
te
33385c99
prompt embeds
d993e161
fix naming
c296b6fe
shapes
aa6b6e28
initial commit to add HiDreamImageLoraLoaderMixin
ecc1c18e
fix init
c439c89f
Merge branch 'huggingface:main' into hi-dream
fc97a545
add tests
22e9ae80
Merge remote-tracking branch 'origin/hi-dream' into hi-dream
8e2e1f11
loader
3653dcc6
Merge branch 'main' into hi-dream
32567bb2
Merge branch 'main' into hi-dream
26f289d1
fix model input
fcf6eaa9
add code example to readme
0fdc7dd4
Merge remote-tracking branch 'origin/hi-dream' into hi-dream
759d204f
fix default max length of text encoders
62f2f156
prints
3cb1a4ce
nullify training cond in unpatchify for temp fix to incompatible shap…
82bcd443
Merge branch 'main' into hi-dream
e956980d
Merge branch 'main' into hi-dream
764bce67
smol fix
75aa8bdc
unpatchify
47e861fc
unpatchify
a461d385
Merge branch 'main' into hi-dream
2a1336cc
Merge remote-tracking branch 'origin/hi-dream' into hi-dream
1b20d159
fix validation
b31b5956
Merge branch 'main' into hi-dream
640beadd
flip pred and loss
466c9c03
Merge remote-tracking branch 'origin/hi-dream' into hi-dream
04be03a2
Merge branch 'main' into hi-dream
baa97845
Merge branch 'main' into hi-dream
efb22e27
sayakpaul
commented
on 2025-04-17
fix shift!!!
6043d9d1
Merge remote-tracking branch 'origin/hi-dream' into hi-dream
0a2adfda
Merge branch 'main' into hi-dream
92306d97
revert unpatchify changes (for now)
13e6f0da
Merge branch 'main' into hi-dream
c3a4047c
smol fix
ae39434d
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?v=4&s=60)
Apply style fixes
c8932ede
workaround moe training
c8ac7d5f
workaround moe training
bf7ace6d
remove prints
2fcb17dd
to reduce some memory, keep vae in `weight_dtype` same as we have for…
80f13beb
refactor to align with HiDream refactor
b8039c94
refactor to align with HiDream refactor
c331597b
refactor to align with HiDream refactor
c32ccccc
add support for cpu offloading of text encoders
6e070b8b
Apply style fixes
d77e42a1
adjust lr and rank for train example
5c8c3390
fix copies
abfb389f
Apply style fixes
a5fe6be7
Merge branch 'main' into hi-dream
d5627760
update README
2798d402
update README
ab960c2a
update README
52d94213
fix license
fc5eb48f
keep prompt2,3,4 as None in validation
a0129148
remove reverse ode comment
d5b9eccf
Update examples/dreambooth/train_dreambooth_lora_hidream.py
f04a13ac
Update examples/dreambooth/train_dreambooth_lora_hidream.py
0b75081c
vae offload change
4db988f9
fix text encoder offloading
13192a33
Apply style fixes
408dfdbe
cleaner to_kwargs
33834465
fix module name in copied from
73ab2017
Merge branch 'main' into hi-dream
62019cc1
add requirements
a07ee59f
fix offloading
a751cc2f
fix offloading
120b8214
fix offloading
9d71d3b3
update transformers version in reqs
2798d772
try AutoTokenizer
363d29b6
try AutoTokenizer
8f24e8ce
Apply style fixes
b31bdf09
empty commit
6c77651f
Merge remote-tracking branch 'origin/hi-dream' into hi-dream
246978e9
Delete tests/lora/test_lora_layers_hidream.py
9b6ef439
change tokenizer_4 to load with AutoTokenizer as well
fb3ac745
make text_encoder_four and tokenizer_four configurable
82a40372
save model card
9de10cbf
save model card
418f6a3c
revert T5
36c1adae
fix test
bd399b19
Merge branch 'main' into hi-dream
a8e1a0bf
Merge branch 'main' into hi-dream
bd275c01
Merge branch 'main' into hi-dream
e49be975
remove non diffusers lumina2 conversion
ed97dba0
sayakpaul
approved these changes
on 2025-04-22
Login to write a write a comment.
Login via GitHub