diffusers
[Feat] Support SDXL Kohya-style LoRA
#4287
Merged

[Feat] Support SDXL Kohya-style LoRA #4287

patrickvonplaten merged 99 commits into main from feat/sdxl-lora-1
sayakpaul
sayakpaul sdxl lora changes.
9ae25cf6
sayakpaul better name replacement.
37f55987
sayakpaul better replacement.
be43f123
sayakpaul debugging
431a7ef9
sayakpaul debugging
177c4fed
sayakpaul debugging
d4e1c225
sayakpaul debugging
ed74dfe0
sayakpaul debugging
36678881
sayakpaul remove print.
40cb7908
sayakpaul print state dict keys.
cbc21f7b
sayakpaul print
e12b128b
sayakpaul distingisuih better
4ea13cf7
sayakpaul debuggable.
e0a946bc
sayakpaul sayakpaul requested a review from patrickvonplaten patrickvonplaten 2 years ago
sayakpaul fxi: tyests
508bd78d
HuggingFaceDocBuilderDev
duongna21
duongna21 commented on 2023-07-26
sayakpaul fix: arg from training script.
b6f0ba0a
patrickvonplaten
sayakpaul access from class.
ca353393
sayakpaul run style
6b535bc9
patrickvonplaten debug
3e72de39
isidentical
patrickvonplaten save intermediate
0ce05446
patrickvonplaten some simplifications for SDXL LoRA
456eba5b
patrickvonplaten
sayakpaul
isidentical
sayakpaul
sayakpaul commented on 2023-07-27
sayakpaul
sayakpaul commented on 2023-07-27
sayakpaul
sayakpaul commented on 2023-07-27
sayakpaul
sayakpaul commented on 2023-07-27
sayakpaul
sayakpaul commented on 2023-07-27
sayakpaul
sayakpaul commented on 2023-07-27
sayakpaul styling
d1efaacd
sayakpaul
sayakpaul commented on 2023-07-27
sayakpaul unet config is not needed in diffusers format.
618aa9ec
isidentical fix: dynamic SGM block mapping for SDXL kohya loras (#4322)
46f28093
isidentical Use lora compatible layers for linear proj_in/proj_out (#4323)
a18cb4d2
patrickvonplaten
patrickvonplaten commented on 2023-07-27
sayakpaul improve condition for using the sgm_diffusers mapping
673a674b
sayakpaul informative comment.
eb4f8cee
sayakpaul load compatible keys and embedding layer maaping.
205bb732
patrickvonplaten Get SDXL 1.0 example lora to load
16632cdb
patrickvonplaten
patrickvonplaten commented on 2023-07-28
patrickvonplaten
patrickvonplaten commented on 2023-07-28
patrickvonplaten
sayakpaul
sayakpaul commented on 2023-07-28
sayakpaul simplify
24cf8bd7
sayakpaul specif ranks and hidden sizes.
935839d1
sayakpaul better handling of k rank and hidden
cd581c2d
sayakpaul debug
d7c9be19
sayakpaul debug
b614d6ea
sayakpaul debug
0b8c47fa
sayakpaul debug
190dfada
sayakpaul debug
925327c5
sayakpaul
sayakpaul fix: alpha keys
37215a9b
sayakpaul add check for handling LoRAAttnAddedKVProcessor
e034ff94
sayakpaul sanity comment
e424968b
sayakpaul modifications for text encoder SDXL
4d1295f7
sayakpaul debugging
619e01c7
sayakpaul debugging
37c3a945
sayakpaul debugging
be066bcb
sayakpaul debugging
b67a637f
sayakpaul debugging
157b2cc6
sayakpaul debugging
e500ccf4
sayakpaul debugging
e4d96495
sayakpaul debugging
02d445e0
sayakpaul denugging
1c667989
sayakpaul debugging
d372a7da
sayakpaul debugging
9ab6e7af
sayakpaul debugging
2e7c60d2
sayakpaul debugging
fcd94eb2
sayakpaul debugging
9f65a8b5
sayakpaul debugging
837fce59
sayakpaul debugging
4a3ac8e1
sayakpaul debugging
78525994
sayakpaul debugging
7ac4526d
sayakpaul debugging
163fe5eb
sayakpaul debugging
6f2507a3
sayakpaul debugging
ddf56e6c
sayakpaul debugging
ddf11a13
sayakpaul debugging
f5d24a26
sayakpaul debugging
8032778c
sayakpaul debugging
3e376b24
sayakpaul debugging
48c44bc0
sayakpaul debugging
db2eea07
sayakpaul up
4125c4d8
sayakpaul up
94bbe5e1
sayakpaul up
260c9033
sayakpaul up
31a41041
sayakpaul up
fbf1c731
sayakpaul up
d676e61d
sayakpaul unneeded comments.
6a6654b1
sayakpaul unneeded comments.
db0e8d09
sayakpaul kwargs for the other attention processors.
43a39550
sayakpaul sayakpaul marked this pull request as ready for review 2 years ago
sayakpaul sayakpaul changed the title [WIP][Feat] Support SDXL Kohya-style LoRA [Feat] Support SDXL Kohya-style LoRA 2 years ago
sayakpaul kwargs for the other attention processors.
bb55eaa8
sayakpaul debugging
2bbd5c3c
sayakpaul debugging
68edb879
sayakpaul debugging
451fee1f
sayakpaul debugging
e706f146
patrickvonplaten improve
edf9ea96
patrickvonplaten Merge branch 'feat/sdxl-lora-1' of https://github.com/huggingface/dif…
07ae3655
sayakpaul debugging
2d77481a
sayakpaul debugging
a50c7ee7
sayakpaul
isidentical
sayakpaul
isidentical
patrickvonplaten more print
281a0428
patrickvonplaten Merge branch 'feat/sdxl-lora-1' of https://github.com/huggingface/dif…
8904959a
patrickvonplaten
isidentical
patrickvonplaten Fix alphas
00f391cf
patrickvonplaten
sayakpaul
sayakpaul commented on 2023-07-28
sayakpaul debugging
c53277a4
sayakpaul debugging
adafaf2b
sayakpaul debugging
fd4dd0ea
sayakpaul debugging
0519e4ac
sayakpaul debugging
6c08115b
sayakpaul debugging
8ae37981
patrickvonplaten Merge branch 'main' into feat/sdxl-lora-1
bf7fe221
sayakpaul clean up
baf386d3
sayakpaul clean up.
060f9f7d
sayakpaul debugging
98cada28
sayakpaul fix: text
cc4a019b
patrickvonplaten patrickvonplaten merged 4a4cdd6b into main 2 years ago
patrickvonplaten patrickvonplaten deleted the feat/sdxl-lora-1 branch 2 years ago
BitPhinix
LWprogramming
gonzalojaimovitch
sayakpaul
gonzalojaimovitch
sayakpaul
gonzalojaimovitch
linnanwang
sayakpaul
linnanwang
sayakpaul
sayakpaul
linnanwang
linnanwang

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone