[WIP] SD3.5 IP-Adapter Pipeline Integration #9987
yiyixuxu
merged
55 commits into
huggingface:main
from
guiyrt:sd3.5_IPAdapter
Initial pipeline for SD3.5-Large-IP-Adapter
0af910be
Added support for single IPAdapter on SD3.5 pipeline
55674387
Merge branch 'main' into sd3.5_IPAdapter
50d09d92
Fixed typo and reverted removal of skip_layers in SD3Transformer2DModel
0ef36dd2
Added new SD3IPAdapterMixin loader
de8909ac
ip_adapter image embeds now considers num_images_per_prompt
ab0d9042
Merge branch 'main' into sd3.5_IPAdapter
d868ddb6
guiyrt
changed the title 
Removed usage of einops
5aed1d3d
Reverted joint_attention_kwargs default for consistency
4383175d
Corrected einops removal
461ab733
Quality and style checks
83232408
Quality and style checks
89c4e634
Handle None joint_attention_kwargs in JointTransformerBlock
27d574fe
Fix test_components_function
0a486483
Remove from img2img/inpaint for now
10d0a062
Fixed loading ip_adapter state dict
c78c4fd1
Simpler image encoding
0f6c6079
Style check
53fd40db
Better checks for image prompt considering ip_adapter scale
8039599f
Minor change correcting checking for ip_adapter embeds
7333bfc3
Removing old check of ip_adapter scale
a87895e9
Refactor of image_proj (testing)
4ba374a6
Revert "Removing old check of ip_adapter scale"
819dd3e0
Merge branch 'main' into sd3.5_IPAdapter
262a3bb0
Corrected property check
ea32e132
hlky
commented
on 2024-12-11
Corrected forward() of IPAdapterTimeImageProjectionBlock
f60751f7
IPAdapterTimeImageProjectionBlock now uses original attention impleme…
b0aa5cb3
Clean-up and make style
b3dc69ae
Minor changes in code structure
84aa4a3e
make style && make quality
34793fbd
Merge branch 'main' into sd3.5_IPAdapter
27fe083e
hlky
approved these changes
on 2024-12-13
guiyrt
commented
on 2024-12-16
Updated dosctrings and doc entries
68169f8f
yiyixuxu
approved these changes
on 2024-12-16
yiyixuxu
commented
on 2024-12-16
Merge branch 'main' into sd3.5_IPAdapter
d8244518
make
24e6880b
More docs and small refactors
43d2e77d
Merge remote-tracking branch 'origin' into sd3.5_IPAdapter
05f49e6f
Fix in loading state dict
44e38477
Enabled cpu offload
178e513a
Merge branch 'main' into sd3.5_IPAdapter
7899c6ab
hlky
commented
on 2024-12-18
Renaming from transformers_sd3 to transformer_sd3
8daca657
Missing rename
7c918db6
Updated docs for SD3 pipeline
99a6d594
Merge branch 'main' into sd3.5_IPAdapter
3916298a
Update docs/source/en/api/pipelines/stable_diffusion/stable_diffusion…
02a6d90e
Minor doc correction
64ab7f9f
Updated img source to hf/documentation-images
b254aa3a
image_proj is now called from SD3Transformer2DModel
5c28161b
Merge branch 'main' into sd3.5_IPAdapter
1313501b
ip_adapter_image_embeds go through joint_attention_kwargs
b882e1bd
Warning for sequential cpu offloading with image_encoder
988447f8
Merge branch 'main' into sd3.5_IPAdapter
66c48666
make style quality
98f4521a
yiyixuxu
commented
on 2024-12-19
Merge branch 'main' into sd3.5_IPAdapter
5eef7f18
Update src/diffusers/models/attention.py
18cd8e4f
yiyixuxu
commented
on 2024-12-19
Update src/diffusers/pipelines/stable_diffusion_3/pipeline_stable_dif…
65b477fb
Login to write a write a comment.
Login via GitHub