diffusers
[feat] allow SDXL pipeline to run with fused QKV projections
#6030
Merged
Overview
Commits
61
Changes
View On GitHub

[feat] allow SDXL pipeline to run with fused QKV projections #6030

sayakpaul merged 61 commits into main from sdxl/feat
sayakpaul
sayakpaul debug
bf4e645a
sayakpaul from step
afb517ae
sayakpaul print
55f1842a
sayakpaul turn sigma a list
215bf3b6
sayakpaul make str
75ae3df5
sayakpaul init_noise_sigma
ff04934d
sayakpaul comment
096fffbb
sayakpaul remove prints
bd855d78
sayakpaul feat: introduce fused projections
88c7e166
sayakpaul change to a better name
f5b091d1
sayakpaul no grad
a4da76b6
sayakpaul device.
c5a5f852
sayakpaul device
4e556a92
sayakpaul dtype
86027e52
sayakpaul okay
a030797f
sayakpaul print
01c6038e
sayakpaul more print
c4eaec3a
sayakpaul fix: unbind -> split
a7da4671
sayakpaul fix: qkv >-> k
94fb74a7
sayakpaul enable disable
678577b9
sayakpaul apply attention processor within the method
580a1c2d
sayakpaul attn processors
06bb65b1
sayakpaul _enable_fused_qkv_projections
a0b90662
sayakpaul remove print
32012cea
sayakpaul add fused projection to vae
5175b91c
sayakpaul add todos.
7b168887
sayakpaul merge main and resolve conflicts
ba14a082
sayakpaul add: documentation and cleanups.
23f8404b
sayakpaul add: test for qkv projection fusion.
e51bc7e7
sayakpaul relax assertions.
b64e5336
sayakpaul relax further
c7f78bf5
sayakpaul sayakpaul requested a review from patrickvonplaten patrickvonplaten 2 years ago
sayakpaul
sayakpaul commented on 2023-12-03
sayakpaul
sayakpaul commented on 2023-12-03
sayakpaul fix: docs
981dc3ab
sayakpaul Merge branch 'main' into sdxl/feat
be647c34
sayakpaul fix-copies
0afc2b45
sayakpaul correct error message.
2c02f073
sayakpaul Empty-Commit
e0848ebb
sayakpaul better conditioning on disable_fused_qkv_projections
4b66d102
sayakpaul Merge branch 'main' into sdxl/feat
6c5712cd
sayakpaul check
8da35af8
sayakpaul check processor
4e120d86
sayakpaul bfloat16 computation.
253aaf0d
HuggingFaceDocBuilderDev
sayakpaul check latent dtype
44d4263a
sayakpaul style
418d33c7
sayakpaul remove copy temporarily
8c0c3e2f
sayakpaul cast latent to bfloat16
1688fee3
sayakpaul fix: vae -> self.vae
4f882ab0
sayakpaul remove print.
2632a8b2
sayakpaul add _change_to_group_norm_32
d944d8b1
sayakpaul comment out stuff that didn't work
0432297d
patrickvonplaten
patrickvonplaten commented on 2023-12-04
patrickvonplaten
patrickvonplaten commented on 2023-12-04
patrickvonplaten
patrickvonplaten commented on 2023-12-04
patrickvonplaten
patrickvonplaten commented on 2023-12-04
patrickvonplaten
patrickvonplaten commented on 2023-12-04
patrickvonplaten
patrickvonplaten commented on 2023-12-04
sayakpaul
sayakpaul Apply suggestions from code review
7d8b9130
sayakpaul reflect patrick's suggestions.
ff28fdd8
sayakpaul fix imports
93b5f92a
sayakpaul Merge branch 'main' into sdxl/feat
a7a952dc
sayakpaul fix: disable call.
8d17831b
sayakpaul fix more
d17bbbd9
sayakpaul fix device and dtype
a5fb4d76
sayakpaul fix conditions.
8fadb14a
sayakpaul fix more
c6d5e86a
patrickvonplaten
patrickvonplaten
patrickvonplaten commented on 2023-12-04
patrickvonplaten
patrickvonplaten commented on 2023-12-04
patrickvonplaten
patrickvonplaten approved these changes on 2023-12-04
sayakpaul Apply suggestions from code review
abf9ebc7
sayakpaul Merge branch 'main' into sdxl/feat
d485abdd
sayakpaul
sayakpaul Merge branch 'main' into sdxl/feat
e65ddcd0
patrickvonplaten
patrickvonplaten approved these changes on 2023-12-05
sayakpaul sayakpaul merged a2bc2e14 into main 2 years ago
sayakpaul sayakpaul deleted the sdxl/feat branch 2 years ago
sayakpaul sayakpaul restored the head branch 2 years ago
patrickvonplaten
patrickvonplaten commented on 2023-12-06

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum