PR #2634 Support for cross-attention bias / mask

Support for cross-attention bias / mask #2634

patrickvonplaten merged 25 commits into huggingface:main from Birch-san:cross_attn_mask_3

Birch-san force pushed from 4fb67fb0 to 9aea4a21 2 years ago

patrickvonplaten commented on 2023-03-13

Birch-san force pushed from cc8bce29 to 012dbce1 2 years ago

Birch-san force pushed from 012dbce1 to 41316d71 2 years ago

Birch-san force pushed from 41316d71 to aa7cd2f1 2 years ago

Birch-san force pushed from aa7cd2f1 to 4232ad09 2 years ago

patrickvonplaten commented on 2023-03-31

patrickvonplaten requested a review from

pcuenca 2 years ago

patrickvonplaten requested a review from

williamberman 2 years ago

patrickvonplaten requested a review from

sayakpaul 2 years ago

Birch-san force pushed from 8e45eadf to b6598569 2 years ago

sayakpaul commented on 2023-04-04

pcuenca commented on 2023-04-04

Birch-san force pushed from 2a7c8baa to 6a68067f 2 years ago

patrickvonplaten commented on 2023-04-28

Birch-san force pushed from 6a68067f to 7c3fb5af 2 years ago

Birch-san force pushed from 7c3fb5af to 27b807f6 2 years ago

patrickvonplaten commented on 2023-05-11

Birch-san force pushed from 7009b1fb to fb496db2 2 years ago

patrickvonplaten commented on 2023-05-12

patrickvonplaten approved these changes on 2023-05-12

williamberman commented on 2023-05-12

Birch-san force pushed from 80d6ef46 to 82117f2a 2 years ago

patrickvonplaten commented on 2023-05-16

williamberman commented on 2023-05-17

sayakpaul commented on 2023-05-17

patrickvonplaten commented on 2023-05-17

Birch-san force pushed from 4245520f to e35b7df4 2 years ago

Cross-attention masks

57bdc4f1

encoder_attention_mask for SimpleCrossAttnDownBlock2D, SimpleCrossAtt…

bd763a44

encoder_attention_mask for UNetMidBlock2DSimpleCrossAttn

d2f99b9d

support attention_mask, encoder_attention_mask in KCrossAttnDownBlock…

9ad3ed98

fix mistake made during merge conflict resolution

fecc5953

regenerate versatile_diffusion

370daf57

pass time embedding into checkpointed attention invocation

b60b7ed7

always assume encoder_attention_mask is a mask (i.e. not a bias).

faef7acd

style, fix-copies

725c27ad

add tests for cross-attention masks

e0437ae0

fix mistake made during merge conflict resolution

fecc5953

always assume encoder_attention_mask is a mask (i.e. not a bias).

faef7acd

explain mask's query_tokens dim. fix explanation about broadcasting o…

ea2948e4

Birch-san force pushed from 8f12786c to 8c323c5f 2 years ago

patrickvonplaten commented on 2023-05-22

patrickvonplaten merged 64bf5d33 into main 2 years ago

Reviewers

patrickvonplaten

pcuenca

sayakpaul

williamberman

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

diffusers Support for cross-attention bias / mask #2634 Merged

Support for cross-attention bias / mask #2634

diffusers
Support for cross-attention bias / mask
#2634

Merged