diffusers
replace enable_gpa with repeat_interleave for krea2
#14523

Merged

replace enable_gpa with repeat_interleave for krea2 #14523

yiyixuxu merged 4 commits into main from gqa-mask-no-math

Krea 2: repeat key/value heads instead of `enable_gqa`

b3f66f3b

docs: how to choose between `enable_gqa` and repeating key/value heads

4b89f7b6

docs: recommend a choice rather than just reporting one

ed14a5d6

github-actions added fixes-issue

github-actions added models

github-actions added size/S

yiyixuxu requested a review from

sayakpaul 8 days ago

yiyixuxu requested a review from

asomoza 8 days ago

yiyixuxu changed the title ~~replace enable_gpa with repeat_interleave~~ replace enable_gpa with repeat_interleave for krea2 8 days ago

sayakpaul approved these changes on 2026-08-18

asomoza approved these changes on 2026-08-18

docs: add enable_gqa reference model, reword performance note

cf84016f

yiyixuxu merged 11a82a15 into main 7 days ago

yiyixuxu deleted the gqa-mask-no-math branch 7 days ago

Reviewers

asomoza

sayakpaul

Assignees

No one assigned

Labels

models size/S fixes-issue

Milestone

No milestone