transformers
🚨 Attention 🚨 Make regular attention support CB
#49101

Open

🚨 Attention 🚨 Make regular attention support CB #49101

remi-or wants to merge 16 commits into support-paged-in-flash from merge-paged-into-regular

remi-or commented on 2026-09-25

remi-or marked this pull request as ready for review 4 days ago

remi-or requested a review from

vasqu 4 days ago

remi-or force pushed from 7f643416 to 1c0bd764 4 days ago

vasqu commented on 2026-09-25

remi-or changed the title ~~[Attention] Make regular attention support CB~~ 🚨 Attention 🚨 Make regular attention support CB 4 days ago

remi-or commented on 2026-09-25

vasqu commented on 2026-09-25

vasqu approved these changes on 2026-09-28

remi-or force-pushed the support-paged-in-flash branch from 8f39df93 to bdc3efaf 18 hours ago

remi-or force pushed from cd3112cc to 8e141b18 17 hours ago

Core

a1b9cb7d

Fix before PR

1badfbd4

Reroute flash

e9dce149

Reroute SDPA

099b6037

Cleanup

b7415d0b

Review

a49916e7

Rename + style

8ecaaacc

Nits

4cd195fe

Note

fa875e6b

Fix

a5fc6814

Note

847c7590

Apply suggestion from @vasqu

c647df8e

Review

02c77b61

Blockify

fa1c7df0

Update src/transformers/modeling_flash_attention_utils.py

529737cd

Final rieview

2a995bef

remi-or force pushed from 8e141b18 to 2a995bef 15 hours ago

Reviewers

vasqu

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers 🚨 Attention 🚨 Make regular attention support CB #49101 Open

🚨 Attention 🚨 Make regular attention support CB #49101

transformers
🚨 Attention 🚨 Make regular attention support CB
#49101

Open