Remove pages_per_seq padding constrains and add MHA support #8816
yaochengji
merged
1 commit into
pytorch:master
from
bythew3i:ragged-attn-v2
Remove pages_per_seq % num_kv_pages_per_blk == 0 constrains and add M…
269c2b98
vanbasten23
commented
on 2025-03-11
yaochengji
approved these changes
on 2025-03-12
Login to write a write a comment.
Login via GitHub