xla
Update ragged paged attention kernel to prevent vmem oom
#9346

Merged

Update ragged paged attention kernel to prevent vmem oom #9346

yaochengji merged 4 commits into pytorch:master from Chenyaaang:vmem-oom

calculate actual vmem usage after getting kernel shapes

77a038b5

Merge remote-tracking branch 'cy-fork/master' into vmem-oom

de4097bb

calculate actual kerrnel vem usage

26e61f43

Chenyaaang force pushed from 55dd3cd0 to a12d6316 230 days ago

yaochengji requested a review from

yaochengji 229 days ago

Chenyaaang force pushed from a12d6316 to 57f7f27d 229 days ago

yaochengji approved these changes on 2025-06-12

Merge remote-tracking branch 'origin/master' into vmem-oom

048b27f2

Chenyaaang force pushed from 57f7f27d to 048b27f2 229 days ago

yaochengji merged bea86eec into master 228 days ago

Reviewers

yaochengji

Assignees

No one assigned

Labels

None yet

Milestone

No milestone