xla
Add ragged paged attention
#8659
Merged

Add ragged paged attention #8659

vanbasten23
bythew3i
bythew3i commented on 2025-01-31
bythew3i
vanbasten23
vanbasten23 vanbasten23 force pushed from ad2f87c2 to 9e4b227a 1 year ago
bythew3i
bythew3i approved these changes on 2025-02-01
vanbasten23 add the first version. All tests pass except for test_paged_attention…
b129e9a9
vanbasten23 all tests passed.
6c3bf730
vanbasten23 all tests passed except for one test which oom'ed.
dbc3fee2
vanbasten23 Improved the tests and all tests passed except for the OOM one. Also …
e589c860
vanbasten23 clean up
9b3cdab6
vanbasten23 linter
ab69feb7
vanbasten23 address pr comments
cd65cc4b
vanbasten23 fix the rest of comments
7fe50717
vanbasten23 vanbasten23 force pushed from 9e4b227a to 7fe50717 1 year ago
vanbasten23 Trigger CI
51704029
vanbasten23 vanbasten23 requested a review from lsy323 lsy323 1 year ago
vanbasten23 vanbasten23 requested a review from miladm miladm 1 year ago
vanbasten23
miladm
miladm approved these changes on 2025-02-03
miladm
miladm miladm assigned vanbasten23 vanbasten23 1 year ago
miladm miladm added pallas
miladm
miladm commented on 2025-02-03
vanbasten23 vanbasten23 merged 84800944 into master 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
Labels
Milestone