PR #24595 Add Paged Attention Op for CUDA SM80 support

Add Paged Attention Op for CUDA SM80 support #24595

aciddelgado merged 16 commits into main from aciddelgado/paged_attention

paged attention op

6e75e228

test file amid-debug

aa6fd44c

paged attention works

5583aaaf

everything works and is implemented

c628e66b

aciddelgado requested a review from

baijumeswani 1 year ago

aciddelgado requested a review from

tianleiwu 1 year ago

aciddelgado requested a review from

kunal-vaishnavi 1 year ago

github-actions commented on 2025-04-29

github-advanced-security commented on 2025-04-29

small stuff

554d0c70

github-actions commented on 2025-04-29

kunal-vaishnavi commented on 2025-04-30

lint

497a22eb

github-actions commented on 2025-04-30

address comments

c3276d11

github-actions commented on 2025-04-30

tianleiwu commented on 2025-05-01

fix dmmha rotary and address tianleiwu comments

482240c8

github-actions commented on 2025-05-01

increase efficiency

6a197dc6

github-actions commented on 2025-05-01

correction

0f23e6f8

update flash and remove redundant inputs

cd15f813

bert comment

aa9b6f19

merge main

e0432f8d

docs

50a3767d

tianleiwu commented on 2025-06-11

comments

5eccad2c

docs

1c3b53c2

tianleiwu approved these changes on 2025-06-12

aciddelgado merged 30c5f059 into main 1 year ago

aciddelgado deleted the aciddelgado/paged_attention branch 1 year ago

Reviewers

tianleiwu

github-actions

kunal-vaishnavi

github-advanced-security

baijumeswani

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

onnxruntime Add Paged Attention Op for CUDA SM80 support #24595 Merged

Add Paged Attention Op for CUDA SM80 support #24595

onnxruntime
Add Paged Attention Op for CUDA SM80 support
#24595

Merged