onnxruntime
[CUDA] Add speculative decoding to paged XQA
#32340
Merged

[CUDA] Add speculative decoding to paged XQA #32340

tianleiwu merged 10 commits into main from exp/qwen38-paged-xqa-h256
tianleiwu
tianleiwu tianleiwu requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 77 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-08-31
tianleiwu
tianleiwu tianleiwu marked this pull request as draft 77 days ago
tianleiwu [CUDA] Add speculative decoding to paged XQA
5303da95
tianleiwu [CUDA] Harden speculative paged XQA dispatch
04882583
tianleiwu [CUDA] Enable native speculative paged XQA
dc6f7ca7
tianleiwu Fix MSVC C4459 errors in speculative paged XQA
d46aecdf
tianleiwu fix causal mask in XQA kernel
ea1f866c
tianleiwu Suppress MSVC C4459 in native speculative XQA and widen tests
3db7861f
tianleiwu tianleiwu force pushed from a69abc34 to 3db7861f 76 days ago
tianleiwu tianleiwu marked this pull request as ready for review 76 days ago
tianleiwu fix test
14ecf875
tianleiwu [CUDA] Disable native paged XQA by default
5dc2d7bc
tianleiwu test(cuda): allow any non-XQA fallback
78d88629
tianleiwu tianleiwu requested a review from baijumeswani baijumeswani 74 days ago
tianleiwu tianleiwu requested a review from hariharans29 hariharans29 74 days ago
tianleiwu tianleiwu requested a review from titaiwangms titaiwangms 74 days ago
baijumeswani
baijumeswani commented on 2026-09-04
tianleiwu fix(cuda): correct local window, sinks and asserts in speculative XQA
2cb3f9fc
tianleiwu tianleiwu requested a review from baijumeswani baijumeswani 73 days ago
baijumeswani
baijumeswani approved these changes on 2026-09-04
tianleiwu tianleiwu merged 491a5f5f into main 73 days ago
tianleiwu tianleiwu deleted the exp/qwen38-paged-xqa-h256 branch 73 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone