[CUDA] Add speculative decoding to paged XQA #32340
tianleiwu
marked this pull request as draft 77 days ago
[CUDA] Add speculative decoding to paged XQA
5303da95
[CUDA] Harden speculative paged XQA dispatch
04882583
[CUDA] Enable native speculative paged XQA
dc6f7ca7
Fix MSVC C4459 errors in speculative paged XQA
d46aecdf
fix causal mask in XQA kernel
ea1f866c
Suppress MSVC C4459 in native speculative XQA and widen tests
3db7861f
tianleiwu
force pushed
from
a69abc34
to
3db7861f
76 days ago
tianleiwu
marked this pull request as ready for review 76 days ago
fix test
14ecf875
[CUDA] Disable native paged XQA by default
5dc2d7bc
test(cuda): allow any non-XQA fallback
78d88629
fix(cuda): correct local window, sinks and asserts in speculative XQA
2cb3f9fc
tianleiwu
merged
491a5f5f
into main 73 days ago
tianleiwu
deleted the exp/qwen38-paged-xqa-h256 branch 73 days ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub