onnxruntime
[CUDA] Bound GQA non-windowed workspace via the KV-length envelope (route-aware L1 estimate)
#33016
Merged

[CUDA] Bound GQA non-windowed workspace via the KV-length envelope (route-aware L1 estimate) #33016

chilo-ms
chilo-ms chilo-ms marked this pull request as ready for review 45 days ago
Base automatically changed from chilo/gqa-workspace-envelope-plumbing to main 39 days ago
chilo-ms chilo-ms requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 39 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-10-07
chilo-ms chilo-ms requested a review from xadupre xadupre 38 days ago
chilo-ms chilo-ms requested a review from titaiwangms titaiwangms 38 days ago
titaiwangms
titaiwangms commented on 2026-10-09
chilo-ms
chilo-ms chilo-ms force pushed from a17ecc6d to 1f175d33 37 days ago
chilo-ms [CUDA] Bound GQA non-windowed workspace via the KV-length envelope (r…
8b901a30
chilo-ms [CUDA] Bound non-windowed GQA static-cache allocations
a34592af
Harden GQA workspace envelope policy
e27a4f74
Document GQA estimator availability contract
3633cea8
titaiwangms
titaiwangms dismissed these changes on 2026-10-09
chilo-ms chilo-ms force pushed from 1f175d33 to 3633cea8 37 days ago
Fix parsed GQA envelope test expectation
58c6d7b8
chilo-ms chilo-ms dismissed their stale review via 58c6d7b8 34 days ago
chilo-ms chilo-ms requested a review from titaiwangms titaiwangms 34 days ago
titaiwangms titaiwangms requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 33 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-10-13
[CUDA] Decline unproven plugin GQA capacity assignments
2cff2baf
Fix GQA plugin regression test accounting assertion
83019a94
titaiwangms
titaiwangms approved these changes on 2026-10-14
chilo-ms chilo-ms enabled auto-merge (squash) 31 days ago
Merge main into GQA workspace estimation branch
82b6b391
chilo-ms chilo-ms merged 327d11ab into main 31 days ago
chilo-ms chilo-ms deleted the chilo/gqa-workspace-nonwindowed-estimate branch 31 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone