Integrate CUDA workspace with activation memory patterns #32071
chilo-ms
wants to merge
6 commits into
chilo/level2-workspace-verification
from
chilo/static-workspace-preallocation
chilo-ms
force-pushed the
chilo/level2-workspace-verification
branch
from
d05286bf
to
1948ce23
5 days ago
Preallocate declared CUDA workspace
30da4dd0
Plan CUDA workspace with activations
f867bdde
Test planned workspace across MatMulNBits chain
84409b97
Bridge planned workspace access to CUDA
01165aab
Avoid workspace declaration for MatMulNBits GEMV
b5236e8e
Test CUDA arena savings from planned workspace
f4e45cbc
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub