vllm
36bbecd6
- [BugFix] Revert "[KV Offload] Use background thread for mmap / cpu_tensors pinning" (#46958)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
4 days ago
[BugFix] Revert "[KV Offload] Use background thread for mmap / cpu_tensors pinning" (#46958) Signed-off-by: <> Co-authored-by: Varun Sundar Rabindranath <varun-sundar-rabindranath@h100-01.nemg-001.lab.rdu2.dc.redhat.com>
References
#46958 - [BugFix] Revert "[KV Offload] Use background thread for mmap / cpu_tensors pinning"
Author
varun-sundar-rabindranath
Parents
6149187a
Loading