vllm
36bbecd6 - [BugFix] Revert "[KV Offload] Use background thread for mmap / cpu_tensors pinning" (#46958)

Commit
4 days ago
[BugFix] Revert "[KV Offload] Use background thread for mmap / cpu_tensors pinning" (#46958) Signed-off-by: <> Co-authored-by: Varun Sundar Rabindranath <varun-sundar-rabindranath@h100-01.nemg-001.lab.rdu2.dc.redhat.com>
Parents
Loading