vllm
d263bd9d
- [Core] Support disaggregated prefill with Mooncake Transfer Engine (#10884)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Hide Minimap (CTRL+M)
Commit
178 days ago
[Core] Support disaggregated prefill with Mooncake Transfer Engine (#10884) Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
References
#10884 - [Core] Support disaggregated prefill with Mooncake Transfer Engine
Author
ShangmingCai
Parents
38e599d6
Files
4
vllm
config.py
distributed/kv_transfer
kv_connector
factory.py
simple_connector.py
kv_pipe
mooncake_pipe.py
Loading