vllm
05c2dee7 - [DeepSeek + LMCache Multiprocess] handle MLA for deepseek model + LMCache Multiprocess connector (#29039)

Commit

21 days ago

[DeepSeek + LMCache Multiprocess] handle MLA for deepseek model + LMCache Multiprocess connector (#29039) Signed-off-by: KuntaiDu <kuntai@uchicago.edu>

References

#29039 - [DeepSeek + LMCache Multiprocess] handle MLA for deepseek model + LMCache Multiprocess connector

Author

KuntaiDu

Parents

1d642872

vllm 05c2dee7 - [DeepSeek + LMCache Multiprocess] handle MLA for deepseek model + LMCache Multiprocess connector (#29039)

vllm
05c2dee7 - [DeepSeek + LMCache Multiprocess] handle MLA for deepseek model + LMCache Multiprocess connector (#29039)