vllm
856ec480 - [DSv4] Tune default value of `VLLM_MULTI_STREAM_GEMM_TOKEN_THRESHOLD` (#41526)

Commit

177 days ago

[DSv4] Tune default value of `VLLM_MULTI_STREAM_GEMM_TOKEN_THRESHOLD` (#41526) Co-authored-by: Copilot <copilot@github.com>

References

Author

ywang96

Parents