vllm
1198bd06 - add a ring slot to make sure no race

Commit

8 days ago

add a ring slot to make sure no race Signed-off-by: yewentao256 <zhyanwentao@126.com>

References

#35333 - [Perf] Optimize model runner v2 `prepare_inputs` copy logic, 6.1% E2E throughput improvement

Author

yewentao256

yewentao256

Parents

Loading