vllm
14d03b8d - [Perf] Cache xpu_get_mem_info() result to avoid duplicate calls (#32983)

Commit

25 days ago

[Perf] Cache xpu_get_mem_info() result to avoid duplicate calls (#32983) Signed-off-by: 7. Sun <jhao.sun@gmail.com>

References

Author

sjhddh

Parents