vllm
2168fc8f - [NIXL][Misc] Expose metrics from NIXL for logging to CLI (#25388)

Commit

109 days ago

[NIXL][Misc] Expose metrics from NIXL for logging to CLI (#25388) Signed-off-by: NickLucche <nlucches@redhat.com> Signed-off-by: yewentao256 <zhyanwentao@126.com>

References

#25293 - [Refactor] Refactor FP8 & INT8 Quant Folder inside `w8a8`

Author

NickLucche

Committer

yewentao256

Parents

8d332b3c

vllm 2168fc8f - [NIXL][Misc] Expose metrics from NIXL for logging to CLI (#25388)

vllm
2168fc8f - [NIXL][Misc] Expose metrics from NIXL for logging to CLI (#25388)