vllm
edaae182 - add(v1): RequestStatesStats to RequestOutput (#24947)

Commit

200 days ago

add(v1): RequestStatesStats to RequestOutput (#24947) Signed-off-by: huijjj <huijong.jeong@squeezebits.com> Signed-off-by: yewentao256 <zhyanwentao@126.com>

References

#25293 - [Refactor] Refactor FP8 & INT8 Quant Folder inside `w8a8`

Author

huijjj

Committer

yewentao256

Parents

5b80f220

vllm edaae182 - add(v1): RequestStatesStats to RequestOutput (#24947)

vllm
edaae182 - add(v1): RequestStatesStats to RequestOutput (#24947)