vllm
9ea82ecd - Fix V1 engine serialization error with Ray distributed executor (#26148)

Commit

120 days ago

Fix V1 engine serialization error with Ray distributed executor (#26148) Signed-off-by: Nikhil Ghosh <nikhil@anyscale.com> Signed-off-by: yewentao256 <zhyanwentao@126.com>

References

#25293 - [Refactor] Refactor FP8 & INT8 Quant Folder inside `w8a8`

Author

nrghosh

Committer

yewentao256

Parents

13e211bb

vllm 9ea82ecd - Fix V1 engine serialization error with Ray distributed executor (#26148)

vllm
9ea82ecd - Fix V1 engine serialization error with Ray distributed executor (#26148)