vllm
f4ee2c3d - fix fp8 online quantization streaming with tp > 1 (#30900)

Commit

2 days ago

fix fp8 online quantization streaming with tp > 1 (#30900) Signed-off-by: vasiliy <vasiliy@fb.com>

References

Author

vkuzo

Parents