vllm
13e211bb - Avoid division by zero in cache DS MLA kernel (#26174)

Commit

195 days ago

Avoid division by zero in cache DS MLA kernel (#26174) Signed-off-by: Matthew Bonanni <mbonanni@redhat.com> Signed-off-by: yewentao256 <zhyanwentao@126.com>

References

#25293 - [Refactor] Refactor FP8 & INT8 Quant Folder inside `w8a8`

Author

MatthewBonanni

Committer

yewentao256

Parents

2d68bba3

vllm 13e211bb - Avoid division by zero in cache DS MLA kernel (#26174)

vllm
13e211bb - Avoid division by zero in cache DS MLA kernel (#26174)