vllm
c6f384da - [backends][short_conv] CUDA graph piecewise edits (#24215)

Commit

167 days ago

[backends][short_conv] CUDA graph piecewise edits (#24215) Signed-off-by: Paul Pak <paulpak58@gmail.com> Signed-off-by: yewentao256 <zhyanwentao@126.com>

References

#25293 - [Refactor] Refactor FP8 & INT8 Quant Folder inside `w8a8`

Author

paulpak58

Committer

yewentao256

Parents

7faf51f1

vllm c6f384da - [backends][short_conv] CUDA graph piecewise edits (#24215)

vllm
c6f384da - [backends][short_conv] CUDA graph piecewise edits (#24215)