vllm
[Core] Default to using per_token quantization for fp8 when cutlass is supported.
#8651
Merged
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
4
Changes
View On
GitHub
Loading