vllm
e6327c9b - [Feature] Support sequence parallelism for static fp8 quantization (#19181)

Commit
172 days ago
[Feature] Support sequence parallelism for static fp8 quantization (#19181) Signed-off-by: cascade812 <cascade812@outlook.com>
Author
Parents
Loading