vllm
e3d0a1d1 - [Quantizaton] [AMD] Add support for running DeepSeek int8 w8a8 MoE on ROCm (#17558)

Commit

222 days ago

[Quantizaton] [AMD] Add support for running DeepSeek int8 w8a8 MoE on ROCm (#17558) Signed-off-by: Randall Smith <Randall.Smith@amd.com>

References

Author

rasmith

Parents