vllm
6841f5dc - [ROCm] Add env flags to disable dynamic MXFP4 quant and enable AITER tuned GEMMs for Attention Projection Layers (#39987)

Commit

154 days ago

[ROCm] Add env flags to disable dynamic MXFP4 quant and enable AITER tuned GEMMs for Attention Projection Layers (#39987) Signed-off-by: Hemanth Acharya <heachary@amd.com>

References

khluu/b200-k8s-ci-smoke-20260429

#39987 - [ROCm] Add env flags to disable dynamic MXFP4 quant and enable AITER tuned GEMMs for Attention Projection Layers

Author

heachary

Parents

c2fb0133

vllm 6841f5dc - [ROCm] Add env flags to disable dynamic MXFP4 quant and enable AITER tuned GEMMs for Attention Projection Layers (#39987)

vllm
6841f5dc - [ROCm] Add env flags to disable dynamic MXFP4 quant and enable AITER tuned GEMMs for Attention Projection Layers (#39987)