vllm
[Bugfix] Support MLA for CompressedTensorsWNA16
#13725

Merged

[Bugfix] Support MLA for CompressedTensorsWNA16 #13725

tlrmchlsmth merged 3 commits into vllm-project:main from neuralmagic:fix-mla-w4-ct

Fix MLA for CompressedTensorsWNA16

0282207b

Merge branch 'main' into fix-mla-w4-ct

6be8aea7

Fix format

84a84084

mgoin requested a review from

LucasWilkinson 298 days ago

mgoin requested a review from

tlrmchlsmth 298 days ago

mgoin requested a review from

robertgshaw2-redhat 298 days ago

mgoin added bug

mgoin added quantization

mgoin changed the title ~~Fix MLA for CompressedTensorsWNA16~~ [Bugfix] Support MLA for CompressedTensorsWNA16 298 days ago

tlrmchlsmth approved these changes on 2025-02-24

tlrmchlsmth added ready

tlrmchlsmth enabled auto-merge (squash) 298 days ago

kylesayrs approved these changes on 2025-02-24

tlrmchlsmth merged 18e50593 into main 298 days ago

Reviewers

tlrmchlsmth

kylesayrs

LucasWilkinson

robertgshaw2-redhat

Assignees

No one assigned

Labels

bug quantization ready

Milestone

No milestone