vllm
Explicitly explain quant method override ordering and ensure all overrides are ordered
#17256

Merged

Explicitly explain quant method override ordering and ensure all overrides are ordered #17256

mgoin merged 4 commits into vllm-project:main from hmellor:quant-override-clarity

Explicitly explain quant method override ordering and ensure all over…

e7a753f8

hmellor requested a review from

mgoin 1 year ago

hmellor requested a review from

robertgshaw2-redhat 1 year ago

hmellor requested a review from

tlrmchlsmth 1 year ago

hmellor added quantization

DarkLight1337 commented on 2025-04-27

Don't create `QuantizationMethods` because we don't need it in this PR

dc4c3620

Don't raise error for custom quant methods

4afe7429

Give custom overrides priority over build in ones

4b182c38

hmellor requested a review from

DarkLight1337 1 year ago

mgoin approved these changes on 2025-04-28

mgoin added ready

mgoin enabled auto-merge (squash) 1 year ago

mgoin merged c7941cca into main 1 year ago

hmellor deleted the quant-override-clarity branch 1 year ago

Reviewers

mgoin

DarkLight1337

robertgshaw2-redhat

tlrmchlsmth

Assignees

No one assigned

Labels

ready

Milestone

No milestone