vllm
Fix target matching for fused layers with compressed-tensors
#12617

Merged

Fix target matching for fused layers with compressed-tensors #12617

mgoin merged 4 commits into vllm-project:main from eldarkurtic:fix-matching-for-fused-layers

Properly match fused layers

589a540d

eldarkurtic requested a review from

mgoin 1 year ago

eldarkurtic requested a review from

robertgshaw2-redhat 1 year ago

eldarkurtic requested a review from

tlrmchlsmth 1 year ago

mgoin changed the title ~~Fix matching for fused layers~~ Fix target matching for fused layers with compressed-tensors 1 year ago

mgoin added quantization

mgoin added ready

fix line length

e2f9563c

fix style

777baaed

mgoin commented on 2025-01-31

make sure all fused layers have the same quant

cf2511c5

eldarkurtic requested a review from

mgoin 1 year ago

mgoin approved these changes on 2025-01-31

mgoin enabled auto-merge (squash) 1 year ago

mgoin merged 1867c258 into main 1 year ago

Reviewers

mgoin

robertgshaw2-redhat

tlrmchlsmth

Assignees

No one assigned

Labels

ready

Milestone

No milestone