vllm
[Misc] Update `compressed-tensors` WNA16 to support zero-points
#14211

Merged

[Misc] Update `compressed-tensors` WNA16 to support zero-points #14211

mgoin merged 15 commits into vllm-project:main from neuralmagic:update_ct_wna16

dsikka requested a review from

mgoin 292 days ago

dsikka requested a review from

robertgshaw2-redhat 292 days ago

dsikka requested a review from

tlrmchlsmth 292 days ago

dsikka changed the title ~~[Misc~~ [Misc] Update `compressed-tensors` WNA16 to support zero-points 292 days ago

dsikka marked this pull request as draft 292 days ago

mergify added needs-rebase

mergify removed needs-rebase

dsikka marked this pull request as ready for review 255 days ago

dsikka marked this pull request as draft 255 days ago

mgoin commented on 2025-04-10

dsikka marked this pull request as ready for review 251 days ago

brian-dellabetta approved these changes on 2025-04-14

update

b1dfd788

Enable zero points

c423827d

Bypass machete, because it doesn't support zp yet

96943e75

update condition

c050fe12

fix condition

9610d4ad

Channelwise fix

918a8477

clean-up

79a23ff3

remove print

6d6f3205

clean-up; add test cases

c74730a7

dsikka force pushed to c74730a7 251 days ago

fix tets

c4295353

remove extra condition

e90276a8

swap order

43d81434

Format

485d1e9f

mgoin added quantization

mgoin added ready

mgoin approved these changes on 2025-04-15

fix test value

3b12a0ac

Remove todo

4fe26f6f

mgoin merged 54a66e5f into main 250 days ago

dsikka deleted the update_ct_wna16 branch 221 days ago

Reviewers

mgoin

brian-dellabetta

robertgshaw2-redhat

tlrmchlsmth

Assignees

No one assigned

Labels

ready

Milestone

No milestone

vllm [Misc] Update `compressed-tensors` WNA16 to support zero-points #14211 Merged

[Misc] Update `compressed-tensors` WNA16 to support zero-points #14211

vllm
[Misc] Update `compressed-tensors` WNA16 to support zero-points
#14211

Merged