vllm
[Bugfix][Kernel] Fix per-token/per-channel quantization for Hopper scaled mm
#12696

Merged

[Bugfix][Kernel] Fix per-token/per-channel quantization for Hopper scaled mm #12696

simon-mo merged 2 commits into vllm-project:main from neuralmagic:fix_cutlass_group_checks

Fix per-token/per-channel quantization for Hopper scaled mm

fd8f32fd

mergify added needs-rebase

Merge branch 'main' into fix_cutlass_group_checks

be7888da

mergify removed needs-rebase

tlrmchlsmth commented on 2025-02-03

tlrmchlsmth marked this pull request as ready for review 318 days ago

robertgshaw2-redhat approved these changes on 2025-02-03

LucasWilkinson approved these changes on 2025-02-03

tlrmchlsmth added ready

mgoin approved these changes on 2025-02-03

simon-mo merged c11de33d into main 318 days ago

Reviewers

mgoin

LucasWilkinson

robertgshaw2-redhat

Assignees

No one assigned

Labels

ready

Milestone

No milestone