vllm
[Bugfix] gptq_marlin: Ensure g_idx_sort_indices is not a Parameter
#5108

Merged

[Bugfix] gptq_marlin: Ensure g_idx_sort_indices is not a Parameter #5108

robertgshaw2-redhat merged 2 commits into vllm-project:main from neuralmagic:marlin_bug

gptq_marlin: Fix bug report https://github.com/vllm-project/vllm/issu…

a44225e3

restore offline_inference

0b8419c3

alexm-redhat changed the title ~~gptq_marlin: Fix bug report https://github.com/vllm-project/vllm/issu…~~ [Bugfix] gptq_marlin: Ensure g_idx_sort_indices is not a Parameter 1 year ago

robertgshaw2-redhat approved these changes on 2024-05-29

robertgshaw2-redhat enabled auto-merge (squash) 1 year ago

robertgshaw2-redhat merged 5bf185a1 into main 1 year ago

robertgshaw2-redhat deleted the marlin_bug branch 1 year ago

Reviewers

robertgshaw2-redhat

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

vllm [Bugfix] gptq_marlin: Ensure g_idx_sort_indices is not a Parameter #5108 Merged

[Bugfix] gptq_marlin: Ensure g_idx_sort_indices is not a Parameter #5108

vllm
[Bugfix] gptq_marlin: Ensure g_idx_sort_indices is not a Parameter
#5108

Merged