llama.cpp
CUDA: MMQ support for iq4_nl, iq4_xs
#8278
Merged

CUDA: MMQ support for iq4_nl, iq4_xs #8278

JohannesGaessler
JohannesGaessler CUDA: MMQ support for iq4_nl, iq4_xs
382e3410
github-actions github-actions added Nvidia GPU
github-actions github-actions added python
mofosyne mofosyne added Review Complexity : High
ExtReMLapin
JohannesGaessler
slaren
slaren approved these changes on 2024-07-04
JohannesGaessler JohannesGaessler merged 8e558309 into master 1 year ago
nitinrathi
nitinrathi
Green-Sky
JohannesGaessler
nitinrathi
JohannesGaessler
JohannesGaessler
nitinrathi
nitinrathi
nitinrathi

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone