CUDA: optimize Orin single-column MMVQ #31268
CUDA: optimize Orin single-column MMVQ
ad985565
meitmt
requested a review
23 days ago
Create a separate Orin branch in `calc_rows_per_block`
408835df
ggerganov
merged
ea84d709
into master 4 hours ago
Assignees
No one assigned
Labels
ggml
merge ready
CUDA
Login to write a write a comment.
Login via GitHub