llama.cpp
vulkan: tune mat-vec rows for batched inference on Strix Halo
#27909
Merged

vulkan: tune mat-vec rows for batched inference on Strix Halo #27909

SimonTeixidor
SimonTeixidor SimonTeixidor requested a review 56 days ago
github-actions github-actions added Vulkan
github-actions github-actions added ggml
SimonTeixidor
SimonTeixidor commented on 2026-08-28
0cc4m
0cc4m approved these changes on 2026-08-30
SimonTeixidor vulkan: RDNA3 static mat-vec rows above four columns
0e4cea93
SimonTeixidor vulkan: RDNA3 static mat-vec-id rows
6709f1ef
SimonTeixidor SimonTeixidor force pushed to 6709f1ef 54 days ago
0cc4m
0cc4m approved these changes on 2026-08-30
0cc4m
0cc4m 0cc4m added merge ready
ggerganov
ggerganov ggerganov merged 2cdae802 into master 54 days ago
ggerganov
0cc4m
ggerganov
ggerganov
ggerganov
0cc4m
ggerganov
ggerganov
0cc4m
ggerganov
jeffbolznv
jeffbolznv

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone