llama.cpp
CLBlast: Support broadcasting for matrix multiplication and GQA
#3402
Merged

CLBlast: Support broadcasting for matrix multiplication and GQA #3402

0cc4m merged 1 commit into ggml-org:master from shibe2:cl-gqa
shibe2
shibe2 CLBlast: Add broadcast support for matrix multiplication
6ed3104b
ggerganov
ggerganov approved these changes on 2023-09-30
ggerganov ggerganov requested a review from 0cc4m 0cc4m 2 years ago
shibe2
0cc4m
0cc4m
0cc4m approved these changes on 2023-10-02
0cc4m 0cc4m merged 665018c7 into master 2 years ago
cmp-nct
shibe2

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone