llama.cpp
metal : support MTLGPUFamily < Apple7, formatting, style
#3524
Merged
Overview
Commits
5
Changes
View On GitHub

metal : support MTLGPUFamily < Apple7, formatting, style #3524

ggerganov merged 5 commits into master from metal-improve-batching
ggerganov
ggerganov metal : improve decoding speed for batches of 2-16
99ed03a2
ggerganov ggerganov added performance
ggerganov ggerganov added need feedback
jhen0409
ggerganov metal : rename kernels mul_mat_ to mul_mv_
c6002248
ggerganov
ggerganov metal : indentations
8f6ad684
ggerganov
ggerganov minor
545b0349
KerfuffleV2
slaren
ggerganov metal : print more GPU info + disable mul_mm for MTLGPUFamiliy < Apple7
6b9554a7
ggerganov ggerganov force pushed from fe6ef1c1 to 6b9554a7 1 year ago
ggerganov ggerganov changed the title metal : improve decoding speed for batches of 2-16 metal : support MTLGPUFamily < Apple7, formatting, style 1 year ago
ggerganov ggerganov merged b0ec5218 into master 1 year ago
ibehnam

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
performance need feedback
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum