PR #16634 metal : initial Metal4 tensor API support

metal : initial Metal4 tensor API support #16634

ggerganov merged 13 commits into master from gg/metal-mul-mm-rework

github-actions added testing

github-actions added ggml

github-actions added Apple Metal

ggerganov force pushed to 6726e53e 163 days ago

ggerganov force pushed from 6726e53e to 57fa8153 161 days ago

ggerganov marked this pull request as ready for review 161 days ago

ggerganov requested a review from

slaren 161 days ago

ggerganov force pushed from 9fce2447 to f2927f46 153 days ago

ggerganov force pushed from f2927f46 to 738b9163 146 days ago

metal : rework mat-mat multiplication

a4ec817d

metal : initial Metal4 support

6e0b06af

cont

49319349

metal : detect tensor support

9039cb9d

cont : better ifdefs

d9cd31cd

metal : support tensors in mul_mm_id

c30d5c3f

metal : add env for disabling tensor API

ab307c60

tests : restore

e86810a4

metal : remove unused constants

ee6b086c

metal : fix check for bfloat tensor support

e6aa68a4

ggerganov force pushed from 738b9163 to e6aa68a4 145 days ago

cont : handle API incompatibilities

9af8394e

cont : handle even more incompatibilities

afebf27f

ggerganov force pushed to afebf27f 145 days ago

metal : use tensor API only on M5 and later

3d9a497a

ggerganov merged 5b180c3d into master 144 days ago

ggerganov deleted the gg/metal-mul-mm-rework branch 144 days ago

Reviewers

slaren

Assignees

No one assigned

Labels

testing ggml Apple Metal

Milestone

No milestone

llama.cpp metal : initial Metal4 tensor API support #16634 Merged

metal : initial Metal4 tensor API support #16634

llama.cpp
metal : initial Metal4 tensor API support
#16634

Merged