PR #9713 ggml : add metal backend registry / device

ggml : add metal backend registry / device #9713

ggerganov merged 17 commits into master from sl/backend-registry-2-add-metal

github-actions added ggml

github-actions added Apple Metal

ggerganov changed the title ~~ggml-backend : add device and backend reg interfaces~~ ggml : add metal backend registry / devic 1 year ago

ggerganov changed the title ~~ggml : add metal backend registry / devic~~ ggml : add metal backend registry / device 1 year ago

ggerganov force pushed from 37de34c5 to a62ea59c 1 year ago

github-actions added script

github-actions added testing

github-actions added Nvidia GPU

github-actions added nix

github-actions added Vulkan

github-actions added examples

github-actions added python

github-actions added devops

github-actions added server

github-actions added SYCL

github-actions added Kompute

ggerganov changed the base branch from sl/backend-registry-2 to master 1 year ago

ggerganov force pushed to ae9fd54c 1 year ago

ggerganov force pushed from 058430f2 to ae56ec25 1 year ago

mmtmn approved these changes on 2024-10-04

ggerganov commented on 2024-10-04

slaren force pushed 1 year ago

slaren force pushed to 84c3b2a7 1 year ago

ggml : add metal backend registry / device

62146006

metal : fix names [no ci]

2d8c2c79

metal : global registry and device instances

2e7e05c0

cont : alternative initialization of global objects

c080e92e

llama : adapt to backend changes

4ef1b017

fixes

5ea66f43

metal : fix indent

4b161bc6

metal : fix build when MTLGPUFamilyApple3 is not available

6dcb8991

ggerganov force pushed from 84c3b2a7 to 6dcb8991 1 year ago

ggerganov marked this pull request as ready for review 1 year ago

ggerganov requested a review from

slaren 1 year ago

fix merge

b150ffad

slaren commented on 2024-10-06

metal : avoid unnecessary singleton accesses

5f71096e

metal : minor fix [no ci]

1bd5018c

metal : g_state -> g_ggml_ctx_dev_main [no ci]

34e0e6ea

metal : avoid reference of device context in the backend context

70ff50d7

metal : minor [no ci]

2bd826de

Merge remote-tracking branch 'origin/master' into sl/backend-registry…

a70379d9

slaren approved these changes on 2024-10-07

metal : fix maxTransferRate check

2294f078

metal : remove transfer rate stuff

901691c2

ggerganov merged d5ac8cf2 into master 1 year ago

ggerganov deleted the sl/backend-registry-2-add-metal branch 1 year ago

Reviewers

slaren

mmtmn

Assignees

No one assigned

Labels

script testing Nvidia GPU nix Vulkan examples python devops server ggml SYCL Apple Metal Kompute

Milestone

No milestone

llama.cpp ggml : add metal backend registry / device #9713 Merged

ggml : add metal backend registry / device #9713

llama.cpp
ggml : add metal backend registry / device
#9713

Merged