transformers
GGUF: optional Metal dequant fast path via kernels-community
#45975
Open
Open
GGUF: optional Metal dequant fast path via kernels-community #45975
ArthurZucker
wants to merge
3 commits into
update-gguf
from
gguf-metal-kernels
GGUF: optional Metal dequant fast path via kernels-community/gguf-deq…
be73645e
serve: auto-select metal-flash-sdpa attention on MPS
9fc9687b
Point Metal kernel repo to ArthurZ/gguf-dequant until transfer to ker…
b4fb5d71
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub