transformers
GGUF: optional Metal dequant fast path via kernels-community
#45975

Open

Commits

GGUF: optional Metal dequant fast path via kernels-community/gguf-dequant

ArthurZucker committed 44 days ago
serve: auto-select metal-flash-sdpa attention on MPS

ArthurZucker committed 44 days ago
Point Metal kernel repo to ArthurZ/gguf-dequant until transfer to kernels-community

ArthurZucker committed 44 days ago