llama.cpp
32e23059 - ggml : add CUDA support for batched tensor APIs

Commit

4 days ago

ggml : add CUDA support for batched tensor APIs Assisted-by: pi:llama.cpp/ggml-org/DeepSeek-V4-Flash-Vision-Exp-GGUF (Mac Studio, M2 Ultra, 192GB)

Author

ggerganov

Parents