llama.cpp
0a319bb7 - metal : add support for non-padded FA KV (#16148)

Commit
32 days ago
metal : add support for non-padded FA KV (#16148) * metal : pad K, V and Mask when needed * cont : simplify * cuda : add TODO about KV padding requirement * metal : add comments * metal : remove mask padding requirement
Author
Parents
Loading