llama.cpp
b69f1647 - CUDA: skip fully masked-out KV in FA vec kernel (#13584)

Commit

250 days ago

CUDA: skip fully masked-out KV in FA vec kernel (#13584) * CUDA: skip fully masked-out KV in FA vec kernel

References

Author

JohannesGaessler

Parents