llama.cpp
15a68420 - cuda : enable CUDA graphs for MMID BS <= 4

Commit

4 hours ago

cuda : enable CUDA graphs for MMID BS <= 4

References

gg/cuda-graphs-enable-bs-gt1

#19645 - cuda : enable CUDA graphs for MMID 1 <= BS <= 4

Author

ggerganov

ggerganov

Parents

Loading