llama.cpp
55b62bce - llama : reuse device buffers when possible

Commit

53 days ago

llama : reuse device buffers when possible

References

#22838 - spec : parallel drafting support

Author

ggerganov

ggerganov

Parents

Loading