llama.cpp
68e210b3 - server : enable continuous batching by default (#6231)

Commit

1 year ago

server : enable continuous batching by default (#6231)

References

#6231 - server : enable continuous batching by default

Author

ggerganov

ggerganov

Parents

Loading