llama.cpp
d0132a68 - rpc : implement event and async backend APIs (#18626)

Commit

75 days ago

rpc : implement event and async backend APIs (#18626) * rpc : implement event and async backend APIs * cache responses from RPC_CMD_GET_ALLOC_SIZE

References

Author

rgerganov

Parents