llama.cpp
6da5bec8 - rpc : better caching of the base buffer pointer (#11331)

Commit

233 days ago

rpc : better caching of the base buffer pointer (#11331) There is no need to use map, just store the base pointer in the buffer context.

References

Author

rgerganov

Parents