llama.cpp
be7bd6b5 - move llama_context_device_memory function to llama-ext.h

Commit

2 days ago

move llama_context_device_memory function to llama-ext.h

References

#21231 - server: add router device memory margin parameter for dynamic unloading

Author

0cc4m

0cc4m

Committer

0cc4m

0cc4m

Parents

Loading