llama.cpp
d6e7b033 - llama : add option to save memory in device buffers (#22679)

Commit

7 days ago

llama : add option to save memory in device buffers (#22679) * llama : add option to save memory in device buffers * tests : extend llama-save-load-state

References

#22679 - llama : add option to save memory in device buffers

Author

ggerganov

Parents

fa595462

llama.cpp d6e7b033 - llama : add option to save memory in device buffers (#22679)

llama.cpp
d6e7b033 - llama : add option to save memory in device buffers (#22679)