llama.cpp
25781383 - llama: improve TENSOR_READ_LAZY handling (#27837)

Commit

48 days ago

llama: improve TENSOR_READ_LAZY handling (#27837) * force lazy tensor on cpu if lazy is on * llama: improve TENSOR_READ_LAZY handling

References

Author

ngxson

Parents