llama.cpp
Reset schedule earlier to allow overlap with ggml graph computation on device
#6933
Merged

Commits
  • Reset schedule earlier to allow overlap with graph computation on device
    agray3 committed 2 years ago
  • moved reset to end of llama_decode_internal
    agray3 committed 2 years ago
  • style fix
    slaren committed 2 years ago
Loading