llama.cpp
da6e2bac - add pop_deferred_task with specific ID version

Commit

239 days ago

add pop_deferred_task with specific ID version

References

#18789 - server: improve slots scheduling for n_cmpl

#80 - [Mirror] server: improve slots scheduling for n_cmpl

Author

ngxson

ngxson

Parents

Loading