llama.cpp
31cfbb10 - Expose generation timings from server & update completions.js (#2116)

Commit
2 years ago
Expose generation timings from server & update completions.js (#2116) * use javascript generators as much cleaner API Also add ways to access completion as promise and EventSource * export llama_timings as struct and expose them in server * update readme, update baked includes * llama : uniform variable names + struct init --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Author
Parents
Loading