ngxson/llama.cpp

Pull Requests Commits

make it safer & more simple

ngxson committed 82 days ago

e4ae97b4

ui: extract visibility kick grace into a stream constant, bump to 1000 ms

ServeurpersoCom committed 82 days ago

3aa3752d

server-models: deduplicate stream lookup timeouts behind one constant

ServeurpersoCom committed 82 days ago

d34cc0e5

ui: read conv ids from IndexedDB in syncRemoteRunningStreams

ServeurpersoCom committed 82 days ago

623e1cb4

server-stream, ui: replace GET /v1/streams with POST /v1/streams/lookup

ServeurpersoCom committed 82 days ago

4d1d1242

server-stream: poll session->is_cancelled() in stream_aware_should_stop

ServeurpersoCom committed 82 days ago

e5694f32

ui: remove unused selectedModelName

ServeurpersoCom committed 82 days ago

7908d123

ServeurpersoCom committed 82 days ago

1fd6d8af

ui: address review feedback from coder543

ServeurpersoCom committed 82 days ago

81596c3d

server-http: keep request alive in detached SSE drain

ServeurpersoCom committed 82 days ago

0f9ace17

ui: fix cross-conversation contamination

ServeurpersoCom committed 82 days ago

0a2c6a9b

server-stream: fix use-after-free on rd

ServeurpersoCom committed 82 days ago

696b8561

server-context: cleaning

ServeurpersoCom committed 82 days ago

829211a1

refactor: address review feedback from ngxson

ServeurpersoCom committed 82 days ago

17c73028

server: drop magic 17, derive the X-Conversation-Id header length from sizeof at build time

ServeurpersoCom committed 82 days ago

0c1f10a1

server, ui: drop X-Stream-Resume, X-Conversation-Id alone enables the replay buffer

ServeurpersoCom committed 82 days ago

d28a4399

server: create stream session only after post_tasks succeeds

ServeurpersoCom committed 82 days ago

d4c151c4

server: SSE replay buffer, survives client disconnect

ServeurpersoCom committed 82 days ago

c3aae38c

ui: Bump packages + address build warnings (#23300)

allozaur committed 83 days ago

Verified 6db13044

ci : install libssl-dev (#23325)

CISC committed 83 days ago

Verified 4b262ab6

ci : install server kleidiai runner dependencies (#23259)

CISC committed 83 days ago

Verified 00c461ce

server-context: guarantee there is at least 1 token to decode (#23280)

ServeurpersoCom committed 83 days ago

Verified ccee4264

server : print graphs reused in slot timings (#23279)

ggerganov committed 83 days ago

Verified 3c81c8de

save-load-state : refactor tests and improve readability (#23196)

ggerganov committed 83 days ago

Verified cd963fee

llama-eval : add per-task summary stats (#23151)

ggerganov committed 83 days ago

Verified d2e179a4

ggml-webgpu : extend GDN for K>1 (#23299)

reeselevine committed 83 days ago

Verified c85a242e

[SCYL] add chapter for performance reference in SYCL.md (#23315)

arthw committed 83 days ago

Verified aabee047

convert : filter lora tensor names (#23077)

CISC committed 83 days ago

Verified f1c1c5c0

sycl: add GGML_SYCL_USE_ASYNC_MEM_OP env toggle (#22153)

aicss-genai committed 83 days ago

Verified 439f1b19

rpc : keep last_graph_uid in the device context (#23273)

rgerganov committed 83 days ago

Verified c3e9ade6

Older