completion endpoint in streaming mode
#15007

Merged

Fix: flush partial stop string when <EOG> is reached in /completion endpoint in streaming mode #15007

ggerganov merged 1 commit into ggml-org:master from matteoserva:fix_stop_bug

matteoserva requested a review from

ngxson 1 year ago

github-actions added examples

github-actions added server

matteoserva changed the title ~~flush partial stop string when <EOG> is reached in /completion endpoint in streaming mode~~ Fix: flush partial stop string when <EOG> is reached in /completion endpoint in streaming mode 1 year ago

matteoserva force pushed 1 year ago

matteoserva force pushed 362 days ago

matteoserva requested a review from

ggerganov 362 days ago

ggerganov approved these changes on 2025-10-20

send partial stop string when <EOG> is reached

821251ee

matteoserva force pushed to 821251ee 359 days ago

ggerganov merged 8cf6b42d into master 359 days ago

Reviewers

ggerganov

ngxson

Assignees

No one assigned

Labels

examples server

Milestone

No milestone

llama.cpp Fix: flush partial stop string when <EOG> is reached in /completion endpoint in streaming mode #15007 Merged

Fix: flush partial stop string when <EOG> is reached in /completion endpoint in streaming mode #15007

llama.cpp
Fix: flush partial stop string when <EOG> is reached in /completion endpoint in streaming mode
#15007

Merged