completion endpoint in streaming mode
#15007

Merged

Fix: flush partial stop string when <EOG> is reached in /completion endpoint in streaming mode #15007

ggerganov merged 1 commit into ggml-org:master from matteoserva:fix_stop_bug

matteoserva requested a review from

ngxson 213 days ago

github-actions added examples

github-actions added server

matteoserva changed the title ~~flush partial stop string when <EOG> is reached in /completion endpoint in streaming mode~~ Fix: flush partial stop string when <EOG> is reached in /completion endpoint in streaming mode 212 days ago

matteoserva force pushed 192 days ago

matteoserva force pushed 176 days ago

matteoserva force pushed 133 days ago

matteoserva requested a review from

ggerganov 133 days ago

ggerganov approved these changes on 2025-10-20

send partial stop string when <EOG> is reached

821251ee

matteoserva force pushed to 821251ee 130 days ago

ggerganov merged 8cf6b42d into master 130 days ago

Reviewers

ggerganov

ngxson

Assignees

No one assigned

Labels

examples server

Milestone

No milestone

llama.cpp Fix: flush partial stop string when <EOG> is reached in /completion endpoint in streaming mode #15007 Merged

Fix: flush partial stop string when <EOG> is reached in /completion endpoint in streaming mode #15007

llama.cpp
Fix: flush partial stop string when <EOG> is reached in /completion endpoint in streaming mode
#15007

Merged