llama.cpp
Fix: flush partial stop string when <EOG> is reached in /completion endpoint in streaming mode
#15007
Merged
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
1
Changes
View On
GitHub
Commits
send partial stop string when <EOG> is reached
matteoserva
committed
132 days ago
Loading