vllm
b33c8a65
- [Bugfix][Frontend] Keep length finish_reason for max_tokens-truncated streaming tool calls (#46303)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
54 days ago
[Bugfix][Frontend] Keep length finish_reason for max_tokens-truncated streaming tool calls (#46303) Signed-off-by: Ting Sun <suntcrick@gmail.com>
References
#46303 - [Bugfix][Frontend] Keep length finish_reason for max_tokens-truncated streaming tool calls
Author
Sunt-ing
Parents
de6674b0
Loading