text-generation-inference
8542e2b7
- feat: Make streaming for tool calling behave the same as the open ai api
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
feat: Make streaming for tool calling behave the same as the open ai api The streaming API for tool calling now starts when the name is parsed and then send arguments as token are generated and stops properly.
Author
trofleb
Committer
drbh
Parents
9a9a763e
Loading