text-generation-inference
8542e2b7 - feat: Make streaming for tool calling behave the same as the open ai api

Commit
1 year ago
feat: Make streaming for tool calling behave the same as the open ai api The streaming API for tool calling now starts when the name is parsed and then send arguments as token are generated and stops properly.
Author
Committer
Parents
Loading