text-generation-inference
e36dfaa8 - feat: allow tool calling to respond without a tool (#2614)

Commit
1 year ago
feat: allow tool calling to respond without a tool (#2614) * feat: process token stream before returning to client * fix: expect content in test * fix: improve comparison via ruff lint * fix: return event in all cases * fix: always send event on error, avoid unwraps, refactor and improve tests * fix: prefer no_tool over notify_error to improve reponse * fix: adjust chat input test for no_tool * fix: adjust test expected content --------- Co-authored-by: System administrator <root@ip-10-90-0-186.ec2.internal>
Author
Parents
Loading