text-generation-inference
00f36535 - Update response type for `/v1/chat/completions` and `/v1/completions` (#1747)

Commit
1 year ago
Update response type for `/v1/chat/completions` and `/v1/completions` (#1747) `/v1/chat/completions` and `/v1/completions` have different output types depending on the `stream` parameter. This PR aims at fixing the inconsistency in the auto-generated [openapi.json](https://huggingface.github.io/text-generation-inference/openapi.json) specs. cc @OlivierDehaene @drbh I reused what had been done for the `/` endpoint but haven't tested anything myself. Could you confirm this is the correct way of handling things? Also, should I update the openapi.json file manually? If yes, how can I do it?
Author
Parents
Loading