text-generation-inference

06c3d4b1 - feat: accept list as prompt and use first string (#1702)

feat: accept list as prompt and use first string (#1702) This PR allows the `CompletionRequest.prompt` to be sent as a string or array of strings. When an array is sent the first value will be used if it's a string; otherwise the according error will be thrown Fixes: https://github.com/huggingface/text-generation-inference/issues/1690 Similar to: https://github.com/vllm-project/vllm/pull/323/files