batch` endpoint for batched chat completions (#38011)

Commit

6 days ago

Add `/v1/chat/completions/batch` endpoint for batched chat completions (#38011) Signed-off-by: Matej Rojec <64556640+MatejRojec@users.noreply.github.com>

References

#38011 - Add `/v1/chat/completions/batch` endpoint for batched chat completions

Author

MatejRojec

Parents

e6bf9f15

vllm 29080945 - Add `/v1/chat/completions/batch` endpoint for batched chat completions (#38011)

vllm
29080945 - Add `/v1/chat/completions/batch` endpoint for batched chat completions (#38011)