vllm
16cfe728 - [Bugfix][Rust Frontend] Reject n > 1 in the `/inference/v1/generate` route (#52844)

Commit
1 day ago
[Bugfix][Rust Frontend] Reject n > 1 in the `/inference/v1/generate` route (#52844) Co-authored-by: Bugen Zhao <i@bugenzhao.com> Signed-off-by: Quentin Gallouédec <quentin.gallouedec@huggingface.co> Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Author
Parents
Loading