vllm
b111f8a6 - fix(security): Add VLLM_MAX_N_SEQUENCES environment variable and enforce limit (#37952)

Commit
8 days ago
fix(security): Add VLLM_MAX_N_SEQUENCES environment variable and enforce limit (#37952) Signed-off-by: jperezde <jperezde@redhat.com> Signed-off-by: Russell Bryant <rbryant@redhat.com> Co-authored-by: Russell Bryant <rbryant@redhat.com>
Parents
Loading