vllm
66d433b9 - [V1] Revert the default `max_num_seqs` to V0 values for most hardware (#16158)

Commit

250 days ago

[V1] Revert the default `max_num_seqs` to V0 values for most hardware (#16158) Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

References

Author

DarkLight1337

Parents