vllm
090c856d - [Misc] Human-readable `max-model-len` cli arg (#16181)

Commit

68 days ago

[Misc] Human-readable `max-model-len` cli arg (#16181) Signed-off-by: NickLucche <nlucches@redhat.com> Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk> Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

References

#16181 - [Misc] Human-readable `max-model-len` cli arg

Author

NickLucche

Parents

ad434d4c

Files2

tests/engine
- test_arg_utils.py
vllm/engine
- arg_utils.py

vllm 090c856d - [Misc] Human-readable `max-model-len` cli arg (#16181)

vllm
090c856d - [Misc] Human-readable `max-model-len` cli arg (#16181)