vllm
[Rust Frontend] Truncate prompts against max_model_len like Python
#62642

Merged

Commits

[Rust Frontend] Truncate prompts against max_model_len like Python

BugenZhao committed 12 days ago
Merge branch 'main' into bz/rust-parity-truncate-prompt-budget

vllm-agent committed 12 days ago

Loading