vllm
9b459eca - [V1][Scheduler] Avoid calling `_try_schedule_encoder_inputs` for every request (#15778)

Commit
312 days ago
[V1][Scheduler] Avoid calling `_try_schedule_encoder_inputs` for every request (#15778) Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Author
Parents
Loading