vllm
3aee6573 - [V1] Aggregate chunked prompt logprobs in model runner (#14875)

Commit

263 days ago

[V1] Aggregate chunked prompt logprobs in model runner (#14875) Signed-off-by: Nick Hill <nhill@redhat.com>

References

Author

njhill

Parents