vllm
dff80b0e - [Frontend] Add rerank support to run_batch endpoint (#16278)

Commit

194 days ago

[Frontend] Add rerank support to run_batch endpoint (#16278) Signed-off-by: Pooya Davoodi <pooya.davoodi@parasail.io>

References

Author

pooyadavoodi

Parents