PR #530 Multi node vLLM

Multi node vLLM #530

ncassereau wants to merge 11 commits into huggingface:main from ncassereau:multi_node_vllm

Solved an issue where lighteval vllm would hang indefinitely in multi…

ed023bcd

Allows using custom OpenAI endpoint (for instance with vLLM)

c6636283

Added documentation for lighteval vllm and an example for the lost souls

b42ec3f8

Added documentation for lighteval endpoint with vllm serve backend an…

a5ad8b5f

ncassereau force pushed from f017ca0f to a5ad8b5f 1 year ago

clefourrier commented on 2025-02-06

clefourrier approved these changes on 2025-02-06

Merge branch 'main' into multi_node_vllm

0456886e

Merge branch 'main' into multi_node_vllm

79faff44

NathanHB commented on 2025-02-20

NathanHB approved these changes on 2025-02-20

NathanHB commented on 2025-02-20

Apply suggestions from code review

0c41fad5

Remove useless env variable

b0a50606

Remove JZ acct

eea55d93

use more official bench

4ebcc852

Merge branch 'main' into multi_node_vllm

0acbe339

Reviewers

NathanHB

clefourrier

Assignees

No one assigned

Labels

None yet

Milestone

No milestone