PR #1211 Add support for vllm >= 0.19.0

Add support for vllm >= 0.19.0 #1211

NathanHB merged 7 commits into main from vllm-0.19-compat

Fix vLLM 0.11 compatibility and restore hellaswag_cf

e7730009

Support vLLM 0.19 prompt schema

4caaeb32

lewtun commented on 2026-04-12

Address vLLM PR review feedback

9a110250

Remove temporary hellaswag_cf task

2bc5af73

lewtun commented on 2026-04-12

lewtun requested a review from

NathanHB 92 days ago

Clarify vLLM compatibility branches

7106e88a

lewtun commented on 2026-04-13

NathanHB approved these changes on 2026-04-13

Handle tied MCQ logits in slow sample comparisons

bcb902ff

Handle flat VLM token outputs in tie checks

e8356067

NathanHB merged 34889df3 into main 91 days ago

lewtun deleted the vllm-0.19-compat branch 91 days ago

Reviewers

NathanHB

Assignees

No one assigned

Labels

None yet

Milestone

No milestone