lighteval
1607dc10
- Adds multimodal support and MMMU pro (#675)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
212 days ago
Adds multimodal support and MMMU pro (#675) ``` uv run lighteval accelerate "model_name=HuggingFaceTB/SmolVLM-Instruct" "lighteval|mmmu_pro|0|0" --use-chat-template --vision-model ``` --------- Co-authored-by: qubvel <qubvel@gmail.com>
References
#675 - Adds multimodal support and MMMU pro
Author
NathanHB
Parents
63be4b0f
Loading