lighteval
Adding a range of multilingual evals
#832
Open

Adding a range of multilingual evals #832

clefourrier wants to merge 15 commits into main from clem_mmlupro
clefourrier
clefourrier added instruct specific evals
5b3cd265
clefourrier tmp
75af52df
clefourrier fix
ffa43ccb
clefourrier fix
a94973a2
clefourrier tmp
2852db8d
clefourrier clefourrier marked this pull request as draft 320 days ago
clefourrier focused data on actually existing languages
a549107c
lewtun
lewtun commented on 2025-06-26
clefourrier Fix GPQA and index extractive metric (#829)
031e09ce
spyysalo Complete TranslationLiterals for Language.ESTONIAN (#779)
bc5a5641
clefourrier belebele split
bae95440
clefourrier updated prompts/instruction management
78a5c238
clefourrier tmp
91ad5737
clefourrier clefourrier force pushed from ac99d101 to 91ad5737 319 days ago
clefourrier added enforce eager
6f5d92f1
clefourrier small prompt fix
2a108268
clefourrier one file per eval
2114c616
clefourrier adding mgsm
ee6149e9
clefourrier

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone