lighteval
Adding a range of multilingual evals
#832
Open

Adding a range of multilingual evals #832

clefourrier wants to merge 15 commits into main from clem_mmlupro
clefourrier
clefourrier added instruct specific evals
5b3cd265
clefourrier tmp
75af52df
clefourrier fix
ffa43ccb
clefourrier fix
a94973a2
clefourrier tmp
2852db8d
clefourrier clefourrier marked this pull request as draft 1 year ago
clefourrier focused data on actually existing languages
a549107c
lewtun
lewtun commented on 2025-06-26
clefourrier Fix GPQA and index extractive metric (#829)
031e09ce
spyysalo Complete TranslationLiterals for Language.ESTONIAN (#779)
bc5a5641
clefourrier belebele split
bae95440
clefourrier updated prompts/instruction management
78a5c238
clefourrier tmp
91ad5737
clefourrier clefourrier force pushed from ac99d101 to 91ad5737 1 year ago
clefourrier added enforce eager
6f5d92f1
clefourrier small prompt fix
2a108268
clefourrier one file per eval
2114c616
clefourrier adding mgsm
ee6149e9
clefourrier

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone