lighteval
Add MCQ support to Yourbench evaluation
#734
Merged

Add MCQ support to Yourbench evaluation #734

alozowski merged 9 commits into main from mcq-support-yourbench
alozowski
alozowski Add MCQ support to Yourbench evaluation
9deb4020
alozowski alozowski requested a review from clefourrier clefourrier 293 days ago
alozowski alozowski requested a review from NathanHB NathanHB 293 days ago
HuggingFaceDocBuilderDev
alozowski Apply Ruff to custom_yourbench_task_mcq.py
df19a810
clefourrier
clefourrier commented on 2025-05-16
alozowski Update custom_yourbench_task_mcq.py to use ExactMatches
e90c74d3
alozowski Remove XML prompt format and unused metadata fields
9c0fff62
NathanHB NathanHB added task-update
alozowski Merge remote-tracking branch 'origin/main' into mcq-support-yourbench
c7f4ae90
NathanHB
NathanHB commented on 2025-05-19
hynky1999 fix extractive match to accept (A) (#746)
74df0b1c
alozowski Update custom_yourbench_task_mcq to use multilingual_extractive_match…
fc82f573
alozowski Fix a typo in test_extractive_match.py
3e332423
clefourrier
clefourrier approved these changes on 2025-05-20
alozowski Remove dot in test_extractive_match.py
af31fadb
alozowski alozowski merged 317cb504 into main 288 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone