PR #734 Add MCQ support to Yourbench evaluation

Add MCQ support to Yourbench evaluation

alozowski committed 1 year ago

Apply Ruff to custom_yourbench_task_mcq.py

alozowski committed 1 year ago

Update custom_yourbench_task_mcq.py to use ExactMatches

alozowski committed 1 year ago

Remove XML prompt format and unused metadata fields

alozowski committed 1 year ago

Merge remote-tracking branch 'origin/main' into mcq-support-yourbench

alozowski committed 1 year ago

fix extractive match to accept (A) (#746)

hynky1999 committed 1 year ago

Update custom_yourbench_task_mcq to use multilingual_extractive_match_metric and instruction

alozowski committed 1 year ago

Fix a typo in test_extractive_match.py

alozowski committed 1 year ago

Remove dot in test_extractive_match.py

alozowski committed 1 year ago

lighteval Add MCQ support to Yourbench evaluation #734 Merged