PR #835 Adding mmlu pro

Adding mmlu pro #835

clefourrier merged 7 commits into model_release from mmlu_pro

adding mmlu pro

1fcd1444

updated regexes

67f36234

reverting prompt

5e130659

adding assistant prefix option

92950e17

more extraction fixing

4449200b

clefourrier requested a review from

lewtun 179 days ago

clefourrier commented on 2025-06-27

lewtun commented on 2025-06-27

remove the prefill

f42791de

removing the assistant prefix to be on the safe side

567ca2cf

lewtun approved these changes on 2025-06-27

clefourrier merged 87cdf289 into model_release 179 days ago

Reviewers

lewtun

Assignees

No one assigned

Labels

None yet

Milestone

No milestone