PR #829 Fix GPQA and index extractive metric

Fix GPQA and index extractive metric #829

clefourrier merged 7 commits into main from clem_fix_templates

too many false positives with the current gpqa metric extraction, mak…

448859c6

fixing whitespace and instruction in prompt

5cc26070

Merge branch 'main' into clem_fix_templates

b2eb5bc8

clefourrier requested a review from

copilot-pull-request-reviewer 207 days ago

copilot-pull-request-reviewer commented on 2025-06-24

clefourrier requested a review from

hynky1999 207 days ago

better to have a strict extraction for index extraction in general ac…

9c55b986

added comment

47857e48

clefourrier changed the title ~~Fix GPQA~~ Fix GPQA and index extractive metric 207 days ago

fix tests, need to invert condition

00988bb8

Merge branch 'main' into clem_fix_templates

65bc25d9

clefourrier requested a review from

NathanHB 206 days ago

hynky1999 approved these changes on 2025-06-25

clefourrier merged 50c78a2e into main 205 days ago

NathanHB added bug

Reviewers

hynky1999

NathanHB

Assignees

No one assigned

Labels

bug

Milestone

No milestone