lighteval
[MATH] Fix generation for chat models & fix normalization for predictions
#163
Merged
Merged
[MATH] Fix generation for chat models & fix normalization for predictions #163
clefourrier
merged
16 commits into
main
from
fix-math-chat
Fix _fix_fracs in MATH normalization
98c41c65
Refactor
a8fa3f56
Clean
12c3fb66
Add docstring
8a3cbe06
Fix generation for chat models
726acfbf
Use same normaliser for predictions and golds
ea368dab
Merge branch 'main' into fix-math-chat
a9009cda
lewtun
commented
on 2024-04-20
Handle case when text is None
a5b4fd77
lewtun
commented
on 2024-04-20
Fix _remove_right_units
9195769d
NathanHB
commented
on 2024-04-26
better stop token managment when using chat templates
34b7595a
NathanHB
commented
on 2024-04-26
Merge branch 'main' into fix-math-chat
fe416488
Merge branch 'main' into fix-math-chat
7f80b211
Fix prompt formatting
c232d8df
edit metrics
63eeca7b
fix test, separate math and math cot
f6f50092
Merge branch 'main' into fix-math-chat
869ad787
clefourrier
approved these changes
on 2024-05-04
Login to write a write a comment.
Login via GitHub