Adding custom metric system + IFEval as an example #48
clefourrier
merged
15 commits into
main
from
clem_customizable_metrics
init ifeval, now need to add loading custom metric system
89e7fda5
Merge branch 'main' into clem_customizable_metrics
96aa81b3
custom metrics working! need to update the readme
2fdceb82
update doc
0e30b215
clefourrier
changed the title
clefourrier
changed the title 
fix eos token + eval script
1ba178f1
lewtun
commented
on 2024-02-23
NathanHB
commented
on 2024-02-25
Update tasks_examples/custom_tasks_with_custom_metrics/ifeval/ifeval.py
53c11587
Merge branch 'main' into clem_customizable_metrics
92f72aa5
changed eos token
885541b1
Merge branch 'clem_customizable_metrics' of github.com:huggingface/li…
75e29ab8
wip
7c8ef073
lewtun
commented
on 2024-02-28
lewtun
commented
on 2024-02-28
Merge branch 'main' into clem_customizable_metrics
9da1282c
Merge branch 'main' into clem_customizable_metrics
645c82a3
more info about new tasks
8b966111
Merge branch 'clem_customizable_metrics' of github.com:huggingface/li…
ddc741f8
fix
983e8d1e
NathanHB
approved these changes
on 2024-02-28
Login to write a write a comment.
Login via GitHub