Add mt-bench #75
NathanHB
merged
51 commits into
main
from
nathan-add-mt-bench
init ifeval, now need to add loading custom metric system
89e7fda5
Merge branch 'main' into clem_customizable_metrics
96aa81b3
custom metrics working! need to update the readme
2fdceb82
update doc
0e30b215
fix eos token + eval script
1ba178f1
init
6233af7c
clefourrier
commented
on 2024-02-28
remove ifeval
5cc9c2c0
revert README
b9045e13
revert README
ff794802
better context management
a234bf65
working state
1357c109
fix
bb5cca2e
:Merge branch 'nathan_fix_push_details' into nathan-add-mt-bench
6b74a682
continue
f548902f
continue
2e2b15d9
commit
339f1f66
:Merge remote-tracking branch 'origin/main' into nathan-add-mt-bench
aba90b3f
Update README.md
5bc5b98e
commit
cd1300dd
commit
1fd755e9
clefourrier
commented
on 2024-03-20
commit
4b00eb7d
commit
49037557
commit
9ff0707f
commit
ff177a16
commit
9794b7c7
commit
6268ff67
commit
31eaab1b
commit
c80ef8cd
Revert "commit"
c296b63f
commit
804f41ae
remove model adapter
48b0fee5
commit
e5b6ea88
update readme
0dcdb1ef
commti
703741be
commit
6e8026fa
format
588fb2f9
format
8cb4894c
commit
c08a8f6c
fixes for review
64ceee51
make style
46d7dd8d
fix
e2f7fa8e
revert generate_response in base model
3260147c
Merge remote-tracking branch 'origin/main' into nathan-add-mt-bench
323188a6
merge
33eb2520
fix tests
b2e5895f
fix format
c42e65d3
clefourrier
commented
on 2024-03-28
clefourrier
commented
on 2024-03-28
commit
aa6c6f88
make style
bb4b1333
fix from review
2d3a04ca
fix
0819ac75
Merge branch 'main' into nathan-add-mt-bench
b2bf514d
Login to write a write a comment.
Login via GitHub