huggingface/lighteval

Pull Requests Commits
Add maj@k metric (#158)
clefourrier committed 2 years ago
Verified 0a455c4f
Merge branch 'main' into nathan-add-cli-tool
NathanHB committed 2 years ago
Verified 604684e1
fix nanotron launcher
NathanHB committed 2 years ago
fa82b130
Revert "fix nanotron launcher"
NathanHB committed 2 years ago
5c099172
fix nanotron launcher
NathanHB committed 2 years ago
40df0c26
fix
NathanHB committed 2 years ago
d6f60926
fix style
NathanHB committed 2 years ago
bcf834c7
fix tests
NathanHB committed 2 years ago
46c5ab2e
add 'cite as' section in readme (#178)
NathanHB committed 2 years ago
Verified 98060932
Fix prompt format german rag community task (#171)
jphme committed 2 years ago
Verified af35e886
uppdate doc
Nathan Habib committed 2 years ago
ecf98d29
working
Nathan Habib committed 2 years ago
ddbb748a
undo
NathanHB committed 2 years ago
2d15999f
small fixes
NathanHB committed 2 years ago
add6e6f5
no function we actually use should be named prompt_fn (#168)
clefourrier committed 2 years ago
Verified 11b48333
add files
NathanHB committed 2 years ago
a128176d
fix style
NathanHB committed 2 years ago
5db6049a
fix tests
NathanHB committed 2 years ago
16fe94ef
working with accelerate
NathanHB committed 2 years ago
819d27ec
[MATH] Fix MATH normalization (#162)
lewtun committed 2 years ago
Verified fc428f60
Nathan add logging to metrics (#157)
NathanHB committed 2 years ago
Verified 6a48e4e7
Merge remote-tracking branch 'origin/main' into nathan-add-cli-tool
NathanHB committed 2 years ago
70cc52c4
Fix nanotron models input size bug (#156)
clefourrier committed 2 years ago
Verified 6ea07cd7
CLI list tasks (#142)
DimbyTa committed 2 years ago
Verified f28a270a
Merge remote-tracking branch 'origin/main' into nathan-add-cli-tool
Nathan Habib committed 2 years ago
d59dd2c0
Add llm as judge in metrics (#146)
NathanHB committed 2 years ago
Verified 7f6f8077
Added Namespace parameter for InferenceEndpoints, added option for passing model config directly (#147)
shaltielshmid committed 2 years ago
Verified 23987aa7
make style
Nathan Habib committed 2 years ago
54486ae3
add nanotron to lighteval cli
Nathan Habib committed 2 years ago
a35305a5
init
Nathan Habib committed 2 years ago
29e5cb88
Terms Of Use Privacy Policy Refund Policy Impressum