huggingface/lighteval

Pull Requests Commits
Merge branch 'main' into function_prompts
clefourrier committed 1 year ago
Verified f275f600
Download BERT scorer lazily (#190)
sadra-barikbin committed 1 year ago
Verified a3d1eea1
fix ruff setting + fmt
hynky1999 committed 1 year ago
cb8be215
add json casting
hynky1999 committed 1 year ago
57d40f96
add function prompt assigment
hynky1999 committed 1 year ago
58fee656
Mention HF_TOKEN in readme (#194)
Wauplin committed 1 year ago
Verified a98210fd
fix typos (#189)
kashif committed 1 year ago
Verified ad42e43b
Fix a few comment and docstring typos and a typehint (#177)
sadra-barikbin committed 1 year ago
Verified 061283f5
Fix AIMO (#186)
lewtun committed 1 year ago
Verified 981e10ac
[MATH] Fix generation for chat models & fix normalization for predictions (#163)
lewtun committed 1 year ago
Verified 60438f3c
adding aimo custom eval (#154)
NathanHB committed 1 year ago
Verified 9e3078eb
Add version config option. (#181)
PhilipMay committed 1 year ago
Verified c89b386e
Fix broken link to extended tasks in README (#182)
alexrs committed 1 year ago
Verified 979359db
Fix citation section in readme (#180)
NathanHB committed 1 year ago
Verified 6183bf22
Add maj@k metric (#158)
clefourrier committed 1 year ago
Verified 0a455c4f
add 'cite as' section in readme (#178)
NathanHB committed 1 year ago
Verified 98060932
Fix prompt format german rag community task (#171)
jphme committed 1 year ago
Verified af35e886
no function we actually use should be named prompt_fn (#168)
clefourrier committed 1 year ago
Verified 11b48333
[MATH] Fix MATH normalization (#162)
lewtun committed 1 year ago
Verified fc428f60
Nathan add logging to metrics (#157)
NathanHB committed 1 year ago
Verified 6a48e4e7
Fix nanotron models input size bug (#156)
clefourrier committed 1 year ago
Verified 6ea07cd7
CLI list tasks (#142)
DimbyTa committed 1 year ago
Verified f28a270a
Add llm as judge in metrics (#146)
NathanHB committed 1 year ago
Verified 7f6f8077
Added Namespace parameter for InferenceEndpoints, added option for passing model config directly (#147)
shaltielshmid committed 1 year ago
Verified 23987aa7
Add `Ger-RAG-eval`tasks. (#149)
PhilipMay committed 1 year ago
Verified 5a732e6c
Add fun widgets to the README (#145)
clefourrier committed 1 year ago
Verified 996b5042
Add config files for models (#131)
clefourrier committed 1 year ago
Verified efa17331
Fix max_length type in base_model.py (#138)
csarron committed 2 years ago
Verified ce087cda
commit (#137)
NathanHB committed 2 years ago
Verified 017581f7
Add mt-bench (#75)
NathanHB committed 2 years ago
Verified af24080e
Terms Of Use Privacy Policy Refund Policy Impressum