huggingface/lighteval

Pull Requests Commits
Fix VLLM data-parallel (#541)
hynky1999 committed 1 year ago
Verified 86f62259
Bug fix extractive match (#540)
hynky1999 committed 1 year ago
Verified 3c9b0c9d
Update README.md (#539)
clefourrier committed 1 year ago
Verified f8405eee
Pass@k (#519)
clefourrier committed 1 year ago
Verified 441d7a4a
Make BLEURT lazy (#536)
hynky1999 committed 1 year ago
Verified 15bdbb81
Add GPQA for instruct models (#534)
lewtun committed 1 year ago
Verified 1ce7331f
Sync Math-verify (#535)
hynky1999 committed 1 year ago
Verified cb35beae
Add custom task (bac-fr) for evaluation of models in french (#518)
mdiazmel committed 1 year ago
Verified d7a1f112
Update french_evals.py
clefourrier committed 1 year ago
Verified be7da176
adds olympiad bench (#521)
NathanHB committed 1 year ago
Verified d332207b
Improve readability of the quick tour. (#501)
vxw3t8fhjsdkghvbdifuk committed 1 year ago
Verified 515bd01d
Implemented the possibility to load predictions from details files and continue evaluating from there (#488)
JoelNiklaus committed 1 year ago
Verified 94fc5a28
add missing inits (#524)
hynky1999 committed 1 year ago
Verified 48d0c284
Math extraction - allow only trying the first match, more customizable latex extraction + bump deps (#522)
hynky1999 committed 1 year ago
Verified 0e462692
Fixing commonsense qa: generative metrics, -1 gen length (#517)
clefourrier committed 1 year ago
Verified cb075a54
Fix Ukrainian indices and confirmation word (#516)
ayukh committed 1 year ago
Verified 499cc820
Fixed bug of import url_to_fs from fsspec (#507) (#512)
LoserCheems committed 1 year ago
Verified 4f381b35
Bump up the latex2sympy2_extended version + more tests (#510)
hynky1999 committed 1 year ago
Verified 0ab63d01
Support custom results/details push to hub (#457)
albertvillanova committed 1 year ago
Verified c82143a4
Add custom tasks for evaluation of french models (#505)
mdiazmel committed 1 year ago
Verified 7028af37
llm_as_a_judge_for_oallv2_arabic (#498)
Manel-Hik committed 1 year ago
Verified 620873b5
Relax upper bound on torch (#508)
lewtun committed 1 year ago
Verified 5f5bed52
Translate task template to Catalan and Galician and fix typos (#506)
mariagrandury committed 1 year ago
Verified 1ae2fa28
Made judge response processing more robust. (#491)
JoelNiklaus committed 1 year ago
Verified 01405785
feat: add asian language support to CorpusLevelTranslationMetric (#479)
ryan-minato committed 1 year ago
Verified be18ae59
Hotfix for litellm judge (#490)
JoelNiklaus committed 1 year ago
Verified fee2ec32
Fixed issue with o1 in litellm. (#493)
JoelNiklaus committed 1 year ago
Verified 3b89734c
Fix math extraction (#503)
hynky1999 committed 1 year ago
Verified 90d44c1e
Extractive Match metric (#495)
hynky1999 committed 1 year ago
Verified 59624c88
fix README link (#500)
vxw3t8fhjsdkghvbdifuk committed 1 year ago
Verified a7aa6edb
Terms Of Use Privacy Policy Refund Policy Impressum