huggingface/lighteval

Pull Requests Commits

Update README.md

clefourrier committed 345 days ago

Verified 116538cc

Update README.md

clefourrier committed 345 days ago

Verified cef4ac5e

Update README.md

clefourrier committed 345 days ago

Verified c4f9e924

clefourrier committed 345 days ago

Verified 441d7a4a

Make BLEURT lazy (#536)

hynky1999 committed 345 days ago

Verified 15bdbb81

Add GPQA for instruct models (#534)

lewtun committed 346 days ago

Verified 1ce7331f

Sync Math-verify (#535)

hynky1999 committed 346 days ago

Verified cb35beae

Add custom task (bac-fr) for evaluation of models in french (#518)

mdiazmel committed 348 days ago

Verified d7a1f112

Update french_evals.py

clefourrier committed 348 days ago

Verified be7da176

adds olympiad bench (#521)

NathanHB committed 351 days ago

Verified d332207b

Improve readability of the quick tour. (#501)

vxw3t8fhjsdkghvbdifuk committed 352 days ago

Verified 515bd01d

Implemented the possibility to load predictions from details files and continue evaluating from there (#488)

JoelNiklaus committed 353 days ago

Verified 94fc5a28

add missing inits (#524)

hynky1999 committed 353 days ago

Verified 48d0c284

Math extraction - allow only trying the first match, more customizable latex extraction + bump deps (#522)

hynky1999 committed 354 days ago

Verified 0e462692

Fixing commonsense qa: generative metrics, -1 gen length (#517)

clefourrier committed 356 days ago

Verified cb075a54

Fix Ukrainian indices and confirmation word (#516)

ayukh committed 356 days ago

Verified 499cc820

Fixed bug of import url_to_fs from fsspec (#507) (#512)

LoserCheems committed 358 days ago

Verified 4f381b35

Bump up the latex2sympy2_extended version + more tests (#510)

hynky1999 committed 359 days ago

Verified 0ab63d01

Support custom results/details push to hub (#457)

albertvillanova committed 359 days ago

Verified c82143a4

Add custom tasks for evaluation of french models (#505)

mdiazmel committed 359 days ago

Verified 7028af37

llm_as_a_judge_for_oallv2_arabic (#498)

Manel-Hik committed 359 days ago

Verified 620873b5

Relax upper bound on torch (#508)

lewtun committed 359 days ago

Verified 5f5bed52

Translate task template to Catalan and Galician and fix typos (#506)

mariagrandury committed 360 days ago

Verified 1ae2fa28

Made judge response processing more robust. (#491)

JoelNiklaus committed 362 days ago

Verified 01405785

feat: add asian language support to CorpusLevelTranslationMetric (#479)

ryan-minato committed 362 days ago

Verified be18ae59

Hotfix for litellm judge (#490)

JoelNiklaus committed 362 days ago

Verified fee2ec32

Fixed issue with o1 in litellm. (#493)

JoelNiklaus committed 362 days ago

Verified 3b89734c

Fix math extraction (#503)

hynky1999 committed 364 days ago

Verified 90d44c1e

Extractive Match metric (#495)

hynky1999 committed 1 year ago

Verified 59624c88

fix README link (#500)

vxw3t8fhjsdkghvbdifuk committed 1 year ago

Verified a7aa6edb

Older