huggingface/lighteval

Pull Requests Commits

adding comments

NathanHB committed 318 days ago

7f34927d

adds chinese version

NathanHB committed 320 days ago

4396387c

adds olympiad bench

NathanHB committed 320 days ago

180daf12

adds olympiad bench

NathanHB committed 321 days ago

ca470997

Fixing commonsense qa: generative metrics, -1 gen length (#517)

clefourrier committed 322 days ago

Verified cb075a54

Fix Ukrainian indices and confirmation word (#516)

ayukh committed 323 days ago

Verified 499cc820

Fixed bug of import url_to_fs from fsspec (#507) (#512)

LoserCheems committed 325 days ago

Verified 4f381b35

Bump up the latex2sympy2_extended version + more tests (#510)

hynky1999 committed 325 days ago

Verified 0ab63d01

Support custom results/details push to hub (#457)

albertvillanova committed 326 days ago

Verified c82143a4

Add custom tasks for evaluation of french models (#505)

mdiazmel committed 326 days ago

Verified 7028af37

llm_as_a_judge_for_oallv2_arabic (#498)

Manel-Hik committed 326 days ago

Verified 620873b5

Relax upper bound on torch (#508)

lewtun committed 326 days ago

Verified 5f5bed52

Translate task template to Catalan and Galician and fix typos (#506)

mariagrandury committed 327 days ago

Verified 1ae2fa28

Made judge response processing more robust. (#491)

JoelNiklaus committed 328 days ago

Verified 01405785

feat: add asian language support to CorpusLevelTranslationMetric (#479)

ryan-minato committed 329 days ago

Verified be18ae59

Hotfix for litellm judge (#490)

JoelNiklaus committed 329 days ago

Verified fee2ec32

Fixed issue with o1 in litellm. (#493)

JoelNiklaus committed 329 days ago

Verified 3b89734c

Fix math extraction (#503)

hynky1999 committed 330 days ago

Verified 90d44c1e

Extractive Match metric (#495)

hynky1999 committed 334 days ago

Verified 59624c88

fix README link (#500)

vxw3t8fhjsdkghvbdifuk committed 334 days ago

Verified a7aa6edb

Fix `T_co` import bug (#484)

gucci-j committed 341 days ago

Verified 6560c755

Made litellm judge backend more robust. (#485)

JoelNiklaus committed 342 days ago

Verified fdb12f49

Fix issue with encodings for together models. (#483)

JoelNiklaus committed 342 days ago

Verified 2073a295

Update README.md (#486)

NathanHB committed 342 days ago

Verified f6fee3aa

Tiny improvements to `endpoint_model.py`, `base_model.py`,... (#219)

sadra-barikbin committed 345 days ago

Verified 452e031a

Homogeneize generation params (#428)

clefourrier committed 346 days ago

Verified 5a28b229

fix model parallel (#481)

NathanHB committed 347 days ago

Verified 24afde29

Add litellm inference (#385)

JoelNiklaus committed 347 days ago

Verified a2541b12

fix: scorer attribute initialization in ROUGE (#471)

ryan-minato committed 353 days ago

Verified 2ef9740d

fix: LightevalTaskConfig.stop_sequence attribute (#463)

ryan-minato committed 353 days ago

Verified 9ff194d1

Older