huggingface/lighteval

Pull Requests Commits

NathanHB committed 303 days ago

2bce6bc4

NathanHB committed 303 days ago

cb22830e

raise exception when generation size is more than model length

NathanHB committed 303 days ago

fbb2eecd

Add extended task for LiveCodeBench codegeneration (#548)

plaguss committed 303 days ago

Verified fd479ee6

allows better flexibility for litellm endpoints (#549)

NathanHB committed 308 days ago

Verified d6de1fe2

typo(vllm): `gpu_memory_utilisation` typo (#553)

tpoisonooo committed 309 days ago

Verified fac17bb6

[VLLM] Allows for max tokens to be set in model config file (#547)

NathanHB committed 309 days ago

Verified 78b68abb

fix: broken URLs (#550)

deep-diver committed 309 days ago

Verified da119e81

Fix loading of vllm model from files (#533)

NathanHB committed 311 days ago

Verified d4e6f59b

Fix VLLM data-parallel (#541)

hynky1999 committed 315 days ago

Verified 86f62259

Bug fix extractive match (#540)

hynky1999 committed 315 days ago

Verified 3c9b0c9d

Update README.md (#539)

clefourrier committed 315 days ago

Verified f8405eee

clefourrier committed 315 days ago

Verified 441d7a4a

Make BLEURT lazy (#536)

hynky1999 committed 315 days ago

Verified 15bdbb81

Add GPQA for instruct models (#534)

lewtun committed 316 days ago

Verified 1ce7331f

Sync Math-verify (#535)

hynky1999 committed 316 days ago

Verified cb35beae

Add custom task (bac-fr) for evaluation of models in french (#518)

mdiazmel committed 318 days ago

Verified d7a1f112

Update french_evals.py

clefourrier committed 318 days ago

Verified be7da176

adds olympiad bench (#521)

NathanHB committed 321 days ago

Verified d332207b

Improve readability of the quick tour. (#501)

vxw3t8fhjsdkghvbdifuk committed 322 days ago

Verified 515bd01d

Implemented the possibility to load predictions from details files and continue evaluating from there (#488)

JoelNiklaus committed 323 days ago

Verified 94fc5a28

add missing inits (#524)

hynky1999 committed 323 days ago

Verified 48d0c284

Math extraction - allow only trying the first match, more customizable latex extraction + bump deps (#522)

hynky1999 committed 324 days ago

Verified 0e462692

Fixing commonsense qa: generative metrics, -1 gen length (#517)

clefourrier committed 326 days ago

Verified cb075a54

Fix Ukrainian indices and confirmation word (#516)

ayukh committed 326 days ago

Verified 499cc820

Fixed bug of import url_to_fs from fsspec (#507) (#512)

LoserCheems committed 328 days ago

Verified 4f381b35

Bump up the latex2sympy2_extended version + more tests (#510)

hynky1999 committed 329 days ago

Verified 0ab63d01

Support custom results/details push to hub (#457)

albertvillanova committed 329 days ago

Verified c82143a4

Add custom tasks for evaluation of french models (#505)

mdiazmel committed 329 days ago

Verified 7028af37

llm_as_a_judge_for_oallv2_arabic (#498)

Manel-Hik committed 329 days ago

Verified 620873b5

Older