huggingface/lighteval

Pull Requests Commits

NathanHB committed 300 days ago

ebd1a992

NathanHB committed 300 days ago

9054c997

NathanHB committed 300 days ago

6b3976ac

Merge branch 'main' into clem_last_exam

NathanHB committed 300 days ago

Verified 8acb4617

Let lighteval support sglang (#552)

Jayon02 committed 300 days ago

Verified 086cf905

raise exception when generation size is more than model length (#571)

NathanHB committed 300 days ago

Verified bee02f7e

Add extended task for LiveCodeBench codegeneration (#548)

plaguss committed 301 days ago

Verified fd479ee6

Merge branch 'main' into clem_last_exam

NathanHB committed 305 days ago

Verified ab9a6d8e

allows better flexibility for litellm endpoints (#549)

NathanHB committed 305 days ago

Verified d6de1fe2

typo(vllm): `gpu_memory_utilisation` typo (#553)

tpoisonooo committed 306 days ago

Verified fac17bb6

[VLLM] Allows for max tokens to be set in model config file (#547)

NathanHB committed 306 days ago

Verified 78b68abb

fix: broken URLs (#550)

deep-diver committed 306 days ago

Verified da119e81

Fix loading of vllm model from files (#533)

NathanHB committed 309 days ago

Verified d4e6f59b

Fix VLLM data-parallel (#541)

hynky1999 committed 312 days ago

Verified 86f62259

Bug fix extractive match (#540)

hynky1999 committed 312 days ago

Verified 3c9b0c9d

Update README.md (#539)

clefourrier committed 313 days ago

Verified f8405eee

clefourrier committed 313 days ago

Verified 441d7a4a

Make BLEURT lazy (#536)

hynky1999 committed 313 days ago

Verified 15bdbb81

Add GPQA for instruct models (#534)

lewtun committed 313 days ago

Verified 1ce7331f

Sync Math-verify (#535)

hynky1999 committed 314 days ago

Verified cb35beae

Add custom task (bac-fr) for evaluation of models in french (#518)

mdiazmel committed 315 days ago

Verified d7a1f112

Update french_evals.py

clefourrier committed 316 days ago

Verified be7da176

adds olympiad bench (#521)

NathanHB committed 318 days ago

Verified d332207b

clefourrier committed 319 days ago

1dd74f0a

clefourrier committed 319 days ago

a58e6d60

Improve readability of the quick tour. (#501)

vxw3t8fhjsdkghvbdifuk committed 319 days ago

Verified 515bd01d

Implemented the possibility to load predictions from details files and continue evaluating from there (#488)

JoelNiklaus committed 320 days ago

Verified 94fc5a28

revert harcoding

clefourrier committed 320 days ago

c3e02eaa

attempt at async code

clefourrier committed 320 days ago

23ad4766

metrics working

clefourrier committed 321 days ago

59ce9e1f

Older