huggingface/lighteval

Pull Requests Commits

add prompt to math 500

NathanHB committed 332 days ago

d4a5966e

add prompt to math 500

NathanHB committed 332 days ago

5f0a9d7b

Merge branch 'nathan-add-aime24-25' of github.com:huggingface/lighteval into nathan-add-aime24-25

NathanHB committed 332 days ago

f0f9ca4e

NathanHB committed 332 days ago

8d229c90

Apply suggestions from code review

NathanHB committed 332 days ago

Verified 0e1e45a1

NathanHB committed 332 days ago

60117258

docs: update README to reflect new model evaluation entry points (#581)

czakop committed 332 days ago

Verified 066f84f7

parse seed for vllm (#585)

eldarkurtic committed 332 days ago

Verified 95068aa6

Push details without converting fields to str (#572)

NathanHB committed 332 days ago

Verified 7b421132

Add turkish and word (#583)

bezir committed 333 days ago

Verified bd578a84

Fix vLLM generation with sampling params (#578)

lewtun committed 336 days ago

Verified ebb7377b

Humanity's last exam (#520)

clefourrier committed 339 days ago

Verified 782afe89

Let lighteval support sglang (#552)

Jayon02 committed 339 days ago

Verified 086cf905

raise exception when generation size is more than model length (#571)

NathanHB committed 339 days ago

Verified bee02f7e

Add extended task for LiveCodeBench codegeneration (#548)

plaguss committed 339 days ago

Verified fd479ee6

allows better flexibility for litellm endpoints (#549)

NathanHB committed 344 days ago

Verified d6de1fe2

typo(vllm): `gpu_memory_utilisation` typo (#553)

tpoisonooo committed 345 days ago

Verified fac17bb6

[VLLM] Allows for max tokens to be set in model config file (#547)

NathanHB committed 345 days ago

Verified 78b68abb

fix: broken URLs (#550)

deep-diver committed 345 days ago

Verified da119e81

Fix loading of vllm model from files (#533)

NathanHB committed 347 days ago

Verified d4e6f59b

Fix VLLM data-parallel (#541)

hynky1999 committed 351 days ago

Verified 86f62259

Bug fix extractive match (#540)

hynky1999 committed 351 days ago

Verified 3c9b0c9d

Update README.md (#539)

clefourrier committed 351 days ago

Verified f8405eee

clefourrier committed 351 days ago

Verified 441d7a4a

Make BLEURT lazy (#536)

hynky1999 committed 351 days ago

Verified 15bdbb81

Add GPQA for instruct models (#534)

lewtun committed 352 days ago

Verified 1ce7331f

Sync Math-verify (#535)

hynky1999 committed 352 days ago

Verified cb35beae

Add custom task (bac-fr) for evaluation of models in french (#518)

mdiazmel committed 354 days ago

Verified d7a1f112

Update french_evals.py

clefourrier committed 354 days ago

Verified be7da176

adds olympiad bench (#521)

NathanHB committed 357 days ago

Verified d332207b

Older