huggingface/lighteval

Pull Requests Commits

NathanHB committed 295 days ago

88746310

NathanHB committed 295 days ago

a928d949

Merge branch 'nathan-task-from-dataset' of github.com:huggingface/lighteval into nathan-task-from-dataset

NathanHB committed 295 days ago

487f8a1a

NathanHB committed 295 days ago

d1216f2b

Apply suggestions from code review

NathanHB committed 296 days ago

Verified 319828c6

NathanHB committed 296 days ago

e3e8ddd1

Merge remote-tracking branch 'origin/main' into nathan-task-from-dataset

NathanHB committed 296 days ago

6577664e

relax deps for tgi (#626)

NathanHB committed 297 days ago

Verified 14d289e3

vllm fix sampling params (#625)

NathanHB committed 297 days ago

Verified d46f2f78

relax spacy import to relax dep (#622)

clefourrier committed 297 days ago

Verified 0ae8136d

NathanHB committed 298 days ago

37c9ee32

adds inference providers support (#616)

NathanHB committed 298 days ago

Verified b9a2e567

VLLM + Math-Verify fixes (#603)

hynky1999 committed 312 days ago

Verified d81bafd6

Fixing backend error in main_sglang. (#597)

TankNee committed 312 days ago

Verified f2ddc520

Add subsets for lcb (#587)

plaguss committed 318 days ago

Verified ed084813

adds aime24, 25 and math500 (#586)

NathanHB committed 319 days ago

Verified 4c9af85c

docs: update README to reflect new model evaluation entry points (#581)

czakop committed 319 days ago

Verified 066f84f7

parse seed for vllm (#585)

eldarkurtic committed 319 days ago

Verified 95068aa6

Push details without converting fields to str (#572)

NathanHB committed 319 days ago

Verified 7b421132

Add turkish and word (#583)

bezir committed 320 days ago

Verified bd578a84

Fix vLLM generation with sampling params (#578)

lewtun committed 323 days ago

Verified ebb7377b

Humanity's last exam (#520)

clefourrier committed 326 days ago

Verified 782afe89

Let lighteval support sglang (#552)

Jayon02 committed 326 days ago

Verified 086cf905

raise exception when generation size is more than model length (#571)

NathanHB committed 326 days ago

Verified bee02f7e

Add extended task for LiveCodeBench codegeneration (#548)

plaguss committed 326 days ago

Verified fd479ee6

allows better flexibility for litellm endpoints (#549)

NathanHB committed 331 days ago

Verified d6de1fe2

typo(vllm): `gpu_memory_utilisation` typo (#553)

tpoisonooo committed 332 days ago

Verified fac17bb6

[VLLM] Allows for max tokens to be set in model config file (#547)

NathanHB committed 332 days ago

Verified 78b68abb

fix: broken URLs (#550)

deep-diver committed 332 days ago

Verified da119e81

Fix loading of vllm model from files (#533)

NathanHB committed 334 days ago

Verified d4e6f59b

Older