huggingface/lighteval

Pull Requests Commits

NathanHB committed 268 days ago

88746310

NathanHB committed 268 days ago

a928d949

Merge branch 'nathan-task-from-dataset' of github.com:huggingface/lighteval into nathan-task-from-dataset

NathanHB committed 268 days ago

487f8a1a

NathanHB committed 268 days ago

d1216f2b

Apply suggestions from code review

NathanHB committed 269 days ago

Verified 319828c6

NathanHB committed 269 days ago

e3e8ddd1

Merge remote-tracking branch 'origin/main' into nathan-task-from-dataset

NathanHB committed 269 days ago

6577664e

relax deps for tgi (#626)

NathanHB committed 270 days ago

Verified 14d289e3

vllm fix sampling params (#625)

NathanHB committed 270 days ago

Verified d46f2f78

relax spacy import to relax dep (#622)

clefourrier committed 270 days ago

Verified 0ae8136d

NathanHB committed 271 days ago

37c9ee32

adds inference providers support (#616)

NathanHB committed 271 days ago

Verified b9a2e567

VLLM + Math-Verify fixes (#603)

hynky1999 committed 285 days ago

Verified d81bafd6

Fixing backend error in main_sglang. (#597)

TankNee committed 285 days ago

Verified f2ddc520

Add subsets for lcb (#587)

plaguss committed 291 days ago

Verified ed084813

adds aime24, 25 and math500 (#586)

NathanHB committed 292 days ago

Verified 4c9af85c

docs: update README to reflect new model evaluation entry points (#581)

czakop committed 292 days ago

Verified 066f84f7

parse seed for vllm (#585)

eldarkurtic committed 292 days ago

Verified 95068aa6

Push details without converting fields to str (#572)

NathanHB committed 292 days ago

Verified 7b421132

Add turkish and word (#583)

bezir committed 293 days ago

Verified bd578a84

Fix vLLM generation with sampling params (#578)

lewtun committed 296 days ago

Verified ebb7377b

Humanity's last exam (#520)

clefourrier committed 299 days ago

Verified 782afe89

Let lighteval support sglang (#552)

Jayon02 committed 299 days ago

Verified 086cf905

raise exception when generation size is more than model length (#571)

NathanHB committed 299 days ago

Verified bee02f7e

Add extended task for LiveCodeBench codegeneration (#548)

plaguss committed 299 days ago

Verified fd479ee6

allows better flexibility for litellm endpoints (#549)

NathanHB committed 304 days ago

Verified d6de1fe2

typo(vllm): `gpu_memory_utilisation` typo (#553)

tpoisonooo committed 305 days ago

Verified fac17bb6

[VLLM] Allows for max tokens to be set in model config file (#547)

NathanHB committed 305 days ago

Verified 78b68abb

fix: broken URLs (#550)

deep-diver committed 305 days ago

Verified da119e81

Fix loading of vllm model from files (#533)

NathanHB committed 307 days ago

Verified d4e6f59b

Older