huggingface/lighteval

Pull Requests Commits

NathanHB committed 321 days ago

cae24138

Merge remote-tracking branch 'origin/main' into nathan-log-model-config

NathanHB committed 322 days ago

479c893e

NathanHB committed 322 days ago

877c5e17

make tests fail at first failure

NathanHB committed 323 days ago

7fe22275

make tests fail at first failure

NathanHB committed 323 days ago

e7d3582d

NathanHB committed 323 days ago

7f56b208

relax deps for tgi (#626)

NathanHB committed 323 days ago

Verified 14d289e3

log model config

NathanHB committed 323 days ago

2efca779

vllm fix sampling params (#625)

NathanHB committed 323 days ago

Verified d46f2f78

log model config

NathanHB committed 323 days ago

e1b6eb22

relax spacy import to relax dep (#622)

clefourrier committed 323 days ago

Verified 0ae8136d

adds inference providers support (#616)

NathanHB committed 324 days ago

Verified b9a2e567

VLLM + Math-Verify fixes (#603)

hynky1999 committed 338 days ago

Verified d81bafd6

Fixing backend error in main_sglang. (#597)

TankNee committed 338 days ago

Verified f2ddc520

Add subsets for lcb (#587)

plaguss committed 344 days ago

Verified ed084813

adds aime24, 25 and math500 (#586)

NathanHB committed 345 days ago

Verified 4c9af85c

docs: update README to reflect new model evaluation entry points (#581)

czakop committed 345 days ago

Verified 066f84f7

parse seed for vllm (#585)

eldarkurtic committed 345 days ago

Verified 95068aa6

Push details without converting fields to str (#572)

NathanHB committed 345 days ago

Verified 7b421132

Add turkish and word (#583)

bezir committed 346 days ago

Verified bd578a84

Fix vLLM generation with sampling params (#578)

lewtun committed 349 days ago

Verified ebb7377b

Humanity's last exam (#520)

clefourrier committed 352 days ago

Verified 782afe89

Let lighteval support sglang (#552)

Jayon02 committed 352 days ago

Verified 086cf905

raise exception when generation size is more than model length (#571)

NathanHB committed 352 days ago

Verified bee02f7e

Add extended task for LiveCodeBench codegeneration (#548)

plaguss committed 352 days ago

Verified fd479ee6

allows better flexibility for litellm endpoints (#549)

NathanHB committed 357 days ago

Verified d6de1fe2

typo(vllm): `gpu_memory_utilisation` typo (#553)

tpoisonooo committed 358 days ago

Verified fac17bb6

[VLLM] Allows for max tokens to be set in model config file (#547)

NathanHB committed 358 days ago

Verified 78b68abb

fix: broken URLs (#550)

deep-diver committed 358 days ago

Verified da119e81

Fix loading of vllm model from files (#533)

NathanHB committed 360 days ago

Verified d4e6f59b

Older