huggingface/lighteval

Pull Requests Commits

NathanHB committed 273 days ago

cae24138

Merge remote-tracking branch 'origin/main' into nathan-log-model-config

NathanHB committed 274 days ago

479c893e

NathanHB committed 274 days ago

877c5e17

make tests fail at first failure

NathanHB committed 275 days ago

7fe22275

make tests fail at first failure

NathanHB committed 275 days ago

e7d3582d

NathanHB committed 275 days ago

7f56b208

relax deps for tgi (#626)

NathanHB committed 275 days ago

Verified 14d289e3

log model config

NathanHB committed 275 days ago

2efca779

vllm fix sampling params (#625)

NathanHB committed 275 days ago

Verified d46f2f78

log model config

NathanHB committed 275 days ago

e1b6eb22

relax spacy import to relax dep (#622)

clefourrier committed 275 days ago

Verified 0ae8136d

adds inference providers support (#616)

NathanHB committed 276 days ago

Verified b9a2e567

VLLM + Math-Verify fixes (#603)

hynky1999 committed 290 days ago

Verified d81bafd6

Fixing backend error in main_sglang. (#597)

TankNee committed 290 days ago

Verified f2ddc520

Add subsets for lcb (#587)

plaguss committed 296 days ago

Verified ed084813

adds aime24, 25 and math500 (#586)

NathanHB committed 297 days ago

Verified 4c9af85c

docs: update README to reflect new model evaluation entry points (#581)

czakop committed 297 days ago

Verified 066f84f7

parse seed for vllm (#585)

eldarkurtic committed 297 days ago

Verified 95068aa6

Push details without converting fields to str (#572)

NathanHB committed 297 days ago

Verified 7b421132

Add turkish and word (#583)

bezir committed 298 days ago

Verified bd578a84

Fix vLLM generation with sampling params (#578)

lewtun committed 301 days ago

Verified ebb7377b

Humanity's last exam (#520)

clefourrier committed 304 days ago

Verified 782afe89

Let lighteval support sglang (#552)

Jayon02 committed 304 days ago

Verified 086cf905

raise exception when generation size is more than model length (#571)

NathanHB committed 304 days ago

Verified bee02f7e

Add extended task for LiveCodeBench codegeneration (#548)

plaguss committed 304 days ago

Verified fd479ee6

allows better flexibility for litellm endpoints (#549)

NathanHB committed 309 days ago

Verified d6de1fe2

typo(vllm): `gpu_memory_utilisation` typo (#553)

tpoisonooo committed 310 days ago

Verified fac17bb6

[VLLM] Allows for max tokens to be set in model config file (#547)

NathanHB committed 310 days ago

Verified 78b68abb

fix: broken URLs (#550)

deep-diver committed 310 days ago

Verified da119e81

Fix loading of vllm model from files (#533)

NathanHB committed 312 days ago

Verified d4e6f59b

Older