huggingface/lighteval

Pull Requests Commits

NathanHB committed 343 days ago

cae24138

Merge remote-tracking branch 'origin/main' into nathan-log-model-config

NathanHB committed 344 days ago

479c893e

NathanHB committed 344 days ago

877c5e17

make tests fail at first failure

NathanHB committed 345 days ago

7fe22275

make tests fail at first failure

NathanHB committed 345 days ago

e7d3582d

NathanHB committed 345 days ago

7f56b208

relax deps for tgi (#626)

NathanHB committed 345 days ago

Verified 14d289e3

log model config

NathanHB committed 345 days ago

2efca779

vllm fix sampling params (#625)

NathanHB committed 345 days ago

Verified d46f2f78

log model config

NathanHB committed 345 days ago

e1b6eb22

relax spacy import to relax dep (#622)

clefourrier committed 345 days ago

Verified 0ae8136d

adds inference providers support (#616)

NathanHB committed 346 days ago

Verified b9a2e567

VLLM + Math-Verify fixes (#603)

hynky1999 committed 360 days ago

Verified d81bafd6

Fixing backend error in main_sglang. (#597)

TankNee committed 360 days ago

Verified f2ddc520

Add subsets for lcb (#587)

plaguss committed 1 year ago

Verified ed084813

adds aime24, 25 and math500 (#586)

NathanHB committed 1 year ago

Verified 4c9af85c

docs: update README to reflect new model evaluation entry points (#581)

czakop committed 1 year ago

Verified 066f84f7

parse seed for vllm (#585)

eldarkurtic committed 1 year ago

Verified 95068aa6

Push details without converting fields to str (#572)

NathanHB committed 1 year ago

Verified 7b421132

Add turkish and word (#583)

bezir committed 1 year ago

Verified bd578a84

Fix vLLM generation with sampling params (#578)

lewtun committed 1 year ago

Verified ebb7377b

Humanity's last exam (#520)

clefourrier committed 1 year ago

Verified 782afe89

Let lighteval support sglang (#552)

Jayon02 committed 1 year ago

Verified 086cf905

raise exception when generation size is more than model length (#571)

NathanHB committed 1 year ago

Verified bee02f7e

Add extended task for LiveCodeBench codegeneration (#548)

plaguss committed 1 year ago

Verified fd479ee6

allows better flexibility for litellm endpoints (#549)

NathanHB committed 1 year ago

Verified d6de1fe2

typo(vllm): `gpu_memory_utilisation` typo (#553)

tpoisonooo committed 1 year ago

Verified fac17bb6

[VLLM] Allows for max tokens to be set in model config file (#547)

NathanHB committed 1 year ago

Verified 78b68abb

fix: broken URLs (#550)

deep-diver committed 1 year ago

Verified da119e81

Fix loading of vllm model from files (#533)

NathanHB committed 1 year ago

Verified d4e6f59b

Older