huggingface/lighteval

Pull Requests Commits

fixes from review

NathanHB committed 277 days ago

a5491a88

fixes from review

NathanHB committed 277 days ago

5ce0ad11

fixes from review

NathanHB committed 277 days ago

05c7c0bc

Merge branch 'nathan-add-inference-provider' of github.com:huggingface/lighteval into nathan-add-inference-provider

NathanHB committed 277 days ago

7044a568

fixes from review

NathanHB committed 277 days ago

5b425d5f

Update docs/source/use-inference-providers-as-backend.mdx

NathanHB committed 277 days ago

Verified 552291f1

Update docs/source/use-inference-providers-as-backend.mdx

NathanHB committed 277 days ago

Verified 82fbbb90

Update docs/source/use-inference-providers-as-backend.mdx

NathanHB committed 277 days ago

Verified 7b310186

NathanHB committed 277 days ago

4554b8da

NathanHB committed 277 days ago

a06c19aa

Update src/lighteval/models/endpoints/inference_providers_model.py

NathanHB committed 277 days ago

Verified e4f25752

NathanHB committed 277 days ago

42959056

NathanHB committed 277 days ago

e840c7e0

NathanHB committed 277 days ago

55e1f6e3

NathanHB committed 277 days ago

a6b5015b

NathanHB committed 277 days ago

5621793c

NathanHB committed 277 days ago

df29fe3c

VLLM + Math-Verify fixes (#603)

hynky1999 committed 290 days ago

Verified d81bafd6

Fixing backend error in main_sglang. (#597)

TankNee committed 290 days ago

Verified f2ddc520

Add subsets for lcb (#587)

plaguss committed 297 days ago

Verified ed084813

adds aime24, 25 and math500 (#586)

NathanHB committed 297 days ago

Verified 4c9af85c

docs: update README to reflect new model evaluation entry points (#581)

czakop committed 298 days ago

Verified 066f84f7

parse seed for vllm (#585)

eldarkurtic committed 298 days ago

Verified 95068aa6

Push details without converting fields to str (#572)

NathanHB committed 298 days ago

Verified 7b421132

Add turkish and word (#583)

bezir committed 299 days ago

Verified bd578a84

Fix vLLM generation with sampling params (#578)

lewtun committed 302 days ago

Verified ebb7377b

Humanity's last exam (#520)

clefourrier committed 304 days ago

Verified 782afe89

Let lighteval support sglang (#552)

Jayon02 committed 304 days ago

Verified 086cf905

raise exception when generation size is more than model length (#571)

NathanHB committed 304 days ago

Verified bee02f7e

Add extended task for LiveCodeBench codegeneration (#548)

plaguss committed 305 days ago

Verified fd479ee6

Older