huggingface/lighteval

Pull Requests Commits

Pass At K Math (#647)

clefourrier committed 261 days ago

89985bda

Fix docs (#614)

eldarkurtic committed 262 days ago

7d2f8572

Use openai == 1.55.2 and httpx == 0.27.2 (#648)

alozowski committed 265 days ago

965433e0

Integrate huggingface_hub inference support (#651)

alozowski committed 265 days ago

9210be74

fix: timedelta import is missing from the lighteval python-api example (#613)

Laz4rz committed 269 days ago

8ae0dfd9

Rename __initi__.py to __init__.py (#641)

clefourrier committed 269 days ago

ff513b68

Use `blfoat16` as default for vllm models. (#638)

NathanHB committed 269 days ago

aa77be8c

Fix steps numbers in custom_yourbench_task.py (#643)

alozowski committed 270 days ago

1bf3b0e6

Propagate vLLM batch size controls (#588)

alvin319 committed 271 days ago

aadd0a4a

Update README.md (#639)

NathanHB committed 271 days ago

b61b0e7c

fix:change multichoice_continuations_start_space category (#610)

AnikiFan committed 272 days ago

422af3c9

enable together models and reasoning models as judges. (#537)

JoelNiklaus committed 272 days ago

80739679

Fixing some silent bugs in Arabic Custom Tasks (#556)

alielfilali01 committed 272 days ago

edec9d57

support more prequantized models (#620)

DerekLiu35 committed 272 days ago

950f999c

v0.8.1.dev (#637)

NathanHB committed 272 days ago

f9085325

Create custom task (#621)

NathanHB committed 275 days ago

bf19d8dd

log model config (#627)

NathanHB committed 275 days ago

037e8be0

relax deps for tgi (#626)

NathanHB committed 277 days ago

2a95e14d

vllm fix sampling params (#625)

NathanHB committed 277 days ago

76b62fd8

relax spacy import to relax dep (#622)

clefourrier committed 277 days ago

fbfb7204

adds inference providers support (#616)

NathanHB committed 278 days ago

de663743

Merge remote-tracking branch 'origin/main' into multilingual_math

Hynek Kydlicek committed 291 days ago

4d8975a2

Hynek Kydlicek committed 291 days ago

869288f4

Hynek Kydlicek committed 291 days ago

246f86a3

Hynek Kydlicek committed 291 days ago

cfdc1519

VLLM + Math-Verify fixes (#603)

hynky1999 committed 292 days ago

c71c9187

Fixing backend error in main_sglang. (#597)

TankNee committed 292 days ago

12f41f66

Add subsets for lcb (#587)

plaguss committed 298 days ago

ab08d8f6

adds aime24, 25 and math500 (#586)

NathanHB committed 299 days ago

25ded156

docs: update README to reflect new model evaluation entry points (#581)

czakop committed 299 days ago

4a7bdbbb

Newer Older