huggingface/lighteval

Pull Requests Commits

selected one key specifically

clefourrier committed 283 days ago

b1bd2707

fix adapter plus manag elanguages simply - in the future we might want to have a custom enum with one key several values

clefourrier committed 288 days ago

3e2e1f83

filled the translation litterals

clefourrier committed 288 days ago

35b306a1

clefourrier committed 288 days ago

9748e9c5

updated language list to rm redundancies, renamed task to follow usual pattern

clefourrier committed 288 days ago

4337835b

clefourrier committed 288 days ago

7727bf4c

focused on flores

clefourrier committed 288 days ago

1892efa3

draft of flores addition, still need to reupload the flores 200 + test

clefourrier committed 288 days ago

862d8275

adding relevant languages + sorting everyone

clefourrier committed 288 days ago

bfd44db6

Added support for quantization in vLLM backend (#690)

SulRash committed 290 days ago

Verified 04a74a28

Fix tqdm logging (#711)

Vectorrent committed 290 days ago

Verified f7392fa0

add livecodebench v6 (#712)

Cppowboy committed 290 days ago

Verified 7477de09

Patch 0.9.1 (#708)

NathanHB committed 295 days ago

Verified c8714563

Bump dev version0.9.1.dev0 (#705)

NathanHB committed 296 days ago

Verified 20cff959

better release notes (#704)

NathanHB committed 296 days ago

Verified 42c9c61a

fix typos (#702)

omahs committed 296 days ago

Verified 77efde06

Update README.md (#703)

NathanHB committed 296 days ago

Verified 9bf210c0

[FIX] Inference providers (#701)

clefourrier committed 296 days ago

Verified 039debce

docs: improve consistency in punctuation of metric list (#605)

mariagrandury committed 296 days ago

Verified 40626e7a

Update split iteration for DynamicBatchingDataset (#684)

qubvel committed 296 days ago

Verified d146f9b1

Fix TransformersModel.from_model() method (#691)

Vectorrent committed 296 days ago

Verified ea729318

Added custom model inference. (#437)

JoelNiklaus committed 297 days ago

Verified e67ed9c9

reorder authors (#699)

NathanHB committed 297 days ago

Verified dfeb2349

Add pass@1 for GPQA-D and MATH-500 (#698)

lewtun committed 297 days ago

Verified d50bc307

Nathan adds wanddb logging (#685)

NathanHB committed 302 days ago

Verified 96e885d4

fix gsm8k metric (#688)

NathanHB committed 302 days ago

Verified c776694a

Lift protobuf restriction (#683)

Vectorrent committed 302 days ago

Verified b07d4189

Fix yourbench custom task (#695)

alozowski committed 302 days ago

Verified 71fec806

fix wrong 'custom_task_directory' in python api doc (#671)

xgwang committed 304 days ago

Verified 534a5b8c

fix slow tests (#689)

NathanHB committed 304 days ago

Verified 818a2cf2

Older