huggingface/lighteval

Pull Requests Commits

selected one key specifically

clefourrier committed 241 days ago

b1bd2707

fix adapter plus manag elanguages simply - in the future we might want to have a custom enum with one key several values

clefourrier committed 246 days ago

3e2e1f83

filled the translation litterals

clefourrier committed 246 days ago

35b306a1

clefourrier committed 246 days ago

9748e9c5

updated language list to rm redundancies, renamed task to follow usual pattern

clefourrier committed 246 days ago

4337835b

clefourrier committed 246 days ago

7727bf4c

focused on flores

clefourrier committed 246 days ago

1892efa3

draft of flores addition, still need to reupload the flores 200 + test

clefourrier committed 247 days ago

862d8275

adding relevant languages + sorting everyone

clefourrier committed 247 days ago

bfd44db6

Added support for quantization in vLLM backend (#690)

SulRash committed 248 days ago

Verified 04a74a28

Fix tqdm logging (#711)

Vectorrent committed 248 days ago

Verified f7392fa0

add livecodebench v6 (#712)

Cppowboy committed 248 days ago

Verified 7477de09

Patch 0.9.1 (#708)

NathanHB committed 253 days ago

Verified c8714563

Bump dev version0.9.1.dev0 (#705)

NathanHB committed 254 days ago

Verified 20cff959

better release notes (#704)

NathanHB committed 254 days ago

Verified 42c9c61a

fix typos (#702)

omahs committed 254 days ago

Verified 77efde06

Update README.md (#703)

NathanHB committed 254 days ago

Verified 9bf210c0

[FIX] Inference providers (#701)

clefourrier committed 254 days ago

Verified 039debce

docs: improve consistency in punctuation of metric list (#605)

mariagrandury committed 254 days ago

Verified 40626e7a

Update split iteration for DynamicBatchingDataset (#684)

qubvel committed 255 days ago

Verified d146f9b1

Fix TransformersModel.from_model() method (#691)

Vectorrent committed 255 days ago

Verified ea729318

Added custom model inference. (#437)

JoelNiklaus committed 255 days ago

Verified e67ed9c9

reorder authors (#699)

NathanHB committed 255 days ago

Verified dfeb2349

Add pass@1 for GPQA-D and MATH-500 (#698)

lewtun committed 255 days ago

Verified d50bc307

Nathan adds wanddb logging (#685)

NathanHB committed 260 days ago

Verified 96e885d4

fix gsm8k metric (#688)

NathanHB committed 260 days ago

Verified c776694a

Lift protobuf restriction (#683)

Vectorrent committed 260 days ago

Verified b07d4189

Fix yourbench custom task (#695)

alozowski committed 261 days ago

Verified 71fec806

fix wrong 'custom_task_directory' in python api doc (#671)

xgwang committed 262 days ago

Verified 534a5b8c

fix slow tests (#689)

NathanHB committed 262 days ago

Verified 818a2cf2

Older