huggingface/lighteval

Pull Requests Commits

selected one key specifically

clefourrier committed 352 days ago

b1bd2707

fix adapter plus manag elanguages simply - in the future we might want to have a custom enum with one key several values

clefourrier committed 357 days ago

3e2e1f83

filled the translation litterals

clefourrier committed 357 days ago

35b306a1

clefourrier committed 357 days ago

9748e9c5

updated language list to rm redundancies, renamed task to follow usual pattern

clefourrier committed 358 days ago

4337835b

clefourrier committed 358 days ago

7727bf4c

focused on flores

clefourrier committed 358 days ago

1892efa3

draft of flores addition, still need to reupload the flores 200 + test

clefourrier committed 358 days ago

862d8275

adding relevant languages + sorting everyone

clefourrier committed 358 days ago

bfd44db6

Added support for quantization in vLLM backend (#690)

SulRash committed 360 days ago

Verified 04a74a28

Fix tqdm logging (#711)

Vectorrent committed 360 days ago

Verified f7392fa0

add livecodebench v6 (#712)

Cppowboy committed 360 days ago

Verified 7477de09

Patch 0.9.1 (#708)

NathanHB committed 1 year ago

Verified c8714563

Bump dev version0.9.1.dev0 (#705)

NathanHB committed 1 year ago

Verified 20cff959

better release notes (#704)

NathanHB committed 1 year ago

Verified 42c9c61a

fix typos (#702)

omahs committed 1 year ago

Verified 77efde06

Update README.md (#703)

NathanHB committed 1 year ago

Verified 9bf210c0

[FIX] Inference providers (#701)

clefourrier committed 1 year ago

Verified 039debce

docs: improve consistency in punctuation of metric list (#605)

mariagrandury committed 1 year ago

Verified 40626e7a

Update split iteration for DynamicBatchingDataset (#684)

qubvel committed 1 year ago

Verified d146f9b1

Fix TransformersModel.from_model() method (#691)

Vectorrent committed 1 year ago

Verified ea729318

Added custom model inference. (#437)

JoelNiklaus committed 1 year ago

Verified e67ed9c9

reorder authors (#699)

NathanHB committed 1 year ago

Verified dfeb2349

Add pass@1 for GPQA-D and MATH-500 (#698)

lewtun committed 1 year ago

Verified d50bc307

Nathan adds wanddb logging (#685)

NathanHB committed 1 year ago

Verified 96e885d4

fix gsm8k metric (#688)

NathanHB committed 1 year ago

Verified c776694a

Lift protobuf restriction (#683)

Vectorrent committed 1 year ago

Verified b07d4189

Fix yourbench custom task (#695)

alozowski committed 1 year ago

Verified 71fec806

fix wrong 'custom_task_directory' in python api doc (#671)

xgwang committed 1 year ago

Verified 534a5b8c

fix slow tests (#689)

NathanHB committed 1 year ago

Verified 818a2cf2

Older