huggingface/lighteval

Pull Requests Commits

add openai dependency

NouamaneTazi committed 1 year ago

fd86c0c6

Mention HF_TOKEN in readme (#194)

Wauplin committed 1 year ago

Verified a98210fd

fix typos (#189)

kashif committed 1 year ago

Verified ad42e43b

Fix a few comment and docstring typos and a typehint (#177)

sadra-barikbin committed 1 year ago

Verified 061283f5

Fix AIMO (#186)

lewtun committed 1 year ago

Verified 981e10ac

[MATH] Fix generation for chat models & fix normalization for predictions (#163)

lewtun committed 1 year ago

Verified 60438f3c

adding aimo custom eval (#154)

NathanHB committed 1 year ago

Verified 9e3078eb

Add version config option. (#181)

PhilipMay committed 1 year ago

Verified c89b386e

Fix broken link to extended tasks in README (#182)

alexrs committed 1 year ago

Verified 979359db

Fix citation section in readme (#180)

NathanHB committed 1 year ago

Verified 6183bf22

Add maj@k metric (#158)

clefourrier committed 1 year ago

Verified 0a455c4f

add 'cite as' section in readme (#178)

NathanHB committed 1 year ago

Verified 98060932

Fix prompt format german rag community task (#171)

jphme committed 1 year ago

Verified af35e886

no function we actually use should be named prompt_fn (#168)

clefourrier committed 1 year ago

Verified 11b48333

[MATH] Fix MATH normalization (#162)

lewtun committed 1 year ago

Verified fc428f60

Nathan add logging to metrics (#157)

NathanHB committed 1 year ago

Verified 6a48e4e7

Fix nanotron models input size bug (#156)

clefourrier committed 1 year ago

Verified 6ea07cd7

CLI list tasks (#142)

DimbyTa committed 1 year ago

Verified f28a270a

Add llm as judge in metrics (#146)

NathanHB committed 1 year ago

Verified 7f6f8077

Added Namespace parameter for InferenceEndpoints, added option for passing model config directly (#147)

shaltielshmid committed 1 year ago

Verified 23987aa7

Add `Ger-RAG-eval`tasks. (#149)

PhilipMay committed 1 year ago

Verified 5a732e6c

Add fun widgets to the README (#145)

clefourrier committed 1 year ago

Verified 996b5042

Add config files for models (#131)

clefourrier committed 1 year ago

Verified efa17331

Fix max_length type in base_model.py (#138)

csarron committed 1 year ago

Verified ce087cda

NathanHB committed 1 year ago

Verified 017581f7

Add mt-bench (#75)

NathanHB committed 1 year ago

Verified af24080e

Update test workflow name to 'Tests' (#134)

Wauplin committed 1 year ago

Verified bbe3b5f8

Do not use deprecated list_files_info (#133)

Wauplin committed 1 year ago

Verified 7f25cce7

Simplified system for extended tasks (#123)

clefourrier committed 1 year ago

Verified e941a552

Adding support for Arabic benchmarks : AlGhafa benchmarking suite (#95)

alielfilali01 committed 1 year ago

Verified ef631cf5

Older