huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into clem_homogeneize_logging

clefourrier committed 1 year ago

Verified 8a246e59

clefourrier committed 1 year ago

ba4a8c43

restored nanotron config in log

clefourrier committed 1 year ago

440e9fd2

Apply suggestions from code review

clefourrier committed 1 year ago

Verified da0e8126

Adds a dummy/random model for baseline init (#220)

guipenedo committed 1 year ago

Verified 70f7fc6d

NathanHB committed 1 year ago

48c3857c

Merge branch 'main' into clem_homogeneize_logging

NathanHB committed 1 year ago

Verified ce28dca5

Fix the bug (#216)

sadra-barikbin committed 1 year ago

Verified 0528f297

[Bugfix] Avoid truncating the outputs based on string lengths (#201)

anton-l committed 1 year ago

Verified 60646959

Fix a few typos and do a tiny refactor (#187)

sadra-barikbin committed 1 year ago

Verified 843a0f8c

ADD GPT-4 as Judge (#206)

philschmid committed 1 year ago

Verified 0bceaee0

fix llm as judge warnings (#173)

NathanHB committed 1 year ago

Verified 3a808336

Merge branch 'main' into clem_homogeneize_logging

clefourrier committed 1 year ago

Verified c9ba1954

Updated tgi_model and added parameters for endpoint_model (#208)

shaltielshmid committed 1 year ago

Verified 7fcaab35

Download BERT scorer lazily (#190)

sadra-barikbin committed 1 year ago

Verified a3d1eea1

clefourrier committed 1 year ago

dd89c0a7

Update version of the hub

clefourrier committed 1 year ago

Verified 2577c6fd

Merge branch 'main' into clem_homogeneize_logging

clefourrier committed 1 year ago

Verified 9f305a82

Mention HF_TOKEN in readme (#194)

Wauplin committed 1 year ago

Verified a98210fd

fix typos (#189)

kashif committed 1 year ago

Verified ad42e43b

Fix a few comment and docstring typos and a typehint (#177)

sadra-barikbin committed 1 year ago

Verified 061283f5

Fix AIMO (#186)

lewtun committed 1 year ago

Verified 981e10ac

[MATH] Fix generation for chat models & fix normalization for predictions (#163)

lewtun committed 1 year ago

Verified 60438f3c

adding aimo custom eval (#154)

NathanHB committed 1 year ago

Verified 9e3078eb

Add version config option. (#181)

PhilipMay committed 1 year ago

Verified c89b386e

Fix broken link to extended tasks in README (#182)

alexrs committed 1 year ago

Verified 979359db

Fix citation section in readme (#180)

NathanHB committed 1 year ago

Verified 6183bf22

Add maj@k metric (#158)

clefourrier committed 1 year ago

Verified 0a455c4f

add 'cite as' section in readme (#178)

NathanHB committed 1 year ago

Verified 98060932

Fix prompt format german rag community task (#171)

jphme committed 1 year ago

Verified af35e886

Older