huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into simplify_task_system

clefourrier committed 2 years ago

Verified 2c92993c

Fix a few typos in `metrics.py` (#218)

sadra-barikbin committed 2 years ago

Verified 3f909509

Merge branch 'main' into simplify_task_system

NathanHB committed 2 years ago

Verified 0088a01c

Homogeneize logging system (#150)

clefourrier committed 2 years ago

Verified ac57b78e

Merge branch 'main' into simplify_task_system

clefourrier committed 2 years ago

Verified da016b73

Update src/lighteval/tasks/registry.py

clefourrier committed 2 years ago

Verified 1a0efde2

Adds a dummy/random model for baseline init (#220)

guipenedo committed 2 years ago

Verified 70f7fc6d

Fix the bug (#216)

sadra-barikbin committed 2 years ago

Verified 0528f297

[Bugfix] Avoid truncating the outputs based on string lengths (#201)

anton-l committed 2 years ago

Verified 60646959

Fix a few typos and do a tiny refactor (#187)

sadra-barikbin committed 2 years ago

Verified 843a0f8c

ADD GPT-4 as Judge (#206)

philschmid committed 2 years ago

Verified 0bceaee0

clefourrier committed 2 years ago

b84f006c

fix nanotron example

clefourrier committed 2 years ago

96767564

clefourrier committed 2 years ago

c93a2fa0

fix extended tasks + typo

clefourrier committed 2 years ago

4410c237

simplification part 1

clefourrier committed 2 years ago

c5f428cc

Merge branch 'main' into simplify_task_system

clefourrier committed 2 years ago

a6aa1335

clefourrier committed 2 years ago

82e98152

fix llm as judge warnings (#173)

NathanHB committed 2 years ago

Verified 3a808336

replaced json tasks by python tasks, step 1

clefourrier committed 2 years ago

ced2945e

Updated tgi_model and added parameters for endpoint_model (#208)

shaltielshmid committed 2 years ago

Verified 7fcaab35

Download BERT scorer lazily (#190)

sadra-barikbin committed 2 years ago

Verified a3d1eea1

Mention HF_TOKEN in readme (#194)

Wauplin committed 2 years ago

Verified a98210fd

fix typos (#189)

kashif committed 2 years ago

Verified ad42e43b

Fix a few comment and docstring typos and a typehint (#177)

sadra-barikbin committed 2 years ago

Verified 061283f5

Fix AIMO (#186)

lewtun committed 2 years ago

Verified 981e10ac

[MATH] Fix generation for chat models & fix normalization for predictions (#163)

lewtun committed 2 years ago

Verified 60438f3c

adding aimo custom eval (#154)

NathanHB committed 2 years ago

Verified 9e3078eb

Add version config option. (#181)

PhilipMay committed 2 years ago

Verified c89b386e

Fix broken link to extended tasks in README (#182)

alexrs committed 2 years ago

Verified 979359db

Older