huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into hynek_function

clefourrier committed 2 years ago

7d2afa44

Use only dataclasses for task init (#212)

clefourrier committed 2 years ago

Verified 3aaec227

Fix a few typos in `metrics.py` (#218)

sadra-barikbin committed 2 years ago

Verified 3f909509

Merge branch 'simplify_task_system' into hynek_function

clefourrier committed 2 years ago

Verified 8f983379

Homogeneize logging system (#150)

clefourrier committed 2 years ago

Verified ac57b78e

Merge branch 'main' into simplify_task_system

clefourrier committed 2 years ago

Verified da016b73

Update src/lighteval/tasks/registry.py

clefourrier committed 2 years ago

Verified 1a0efde2

Adds a dummy/random model for baseline init (#220)

guipenedo committed 2 years ago

Verified 70f7fc6d

Fix the bug (#216)

sadra-barikbin committed 2 years ago

Verified 0528f297

[Bugfix] Avoid truncating the outputs based on string lengths (#201)

anton-l committed 2 years ago

Verified 60646959

last fix + doc udpate

clefourrier committed 2 years ago

9f518ade

removed templated type which messed up the test suite

clefourrier committed 2 years ago

e4182b43

LightevalTask now only takes functions

clefourrier committed 2 years ago

c927d143

moved everyone to function calling

clefourrier committed 2 years ago

e10a84ce

now use function, not string, to pass prompts in examples

clefourrier committed 2 years ago

d43ffacb

Merge branch 'simplify_task_system' into hynek_function

clefourrier committed 2 years ago

770f67e8

Merge branch 'main' into function_prompts

clefourrier committed 2 years ago

Verified c656d64a

Fix a few typos and do a tiny refactor (#187)

sadra-barikbin committed 2 years ago

Verified 843a0f8c

ADD GPT-4 as Judge (#206)

philschmid committed 2 years ago

Verified 0bceaee0

clefourrier committed 2 years ago

b84f006c

fix nanotron example

clefourrier committed 2 years ago

96767564

clefourrier committed 2 years ago

c93a2fa0

fix extended tasks + typo

clefourrier committed 2 years ago

4410c237

simplification part 1

clefourrier committed 2 years ago

c5f428cc

Merge branch 'main' into simplify_task_system

clefourrier committed 2 years ago

a6aa1335

clefourrier committed 2 years ago

82e98152

fix llm as judge warnings (#173)

NathanHB committed 2 years ago

Verified 3a808336

replaced json tasks by python tasks, step 1

clefourrier committed 2 years ago

ced2945e

Merge branch 'main' into function_prompts

clefourrier committed 2 years ago

Verified cde6c04f

Updated tgi_model and added parameters for endpoint_model (#208)

shaltielshmid committed 2 years ago

Verified 7fcaab35

Older