huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into metrics_as_fn

NathanHB committed 1 year ago

Verified 895c072f

should fix most inference endpoints issues of version config (#226)

clefourrier committed 1 year ago

Verified 733257ff

Merge branch 'main' into metrics_as_fn

clefourrier committed 1 year ago

Verified eedaa592

Data split depending on eval params (#169)

clefourrier committed 1 year ago

Verified 66e6aaeb

Merge branch 'main' into metrics_as_fn

clefourrier committed 2 years ago

f957a9bd

Now only uses functions for prompt definition (#213)

clefourrier committed 2 years ago

Verified 4651531e

Use only dataclasses for task init (#212)

clefourrier committed 2 years ago

Verified 3aaec227

Fix a few typos in `metrics.py` (#218)

sadra-barikbin committed 2 years ago

Verified 3f909509

Homogeneize logging system (#150)

clefourrier committed 2 years ago

Verified ac57b78e

Adds a dummy/random model for baseline init (#220)

guipenedo committed 2 years ago

Verified 70f7fc6d

Fix the bug (#216)

sadra-barikbin committed 2 years ago

Verified 0528f297

[Bugfix] Avoid truncating the outputs based on string lengths (#201)

anton-l committed 2 years ago

Verified 60646959

clefourrier committed 2 years ago

7b614319

clefourrier committed 2 years ago

129ba24f

typo fix + fixes json encoder to fit metric storage

clefourrier committed 2 years ago

417a7aab

moving every metric launcher to a metric

clefourrier committed 2 years ago

b3cfbc2a

last fix + doc udpate

clefourrier committed 2 years ago

9f518ade

removed templated type which messed up the test suite

clefourrier committed 2 years ago

e4182b43

LightevalTask now only takes functions

clefourrier committed 2 years ago

c927d143

moved everyone to function calling

clefourrier committed 2 years ago

e10a84ce

now use function, not string, to pass prompts in examples

clefourrier committed 2 years ago

d43ffacb

Merge branch 'simplify_task_system' into hynek_function

clefourrier committed 2 years ago

770f67e8

Merge branch 'main' into function_prompts

clefourrier committed 2 years ago

Verified c656d64a

Fix a few typos and do a tiny refactor (#187)

sadra-barikbin committed 2 years ago

Verified 843a0f8c

ADD GPT-4 as Judge (#206)

philschmid committed 2 years ago

Verified 0bceaee0

clefourrier committed 2 years ago

b84f006c

fix nanotron example

clefourrier committed 2 years ago

96767564

clefourrier committed 2 years ago

c93a2fa0

fix extended tasks + typo

clefourrier committed 2 years ago

4410c237

simplification part 1

clefourrier committed 2 years ago

c5f428cc

Older