PR #213 Now only uses functions for prompt definition

Now only uses functions for prompt definition #213

clefourrier merged 24 commits into main from hynek_function

add function prompt assigment

58fee656

add json casting

57d40f96

fix ruff setting + fmt

cb8be215

Merge branch 'main' into function_prompts

f275f600

Merge branch 'main' into function_prompts

cde6c04f

replaced json tasks by python tasks, step 1

ced2945e

wip

82e98152

Merge branch 'main' into simplify_task_system

a6aa1335

simplification part 1

c5f428cc

fix extended tasks + typo

4410c237

fix

c93a2fa0

fix nanotron example

96767564

small fix

b84f006c

Merge branch 'main' into function_prompts

c656d64a

Merge branch 'simplify_task_system' into hynek_function

770f67e8

now use function, not string, to pass prompts in examples

d43ffacb

moved everyone to function calling

e10a84ce

LightevalTask now only takes functions

c927d143

removed templated type which messed up the test suite

e4182b43

last fix + doc udpate

9f518ade

clefourrier changed the base branch from main to simplify_task_system 1 year ago

clefourrier requested a review from

NathanHB 1 year ago

Update src/lighteval/tasks/registry.py

1a0efde2

Merge branch 'main' into simplify_task_system

da016b73

Merge branch 'simplify_task_system' into hynek_function

8f983379

NathanHB commented on 2024-07-09

clefourrier changed the base branch from simplify_task_system to main 1 year ago

Merge branch 'main' into hynek_function

7d2afa44

clefourrier requested a review from

NathanHB 1 year ago

NathanHB approved these changes on 2024-07-09

clefourrier merged 4651531e into main 1 year ago

Reviewers

NathanHB

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

lighteval Now only uses functions for prompt definition #213 Merged

Now only uses functions for prompt definition #213

lighteval
Now only uses functions for prompt definition
#213

Merged