Add metrics as functions #214
clefourrier
merged
27 commits into
main
from
metrics_as_fn
add function prompt assigment
58fee656
add json casting
57d40f96
fix ruff setting + fmt
cb8be215
Merge branch 'main' into function_prompts
f275f600
Merge branch 'main' into function_prompts
cde6c04f
replaced json tasks by python tasks, step 1
ced2945e
wip
82e98152
Merge branch 'main' into simplify_task_system
a6aa1335
simplification part 1
c5f428cc
fix extended tasks + typo
4410c237
fix
c93a2fa0
fix nanotron example
96767564
small fix
b84f006c
Merge branch 'main' into function_prompts
c656d64a
Merge branch 'simplify_task_system' into hynek_function
770f67e8
now use function, not string, to pass prompts in examples
d43ffacb
moved everyone to function calling
e10a84ce
LightevalTask now only takes functions
c927d143
removed templated type which messed up the test suite
e4182b43
last fix + doc udpate
9f518ade
moving every metric launcher to a metric
b3cfbc2a
typo fix + fixes json encoder to fit metric storage
417a7aab
fix typo
129ba24f
fix tests
7b614319
Merge branch 'main' into metrics_as_fn
f957a9bd
Merge branch 'main' into metrics_as_fn
eedaa592
NathanHB
commented
on 2024-07-12
Merge branch 'main' into metrics_as_fn
895c072f
NathanHB
approved these changes
on 2024-07-16
Login to write a write a comment.
Login via GitHub