lighteval
4651531e - Now only uses functions for prompt definition (#213)

Commit
1 year ago
Now only uses functions for prompt definition (#213) * add function prompt assigment * add json casting * fix ruff setting + fmt * replaced json tasks by python tasks, step 1 * wip * simplification part 1 * fix extended tasks + typo * fix * fix nanotron example * small fix * now use function, not string, to pass prompts in examples * moved everyone to function calling * LightevalTask now only takes functions * removed templated type which messed up the test suite * last fix + doc udpate * Update src/lighteval/tasks/registry.py Co-authored-by: Nathan Habib <30601243+NathanHB@users.noreply.github.com> --------- Co-authored-by: Hynek Kydlíček <kydlicek.hynek@gmail.com> Co-authored-by: Nathan Habib <30601243+NathanHB@users.noreply.github.com>
Author
Parents
Loading