lighteval
b014b50f - Adds config tempaltes (#295)

Commit
1 year ago
Adds config tempaltes (#295) * draft * finish multichoice config * finish implementation of templates + move stuff around * nicers tests + fix them * nicer todo * add nice doscrings 📃 * add even more docstring * nit * merge nli, add languagees to literals * translation literals * Update src/lighteval/tasks/templates/nli.py Co-authored-by: Clémentine Fourrier <22726840+clefourrier@users.noreply.github.com> * Update src/lighteval/tasks/templates/continuation.py Co-authored-by: Clémentine Fourrier <22726840+clefourrier@users.noreply.github.com> * Update src/lighteval/tasks/templates/multichoice.py Co-authored-by: Clémentine Fourrier <22726840+clefourrier@users.noreply.github.com> * nice docstrings + remove unecessary comments * beatufiful docstrings --------- Co-authored-by: Hynek Kydlicek <kydliceh.hynek@gmail.com> Co-authored-by: Clémentine Fourrier <22726840+clefourrier@users.noreply.github.com>
Author
Parents
Loading