Adds config tempaltes #335
clefourrier
merged
39 commits into
main
from
config_templates
add multilignaul dynamic generative metrics
5c69eb04
Merge branch 'main' into geneartive_dynamic_metrics
39c4220d
Merge branch 'geneartive_dynamic_metrics' into config_templates
2a5cdca9
draft
2df9a082
finish multichoice config
95729ee5
Merge branch 'main' into geneartive_dynamic_metrics
3aa05796
update tokenizers + install nltk reqs
b8f90a9e
use punkt tab
f5a8717e
Update src/lighteval/utils/imports.py
227f5729
Update src/lighteval/metrics/normalizations.py
d80b3bac
fix imports
532bdadd
remove unused import
75f7ac5d
Merge branch 'main' into geneartive_dynamic_metrics
f99e330d
Merge branch 'main' into geneartive_dynamic_metrics
92daf909
Merge branch 'main' into geneartive_dynamic_metrics
f2a801d0
finish implementation of templates + move stuff around
91d9d4f7
resolve nits
9356cc62
when in rome do as romans do (handle error messages the same way)
0fbc7313
fix utils
fa1fa834
Merge branch 'geneartive_dynamic_metrics' into config_templates
db36e166
nicers tests + fix them
44aeecfc
nicer todo
2bff9633
add nice doscrings 📃
3c9eb211
add even more docstring
4216ae29
nit
d8f56b80
fix test
f26e88cb
add multilingual to dev group
111d615a
merge nli, add languagees to literals
7ca42394
translation literals
22eeddb4
Merge branch 'geneartive_dynamic_metrics' into config_templates
2d092561
Update src/lighteval/tasks/templates/nli.py
ec6aa41d
Update src/lighteval/tasks/templates/continuation.py
2652a996
Update src/lighteval/tasks/templates/multichoice.py
f8d2e9c1
nice docstrings + remove unecessary comments
319615b7
Merge branch 'config_templates' of github.com:huggingface/lighteval i…
a2a9101c
beatufiful docstrings
47f908cf
hynky1999
changed the title
Merge remote-tracking branch 'origin/main' into config_templates
c40ab45d
Merge remote-tracking branch 'origin/main' into config_templates
1bc19b8b
Merge branch 'config_templates' of github.com:huggingface/lighteval i…
d5166957
clefourrier
approved these changes
on 2024-09-30
Login to write a write a comment.
Login via GitHub