Support for multilingual generative metrics #293
clefourrier
merged
27 commits into
main
from
geneartive_dynamic_metrics
add multilignaul dynamic generative metrics
5c69eb04
Merge branch 'main' into geneartive_dynamic_metrics
39c4220d
Merge branch 'main' into geneartive_dynamic_metrics
3aa05796
update tokenizers + install nltk reqs
b8f90a9e
use punkt tab
f5a8717e
NathanHB
commented
on 2024-09-10
NathanHB
commented
on 2024-09-10
NathanHB
commented
on 2024-09-10
Update src/lighteval/utils/imports.py
227f5729
Update src/lighteval/metrics/normalizations.py
d80b3bac
fix imports
532bdadd
remove unused import
75f7ac5d
Merge branch 'main' into geneartive_dynamic_metrics
f99e330d
Merge branch 'main' into geneartive_dynamic_metrics
92daf909
Merge branch 'main' into geneartive_dynamic_metrics
f2a801d0
resolve nits
9356cc62
when in rome do as romans do (handle error messages the same way)
0fbc7313
fix utils
fa1fa834
fix test
f26e88cb
add multilingual to dev group
111d615a
Merge branch 'main' into geneartive_dynamic_metrics
27c84037
Update src/lighteval/utils/imports.py
3082e5a4
Update src/lighteval/utils/imports.py
d4d6fcf6
Update src/lighteval/metrics/normalizations.py
9eaa5f10
nits
ea451859
Merge branch 'geneartive_dynamic_metrics' of github.com:huggingface/l…
bbfd7590
add thai tokenizer to spacy install + remove multilngual from dev + a…
300a64f3
actually add the deps to test workflow
f728c60f
Merge branch 'main' into geneartive_dynamic_metrics
6877aeba
fix pipeline not renamed + quality
050dbe29
Login to write a write a comment.
Login via GitHub