huggingface/lighteval

Pull Requests Commits
Update src/lighteval/tasks/multilingual/tasks.py
hynky1999 committed 1 year ago
Verified 1cc1187f
Update src/lighteval/tasks/multilingual/tasks.py
hynky1999 committed 1 year ago
Verified ca865bd7
add continuations + general qa tasks + missed tasks
hynky1999 committed 1 year ago
9a548062
Allow kwargs for BERTScore compute function and remove unused var (#311)
chuandudx committed 1 year ago
Verified 170ed872
Adds tasks templating (#335)
hynky1999 committed 1 year ago
Verified b5d8fdf4
add mcq tasks
hynky1999 committed 1 year ago
b10ff74c
Class implementations of faithfulness and extractiveness metrics (#323)
chuandudx committed 1 year ago
Verified 5584e23c
Skipping push to hub test (#334)
clefourrier committed 1 year ago
Verified 1f303977
Support for multilingual generative metrics (#293)
hynky1999 committed 1 year ago
Verified 1bb0dff1
Math normalization: do not crash on invalid format (#331)
guipenedo committed 1 year ago
Verified 7e80aaa1
Merge branch 'hellaswag_tasks' into rc_tasks
hynky1999 committed 1 year ago
a84e3688
Merge branch 'multilang_copa_task' into hellaswag_tasks
hynky1999 committed 1 year ago
680124ed
Merge branch 'multilnag_nli_tasks' into multilang_copa_task
hynky1999 committed 1 year ago
01161b2a
Merge branch 'config_templates' into multilnag_nli_tasks
hynky1999 committed 1 year ago
7324e896
Merge branch 'geneartive_dynamic_metrics' into config_templates
hynky1999 committed 1 year ago
2d092561
add rcb + chinese nli
hynky1999 committed 1 year ago
ba44fe9d
add rc tasks + small nits
hynky1999 committed 1 year ago
bc669e63
remove hindi hellaswag
hynky1999 committed 1 year ago
4165fc2b
remove custom telgu hellaswag
hynky1999 committed 1 year ago
0c7987f2
add hellaswag tasks
hynky1999 committed 1 year ago
856e758f
add copa tasks + fix tranlation literals
hynky1999 committed 1 year ago
865bcbc7
add nli
hynky1999 committed 1 year ago
7faaa8a4
translation literals
hynky1999 committed 1 year ago
22eeddb4
merge nli, add languagees to literals
hynky1999 committed 1 year ago
7ca42394
readme rewrite (#327)
NathanHB committed 1 year ago
Verified ba202480
add multilingual to dev group
hynky1999 committed 1 year ago
111d615a
[FIX] Fixes vllm backend (#317)
NathanHB committed 1 year ago
Verified 4b06b944
fix test
hynky1999 committed 1 year ago
f26e88cb
nit
hynky1999 committed 1 year ago
d8f56b80
add even more docstring
hynky1999 committed 1 year ago
4216ae29
Terms Of Use Privacy Policy Refund Policy Impressum