huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into hellaswag_tasks

clefourrier committed 1 year ago

Verified 9bf53e93

Fix Metrics import path in community task template file. (#309)

chuandudx committed 1 year ago

Verified 01e7240a

let strip be optional in hellaswag

hynky1999 committed 1 year ago

6284fe5d

change unoficial hellaswag names to have community_prefix + unify hellaswag preprocesisng

hynky1999 committed 1 year ago

eec2444f

enable returning none from templates + better typing

hynky1999 committed 1 year ago

815e8977

Merge remote-tracking branch 'origin/main' into hellaswag_tasks

hynky1999 committed 1 year ago

3c453f79

Multilingual COPA tasks (#330)

hynky1999 committed 1 year ago

Verified 7b94a180

Update src/lighteval/tasks/multilingual/tasks.py

hynky1999 committed 1 year ago

Verified a673d655

Multilingual NLI Tasks (#329)

hynky1999 committed 1 year ago

Verified 551572ae

move hellaswag to lighteval suite

hynky1999 committed 1 year ago

43809ab5

update hellaswag with docs

hynky1999 committed 1 year ago

fcad0e8d

Merge branch 'multilang_copa_task' into hellaswag_tasks

hynky1999 committed 1 year ago

8899a1cd

hynky1999 committed 1 year ago

b219e070

Merge branch 'multilnag_nli_tasks' into multilang_copa_task

hynky1999 committed 1 year ago

f9c71346

Merge remote-tracking branch 'origin/main' into multilnag_nli_tasks

hynky1999 committed 1 year ago

7b561fe6

Merge branch 'multilnag_nli_tasks' of github.com:huggingface/lighteval into multilnag_nli_tasks

hynky1999 committed 1 year ago

4e6100dd

add two new tasks + docs

hynky1999 committed 1 year ago

150c76fa

Update src/lighteval/tasks/multilingual/tasks.py

hynky1999 committed 1 year ago

Verified 99524c5a

Update src/lighteval/tasks/multilingual/tasks.py

hynky1999 committed 1 year ago

Verified e560738b

Update src/lighteval/tasks/multilingual/tasks.py

hynky1999 committed 1 year ago

Verified 35d7e6d6

Update src/lighteval/tasks/multilingual/tasks.py

hynky1999 committed 1 year ago

Verified 9806fab7

Update src/lighteval/tasks/multilingual/tasks.py

hynky1999 committed 1 year ago

Verified d64251f1

Update src/lighteval/tasks/multilingual/tasks.py

hynky1999 committed 1 year ago

Verified 1cc1187f

Update src/lighteval/tasks/multilingual/tasks.py

hynky1999 committed 1 year ago

Verified ca865bd7

Allow kwargs for BERTScore compute function and remove unused var (#311)

chuandudx committed 1 year ago

Verified 170ed872

Adds tasks templating (#335)

hynky1999 committed 1 year ago

Verified b5d8fdf4

Class implementations of faithfulness and extractiveness metrics (#323)

chuandudx committed 1 year ago

Verified 5584e23c

Skipping push to hub test (#334)

clefourrier committed 1 year ago

Verified 1f303977

Support for multilingual generative metrics (#293)

hynky1999 committed 1 year ago

Verified 1bb0dff1

Math normalization: do not crash on invalid format (#331)

guipenedo committed 1 year ago

Verified 7e80aaa1

Older