huggingface/lighteval

Pull Requests Commits

hynky1999 committed 1 year ago

8ead4de0

fix remaning tasks in mcq

hynky1999 committed 1 year ago

8b5a0461

Fix Metrics import path in community task template file. (#309)

chuandudx committed 1 year ago

Verified 01e7240a

hynky1999 committed 1 year ago

32c8a4e9

let strip be optional in hellaswag

hynky1999 committed 1 year ago

6284fe5d

community rename

hynky1999 committed 1 year ago

02c8122f

change unoficial hellaswag names to have community_prefix + unify hellaswag preprocesisng

hynky1999 committed 1 year ago

eec2444f

fix saving of partial fcs + better tasks doc

hynky1999 committed 1 year ago

2a8ae3dd

hynky1999 committed 1 year ago

0d7b8490

Merge branch 'rc_tasks' into multilang_mqa_tasks

hynky1999 committed 1 year ago

843fe9ad

Merge branch 'hellaswag_tasks' into rc_tasks

hynky1999 committed 1 year ago

f9801c7f

enable returning none from templates + better typing

hynky1999 committed 1 year ago

815e8977

Merge remote-tracking branch 'origin/main' into hellaswag_tasks

hynky1999 committed 1 year ago

3c453f79

Multilingual COPA tasks (#330)

hynky1999 committed 1 year ago

Verified 7b94a180

Update src/lighteval/tasks/multilingual/tasks.py

hynky1999 committed 1 year ago

Verified a673d655

Multilingual NLI Tasks (#329)

hynky1999 committed 1 year ago

Verified 551572ae

add desc to tasks

hynky1999 committed 1 year ago

a20a24e5

move hellaswag to lighteval suite

hynky1999 committed 1 year ago

43809ab5

update hellaswag with docs

hynky1999 committed 1 year ago

fcad0e8d

Merge branch 'multilang_copa_task' into hellaswag_tasks

hynky1999 committed 1 year ago

8899a1cd

hynky1999 committed 1 year ago

b219e070

Merge branch 'multilnag_nli_tasks' into multilang_copa_task

hynky1999 committed 1 year ago

f9c71346

Merge remote-tracking branch 'origin/main' into multilnag_nli_tasks

hynky1999 committed 1 year ago

7b561fe6

Merge branch 'multilnag_nli_tasks' of github.com:huggingface/lighteval into multilnag_nli_tasks

hynky1999 committed 1 year ago

4e6100dd

add two new tasks + docs

hynky1999 committed 1 year ago

150c76fa

Update src/lighteval/tasks/multilingual/tasks.py

hynky1999 committed 1 year ago

Verified 99524c5a

Update src/lighteval/tasks/multilingual/tasks.py

hynky1999 committed 1 year ago

Verified e560738b

Update src/lighteval/tasks/multilingual/tasks.py

hynky1999 committed 1 year ago

Verified 35d7e6d6

Update src/lighteval/tasks/multilingual/tasks.py

hynky1999 committed 1 year ago

Verified 9806fab7

Update src/lighteval/tasks/multilingual/tasks.py

hynky1999 committed 1 year ago

Verified d64251f1

Newer Older