huggingface/lighteval

Pull Requests Commits

Empty commit to retrigger actions

hynky1999 committed 1 year ago

98e0648f

translation literals defaults + nits in adapters

hynky1999 committed 1 year ago

c7a72d98

Merge remote-tracking branch 'origin/main' into multilang_mqa_tasks

hynky1999 committed 1 year ago

98e5450f

Merge branch 'rc_tasks' into multilang_mqa_tasks

hynky1999 committed 1 year ago

02d1d2b3

Multilingual Reading Comprehension tasks (#333)

hynky1999 committed 1 year ago

Verified dd2927aa

update the datasets after changing ownership

hynky1999 committed 1 year ago

f81eac82

Merge branch 'rc_tasks' into multilang_mqa_tasks

hynky1999 committed 1 year ago

1f8c8e69

Merge remote-tracking branch 'origin/main' into rc_tasks

hynky1999 committed 1 year ago

6f3de8cc

hynky1999 committed 1 year ago

e12cc3b1

fix up agieval + ceval

hynky1999 committed 1 year ago

ca9d190c

Multilingual Hellaswag tasks (#332)

hynky1999 committed 1 year ago

Verified 994fe73c

hynky1999 committed 1 year ago

03bd7ba4

Merge branch 'hellaswag_tasks' into rc_tasks

hynky1999 committed 1 year ago

d7b98c0a

hynky1999 committed 1 year ago

8ead4de0

fix remaning tasks in mcq

hynky1999 committed 1 year ago

8b5a0461

Fix Metrics import path in community task template file. (#309)

chuandudx committed 1 year ago

Verified 01e7240a

hynky1999 committed 1 year ago

32c8a4e9

let strip be optional in hellaswag

hynky1999 committed 1 year ago

6284fe5d

community rename

hynky1999 committed 1 year ago

02c8122f

change unoficial hellaswag names to have community_prefix + unify hellaswag preprocesisng

hynky1999 committed 1 year ago

eec2444f

fix saving of partial fcs + better tasks doc

hynky1999 committed 1 year ago

2a8ae3dd

hynky1999 committed 1 year ago

0d7b8490

Merge branch 'rc_tasks' into multilang_mqa_tasks

hynky1999 committed 1 year ago

843fe9ad

Merge branch 'hellaswag_tasks' into rc_tasks

hynky1999 committed 1 year ago

f9801c7f

enable returning none from templates + better typing

hynky1999 committed 1 year ago

815e8977

Merge remote-tracking branch 'origin/main' into hellaswag_tasks

hynky1999 committed 1 year ago

3c453f79

Multilingual COPA tasks (#330)

hynky1999 committed 1 year ago

Verified 7b94a180

Update src/lighteval/tasks/multilingual/tasks.py

hynky1999 committed 1 year ago

Verified a673d655

Multilingual NLI Tasks (#329)

hynky1999 committed 1 year ago

Verified 551572ae

add desc to tasks

hynky1999 committed 1 year ago

a20a24e5

Older