huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into misc_tasks

hynky1999 committed 1 year ago

Verified de16271b

Fix Tokenization + misc fixes (#354)

hynky1999 committed 1 year ago

Verified 1dfd77d1

Update src/lighteval/tasks/default_prompts.py

hynky1999 committed 1 year ago

Verified c299f89f

Update src/lighteval/tasks/default_prompts.py

hynky1999 committed 1 year ago

Verified 1a7fd132

Merge branch 'main' into misc_tasks

NathanHB committed 1 year ago

Verified 1008a1a0

Selecting tasks using their superset (#308)

hynky1999 committed 1 year ago

Verified 78cda93f

rename boolqa to boolq

hynky1999 committed 1 year ago

81c6a295

fix few shot splits + add boolq tasks

hynky1999 committed 1 year ago

a4d8e20a

Merge remote-tracking branch 'origin/main' into misc_tasks

hynky1999 committed 1 year ago

4fcc87d7

Nathan llm judge quickfix (#350)

NathanHB committed 1 year ago

Verified b8923aa7

Nathan llm judge quickfix (#348)

NathanHB committed 1 year ago

Verified a6cf5cb3

NathanHB committed 1 year ago

Verified cf40366d

bump lighteval versoin (#328)

NathanHB committed 1 year ago

Verified f89ae20c

refacto judge and add mixeval (#337)

NathanHB committed 1 year ago

Verified 0483bef8

Fixes sampling for vllm when num_samples==1 (#343)

edbeeching committed 1 year ago

Verified 230b31bf

Multilingual General Knowledge tasks (#338)

hynky1999 committed 1 year ago

Verified 9cd26bc7

hynky1999 committed 1 year ago

0f627963

Multilingual Reading Comprehension tasks (#333)

hynky1999 committed 1 year ago

Verified dd2927aa

improve qa readibility

hynky1999 committed 1 year ago

6244ad1c

add openai mmlu, turkish mmlu, lumi and mgsm

hynky1999 committed 1 year ago

db397b05

hellaswag hind + mlqa + hindi/swahili arc + mintaka + triviaqa french

hynky1999 committed 1 year ago

f523bbaf

hellaswag fixes

hynky1999 committed 1 year ago

d3ba842e

Merge branch 'multilang_mqa_tasks' into misc_tasks

hynky1999 committed 1 year ago

70b6b93d

Merge branch 'rc_tasks' into multilang_mqa_tasks

hynky1999 committed 1 year ago

1f8c8e69

Merge remote-tracking branch 'origin/main' into rc_tasks

hynky1999 committed 1 year ago

6f3de8cc

hynky1999 committed 1 year ago

e12cc3b1

fix up agieval + ceval

hynky1999 committed 1 year ago

ca9d190c

Multilingual Hellaswag tasks (#332)

hynky1999 committed 1 year ago

Verified 994fe73c

hynky1999 committed 1 year ago

03bd7ba4

Merge branch 'hellaswag_tasks' into rc_tasks

hynky1999 committed 1 year ago

d7b98c0a

Older