huggingface/lighteval

Pull Requests Commits

fixes from review

NathanHB committed 1 year ago

9c43cc8a

Merge branch 'nathan-add-openai-model' of github.com:huggingface/lighteval into nathan-add-openai-model

NathanHB committed 1 year ago

16a60bf9

fixes from review

NathanHB committed 1 year ago

78991947

Merge branch 'main' into nathan-add-openai-model

NathanHB committed 1 year ago

Verified cf74837b

Merge branch 'nathan-add-openai-model' of github.com:huggingface/lighteval into nathan-add-openai-model

NathanHB committed 1 year ago

214ce870

fixes from review

NathanHB committed 1 year ago

ad966aa3

Fix BLEURT evaluation errors (#316)

chuandudx committed 1 year ago

Verified d84c3783

Adding OZ Eval task (#225)

Stopwolf committed 1 year ago

Verified e27aa0e6

clefourrier committed 1 year ago

Verified 9134ca8c

Serbian LLM Benchmark Task (#340)

DeanChugall committed 1 year ago

Verified 635e5812

adds openai models

NathanHB committed 1 year ago

491c50f5

Merge branch 'main' into nathan-add-openai-model

NathanHB committed 1 year ago

Verified 12d401eb

adds openai models

NathanHB committed 1 year ago

9ffaac6b

adds openai models

NathanHB committed 1 year ago

1cbb68ac

adds openai models

NathanHB committed 1 year ago

bb2ec928

adds openai models

NathanHB committed 1 year ago

e729ee6f

add iroko bench + nicer output on task search failure (#357)

hynky1999 committed 1 year ago

Verified c1366677

Misc-multilingual tasks (#339)

hynky1999 committed 1 year ago

Verified b018c9c7

Fix Tokenization + misc fixes (#354)

hynky1999 committed 1 year ago

Verified 1dfd77d1

Selecting tasks using their superset (#308)

hynky1999 committed 1 year ago

Verified 78cda93f

Nathan llm judge quickfix (#350)

NathanHB committed 1 year ago

Verified b8923aa7

Nathan llm judge quickfix (#348)

NathanHB committed 1 year ago

Verified a6cf5cb3

NathanHB committed 1 year ago

Verified cf40366d

bump lighteval versoin (#328)

NathanHB committed 1 year ago

Verified f89ae20c

refacto judge and add mixeval (#337)

NathanHB committed 1 year ago

Verified 0483bef8

Fixes sampling for vllm when num_samples==1 (#343)

edbeeching committed 1 year ago

Verified 230b31bf

Multilingual General Knowledge tasks (#338)

hynky1999 committed 1 year ago

Verified 9cd26bc7

Multilingual Reading Comprehension tasks (#333)

hynky1999 committed 1 year ago

Verified dd2927aa

Multilingual Hellaswag tasks (#332)

hynky1999 committed 1 year ago

Verified 994fe73c

Fix Metrics import path in community task template file. (#309)

chuandudx committed 1 year ago

Verified 01e7240a

Older