huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into nathan-refacto-judge-and-add-mixeval

NathanHB committed 1 year ago

Verified f14b4bb1

NathanHB committed 1 year ago

fb05793e

Fixes sampling for vllm when num_samples==1 (#343)

edbeeching committed 1 year ago

Verified 230b31bf

NathanHB committed 1 year ago

d67925cd

Merge branch 'nathan-refacto-judge-and-add-mixeval' of github.com:huggingface/lighteval into nathan-refacto-judge-and-add-mixeval

NathanHB committed 1 year ago

499c6f91

NathanHB committed 1 year ago

0c07b20a

Merge branch 'main' into nathan-refacto-judge-and-add-mixeval

clefourrier committed 1 year ago

Verified 430b6f84

Multilingual General Knowledge tasks (#338)

hynky1999 committed 1 year ago

Verified 9cd26bc7

NathanHB committed 1 year ago

07a9c728

Merge branch 'nathan-refacto-judge-and-add-mixeval' of github.com:huggingface/lighteval into nathan-refacto-judge-and-add-mixeval

NathanHB committed 1 year ago

e70c88d6

batch llm as judge

NathanHB committed 1 year ago

cfdf3dba

Multilingual Reading Comprehension tasks (#333)

hynky1999 committed 1 year ago

Verified dd2927aa

Multilingual Hellaswag tasks (#332)

hynky1999 committed 1 year ago

Verified 994fe73c

Fix Metrics import path in community task template file. (#309)

chuandudx committed 1 year ago

Verified 01e7240a

Multilingual COPA tasks (#330)

hynky1999 committed 1 year ago

Verified 7b94a180

Multilingual NLI Tasks (#329)

hynky1999 committed 1 year ago

Verified 551572ae

Merge branch 'main' into nathan-refacto-judge-and-add-mixeval

NathanHB committed 1 year ago

Verified 03dada7f

Update src/lighteval/metrics/metrics.py

NathanHB committed 1 year ago

Verified 733dac88

refacto judge and add mixeval

NathanHB committed 1 year ago

4fbebf97

Allow kwargs for BERTScore compute function and remove unused var (#311)

chuandudx committed 1 year ago

Verified 170ed872

Adds tasks templating (#335)

hynky1999 committed 1 year ago

Verified b5d8fdf4

Class implementations of faithfulness and extractiveness metrics (#323)

chuandudx committed 1 year ago

Verified 5584e23c

Skipping push to hub test (#334)

clefourrier committed 1 year ago

Verified 1f303977

Support for multilingual generative metrics (#293)

hynky1999 committed 1 year ago

Verified 1bb0dff1

Math normalization: do not crash on invalid format (#331)

guipenedo committed 1 year ago

Verified 7e80aaa1

readme rewrite (#327)

NathanHB committed 1 year ago

Verified ba202480

[FIX] Fixes vllm backend (#317)

NathanHB committed 1 year ago

Verified 4b06b944

fix doc in readme (#303)

NathanHB committed 1 year ago

Verified 7295c78f

skip tests if secrets not provided (#304)

hynky1999 committed 1 year ago

Verified 6b943ecb

fix readme doc about custom tasks (#300)

NathanHB committed 1 year ago

Verified 3dd7d500

Older