huggingface/lighteval

Pull Requests Commits

Multilingual NLI Tasks (#329)

hynky1999 committed 1 year ago

Verified 551572ae

Allow kwargs for BERTScore compute function and remove unused var (#311)

chuandudx committed 1 year ago

Verified 170ed872

Adds tasks templating (#335)

hynky1999 committed 1 year ago

Verified b5d8fdf4

Class implementations of faithfulness and extractiveness metrics (#323)

chuandudx committed 1 year ago

Verified 5584e23c

Skipping push to hub test (#334)

clefourrier committed 1 year ago

Verified 1f303977

Support for multilingual generative metrics (#293)

hynky1999 committed 1 year ago

Verified 1bb0dff1

Math normalization: do not crash on invalid format (#331)

guipenedo committed 1 year ago

Verified 7e80aaa1

readme rewrite (#327)

NathanHB committed 1 year ago

Verified ba202480

[FIX] Fixes vllm backend (#317)

NathanHB committed 1 year ago

Verified 4b06b944

fix doc in readme (#303)

NathanHB committed 1 year ago

Verified 7295c78f

skip tests if secrets not provided (#304)

hynky1999 committed 1 year ago

Verified 6b943ecb

fix readme doc about custom tasks (#300)

NathanHB committed 1 year ago

Verified 3dd7d500

Fixes bug: You can't create a model without either a list of model_args or a model_config_path when model_config_path was submited (#298)

NathanHB committed 1 year ago

Verified 8d833565

Task config (#289)

hynky1999 committed 1 year ago

Verified 919be479

Tokenization-wise encoding (#287)

hynky1999 committed 1 year ago

Verified 5034a962

bump dev version to 0.5.0 (#291)

NathanHB committed 1 year ago

Verified 7261d80d

bump nltk version (#290)

NathanHB committed 1 year ago

Verified 279a9f2a

Logging Revamp (#284)

hynky1999 committed 1 year ago

Verified e0af8215

Standalone nanotron config (#285)

hynky1999 committed 1 year ago

Verified aaa8bbf7

add vlmm backend (#274)

NathanHB committed 1 year ago

Verified 21934d52

Probability Metric + New Normalization (#276)

hynky1999 committed 1 year ago

Verified 8c787df2

fix nanotron (#283)

NathanHB committed 1 year ago

Verified cdeb6c2d

Refactoring the few shot management (#272)

clefourrier committed 1 year ago

Verified 24adaa20

Example Configs and Docs (#255)

RohitMidha23 committed 1 year ago

Verified 8883a77f

Remove expensive prediction run during test collection (#279)

hynky1999 committed 1 year ago

Verified 357c75bf

make info loggers dataclass, so that their properties have expected lifetime (#280)

hynky1999 committed 1 year ago

Verified 52a12f98

Small file reorg (only renames/moves) (#271)

clefourrier committed 1 year ago

Verified e6b599a1

Programmatic interface + cleaner management of requests (#269)

clefourrier committed 1 year ago

Verified 9c82fdb8

Add grammar option to generation (#242)

sadra-barikbin committed 1 year ago

Verified e43c9490

updates ifeval repo (#268)

NathanHB committed 1 year ago

Verified cf87de99

Newer Older