huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into nathan-readme-rewrite

NathanHB committed 1 year ago

Verified c0d3933f

Update README.md

NathanHB committed 1 year ago

Verified 79551c67

Update README.md

NathanHB committed 1 year ago

Verified 178763e7

Update README.md

NathanHB committed 1 year ago

Verified 32da9d24

Update README.md

NathanHB committed 1 year ago

Verified c1ee34f8

Update README.md

NathanHB committed 1 year ago

Verified a6f77fb1

NathanHB committed 1 year ago

203fc8bf

[FIX] Fixes vllm backend (#317)

NathanHB committed 1 year ago

Verified 4b06b944

NathanHB committed 1 year ago

3188475e

NathanHB committed 1 year ago

633a7fd7

NathanHB committed 1 year ago

d02c4166

NathanHB committed 1 year ago

f068f16a

NathanHB committed 1 year ago

55131122

NathanHB committed 1 year ago

8094cdd6

NathanHB committed 1 year ago

f3fd6692

NathanHB committed 1 year ago

479c037a

fix doc in readme (#303)

NathanHB committed 1 year ago

Verified 7295c78f

skip tests if secrets not provided (#304)

hynky1999 committed 1 year ago

Verified 6b943ecb

fix readme doc about custom tasks (#300)

NathanHB committed 1 year ago

Verified 3dd7d500

Fixes bug: You can't create a model without either a list of model_args or a model_config_path when model_config_path was submited (#298)

NathanHB committed 1 year ago

Verified 8d833565

Task config (#289)

hynky1999 committed 1 year ago

Verified 919be479

Tokenization-wise encoding (#287)

hynky1999 committed 1 year ago

Verified 5034a962

bump dev version to 0.5.0 (#291)

NathanHB committed 1 year ago

Verified 7261d80d

bump nltk version (#290)

NathanHB committed 1 year ago

Verified 279a9f2a

Logging Revamp (#284)

hynky1999 committed 1 year ago

Verified e0af8215

Standalone nanotron config (#285)

hynky1999 committed 1 year ago

Verified aaa8bbf7

add vlmm backend (#274)

NathanHB committed 1 year ago

Verified 21934d52

Probability Metric + New Normalization (#276)

hynky1999 committed 1 year ago

Verified 8c787df2

fix nanotron (#283)

NathanHB committed 1 year ago

Verified cdeb6c2d

Refactoring the few shot management (#272)

clefourrier committed 1 year ago

Verified 24adaa20

Older