huggingface/lighteval

Pull Requests Commits

Adds config tempaltes (#295)

hynky1999 committed 1 year ago

Verified b014b50f

fix pipeline not renamed + quality

hynky1999 committed 1 year ago

050dbe29

Merge branch 'main' into geneartive_dynamic_metrics

hynky1999 committed 1 year ago

Verified 6877aeba

actually add the deps to test workflow

hynky1999 committed 1 year ago

f728c60f

add thai tokenizer to spacy install + remove multilngual from dev + add multilingual to tests workflow

hynky1999 committed 1 year ago

300a64f3

Merge branch 'geneartive_dynamic_metrics' of github.com:huggingface/lighteval into geneartive_dynamic_metrics

hynky1999 committed 1 year ago

bbfd7590

hynky1999 committed 1 year ago

ea451859

Update src/lighteval/metrics/normalizations.py

hynky1999 committed 1 year ago

Verified 9eaa5f10

Update src/lighteval/utils/imports.py

hynky1999 committed 1 year ago

Verified d4d6fcf6

Update src/lighteval/utils/imports.py

hynky1999 committed 1 year ago

Verified 3082e5a4

Math normalization: do not crash on invalid format (#331)

guipenedo committed 1 year ago

Verified 7e80aaa1

Merge branch 'main' into geneartive_dynamic_metrics

hynky1999 committed 1 year ago

Verified 27c84037

readme rewrite (#327)

NathanHB committed 1 year ago

Verified ba202480

add multilingual to dev group

hynky1999 committed 1 year ago

111d615a

[FIX] Fixes vllm backend (#317)

NathanHB committed 1 year ago

Verified 4b06b944

hynky1999 committed 1 year ago

f26e88cb

hynky1999 committed 1 year ago

fa1fa834

when in rome do as romans do (handle error messages the same way)

Hynek Kydlicek committed 1 year ago

0fbc7313

Hynek Kydlicek committed 1 year ago

9356cc62

Merge branch 'main' into geneartive_dynamic_metrics

NathanHB committed 1 year ago

Verified f2a801d0

fix doc in readme (#303)

NathanHB committed 1 year ago

Verified 7295c78f

skip tests if secrets not provided (#304)

hynky1999 committed 1 year ago

Verified 6b943ecb

fix readme doc about custom tasks (#300)

NathanHB committed 1 year ago

Verified 3dd7d500

Fixes bug: You can't create a model without either a list of model_args or a model_config_path when model_config_path was submited (#298)

NathanHB committed 1 year ago

Verified 8d833565

Merge branch 'main' into geneartive_dynamic_metrics

clefourrier committed 1 year ago

Verified 92daf909

Task config (#289)

hynky1999 committed 1 year ago

Verified 919be479

Merge branch 'main' into geneartive_dynamic_metrics

NathanHB committed 1 year ago

Verified f99e330d

remove unused import

Hynek Kydlicek committed 1 year ago

75f7ac5d

Tokenization-wise encoding (#287)

hynky1999 committed 1 year ago

Verified 5034a962

Hynek Kydlicek committed 1 year ago

532bdadd

Older