huggingface/lighteval

Pull Requests Commits

Merge branch 'config_templates' of github.com:huggingface/lighteval into config_templates

hynky1999 committed 1 year ago

d5166957

Merge remote-tracking branch 'origin/main' into config_templates

hynky1999 committed 1 year ago

1bc19b8b

Merge remote-tracking branch 'origin/main' into config_templates

hynky1999 committed 1 year ago

c40ab45d

beatufiful docstrings

hynky1999 committed 1 year ago

47f908cf

Merge branch 'config_templates' of github.com:huggingface/lighteval into config_templates

hynky1999 committed 1 year ago

a2a9101c

nice docstrings + remove unecessary comments

hynky1999 committed 1 year ago

319615b7

Class implementations of faithfulness and extractiveness metrics (#323)

chuandudx committed 1 year ago

Verified 5584e23c

Skipping push to hub test (#334)

clefourrier committed 1 year ago

Verified 1f303977

Support for multilingual generative metrics (#293)

hynky1999 committed 1 year ago

Verified 1bb0dff1

Update src/lighteval/tasks/templates/multichoice.py

hynky1999 committed 1 year ago

Verified f8d2e9c1

Update src/lighteval/tasks/templates/continuation.py

hynky1999 committed 1 year ago

Verified 2652a996

Update src/lighteval/tasks/templates/nli.py

hynky1999 committed 1 year ago

Verified ec6aa41d

Math normalization: do not crash on invalid format (#331)

guipenedo committed 1 year ago

Verified 7e80aaa1

Merge branch 'geneartive_dynamic_metrics' into config_templates

hynky1999 committed 1 year ago

2d092561

translation literals

hynky1999 committed 1 year ago

22eeddb4

merge nli, add languagees to literals

hynky1999 committed 1 year ago

7ca42394

readme rewrite (#327)

NathanHB committed 1 year ago

Verified ba202480

add multilingual to dev group

hynky1999 committed 1 year ago

111d615a

[FIX] Fixes vllm backend (#317)

NathanHB committed 1 year ago

Verified 4b06b944

hynky1999 committed 1 year ago

f26e88cb

hynky1999 committed 1 year ago

d8f56b80

add even more docstring

hynky1999 committed 1 year ago

4216ae29

add nice doscrings 📃

hynky1999 committed 1 year ago

3c9eb211

hynky1999 committed 1 year ago

2bff9633

nicers tests + fix them

hynky1999 committed 1 year ago

44aeecfc

Merge branch 'geneartive_dynamic_metrics' into config_templates

hynky1999 committed 1 year ago

db36e166

hynky1999 committed 1 year ago

fa1fa834

when in rome do as romans do (handle error messages the same way)

Hynek Kydlicek committed 1 year ago

0fbc7313

Hynek Kydlicek committed 1 year ago

9356cc62

finish implementation of templates + move stuff around

Hynek Kydlicek committed 1 year ago

91d9d4f7

Older