PR #329 Multilingual NLI Tasks

Multilingual NLI Tasks #329

hynky1999 merged 43 commits into main from multilnag_nli_tasks

add multilignaul dynamic generative metrics

5c69eb04

Merge branch 'main' into geneartive_dynamic_metrics

39c4220d

Merge branch 'geneartive_dynamic_metrics' into config_templates

2a5cdca9

draft

2df9a082

finish multichoice config

95729ee5

Merge branch 'main' into geneartive_dynamic_metrics

3aa05796

update tokenizers + install nltk reqs

b8f90a9e

use punkt tab

f5a8717e

Update src/lighteval/utils/imports.py

227f5729

Update src/lighteval/metrics/normalizations.py

d80b3bac

fix imports

532bdadd

remove unused import

75f7ac5d

Merge branch 'main' into geneartive_dynamic_metrics

f99e330d

Merge branch 'main' into geneartive_dynamic_metrics

92daf909

Merge branch 'main' into geneartive_dynamic_metrics

f2a801d0

finish implementation of templates + move stuff around

91d9d4f7

resolve nits

9356cc62

when in rome do as romans do (handle error messages the same way)

0fbc7313

fix utils

fa1fa834

Merge branch 'geneartive_dynamic_metrics' into config_templates

db36e166

nicers tests + fix them

44aeecfc

nicer todo

2bff9633

add nice doscrings 📃

3c9eb211

add even more docstring

4216ae29

nit

d8f56b80

fix test

f26e88cb

add multilingual to dev group

111d615a

merge nli, add languagees to literals

7ca42394

translation literals

22eeddb4

add nli

7faaa8a4

hynky1999 changed the base branch from main to config_templates 1 year ago

hynky1999 requested a review from

clefourrier 1 year ago

hynky1999 force pushed from bfd34e00 to 7faaa8a4 1 year ago

add rcb + chinese nli

ba44fe9d

Merge branch 'geneartive_dynamic_metrics' into config_templates

2d092561

Merge branch 'config_templates' into multilnag_nli_tasks

7324e896

clefourrier approved these changes on 2024-09-27