lighteval
Multilingual COPA tasks
#330
Merged

Commits
  • add multilignaul dynamic generative metrics
    hynky1999 committed 1 year ago
  • Merge branch 'main' into geneartive_dynamic_metrics
    hynky1999 committed 1 year ago
  • Merge branch 'geneartive_dynamic_metrics' into config_templates
    hynky1999 committed 1 year ago
  • draft
    hynky1999 committed 1 year ago
  • finish multichoice config
    hynky1999 committed 1 year ago
  • Merge branch 'main' into geneartive_dynamic_metrics
    hynky1999 committed 1 year ago
  • update tokenizers + install nltk reqs
    hynky1999 committed 1 year ago
  • use punkt tab
    hynky1999 committed 1 year ago
  • Update src/lighteval/utils/imports.py
    hynky1999 committed 1 year ago
  • Update src/lighteval/metrics/normalizations.py
    hynky1999 committed 1 year ago
  • fix imports
    Hynek Kydlicek committed 1 year ago
  • remove unused import
    Hynek Kydlicek committed 1 year ago
  • Merge branch 'main' into geneartive_dynamic_metrics
    NathanHB committed 1 year ago
  • Merge branch 'main' into geneartive_dynamic_metrics
    clefourrier committed 1 year ago
  • Merge branch 'main' into geneartive_dynamic_metrics
    NathanHB committed 1 year ago
  • finish implementation of templates + move stuff around
    Hynek Kydlicek committed 1 year ago
  • resolve nits
    Hynek Kydlicek committed 1 year ago
  • when in rome do as romans do (handle error messages the same way)
    Hynek Kydlicek committed 1 year ago
  • fix utils
    hynky1999 committed 1 year ago
  • Merge branch 'geneartive_dynamic_metrics' into config_templates
    hynky1999 committed 1 year ago
  • nicers tests + fix them
    hynky1999 committed 1 year ago
  • nicer todo
    hynky1999 committed 1 year ago
  • add nice doscrings 📃
    hynky1999 committed 1 year ago
  • add even more docstring
    hynky1999 committed 1 year ago
  • nit
    hynky1999 committed 1 year ago
  • fix test
    hynky1999 committed 1 year ago
  • add multilingual to dev group
    hynky1999 committed 1 year ago
  • merge nli, add languagees to literals
    hynky1999 committed 1 year ago
  • translation literals
    hynky1999 committed 1 year ago
  • add nli
    hynky1999 committed 1 year ago
  • add copa tasks + fix tranlation literals
    hynky1999 committed 1 year ago
  • add rcb + chinese nli
    hynky1999 committed 1 year ago
  • Merge branch 'geneartive_dynamic_metrics' into config_templates
    hynky1999 committed 1 year ago
  • Merge branch 'config_templates' into multilnag_nli_tasks
    hynky1999 committed 1 year ago
  • Merge branch 'multilnag_nli_tasks' into multilang_copa_task
    hynky1999 committed 1 year ago
  • Update src/lighteval/tasks/multilingual/tasks.py
    hynky1999 committed 1 year ago
  • Update src/lighteval/tasks/multilingual/tasks.py
    hynky1999 committed 1 year ago
  • Update src/lighteval/tasks/multilingual/tasks.py
    hynky1999 committed 1 year ago
  • Update src/lighteval/tasks/multilingual/tasks.py
    hynky1999 committed 1 year ago
  • Update src/lighteval/tasks/multilingual/tasks.py
    hynky1999 committed 1 year ago
  • Update src/lighteval/tasks/multilingual/tasks.py
    hynky1999 committed 1 year ago
  • Update src/lighteval/tasks/multilingual/tasks.py
    hynky1999 committed 1 year ago
  • add two new tasks + docs
    hynky1999 committed 1 year ago
  • Merge branch 'multilnag_nli_tasks' of github.com:huggingface/lighteval into multilnag_nli_tasks
    hynky1999 committed 1 year ago
  • Merge remote-tracking branch 'origin/main' into multilnag_nli_tasks
    hynky1999 committed 1 year ago
  • Merge branch 'multilnag_nli_tasks' into multilang_copa_task
    hynky1999 committed 1 year ago
  • add nice docs
    hynky1999 committed 1 year ago
  • Merge remote-tracking branch 'origin/main' into multilang_copa_task
    hynky1999 committed 1 year ago
Loading