lighteval
706f97eb - Fixing some silent bugs in Arabic Custom Tasks (#556)

Commit
269 days ago
Fixing some silent bugs in Arabic Custom Tasks (#556) * Update arabic_evals.py Fix alghafa prompt function by explicitly determining the list of choices based on task_name. Not all subsets of AlGhafa Native share same columns * Update community_tasks/arabic_evals.py Co-authored-by: Clémentine Fourrier <22726840+clefourrier@users.noreply.github.com> * Update arabic_evals.py Fix to `KeyError: 'sol3'` and `TypeError: Doc.__init__() got an unexpected keyword argument 'target_for_fewshot_sorting'` * Fix formatting and linting issues via pre-commit hooks * Update arabic_evals.py * Update arabic_evals.py * Update arabic_evals.py correct prompt function * Update arabic_evals.py * Update arabic_evals.py * Update OALL_v2_tasks.txt * Fix formatting and linting issues via pre-commit hooks --------- Co-authored-by: Clémentine Fourrier <22726840+clefourrier@users.noreply.github.com> Co-authored-by: Nathan Habib <30601243+NathanHB@users.noreply.github.com>
Author
Parents
Loading