lighteval
9c82fdb8 - Programmatic interface + cleaner management of requests (#269)

Commit
1 year ago
Programmatic interface + cleaner management of requests (#269) * Added model info to models, edited mains to homogenenize them, added a pipeline for neater launches * fix circular import * forgot one import * mini fixes * fix for config logging * fix tests * style * code review * added evaluator to pipeline, as these blocks are logically redundant * forgot to push the tests * Update __main__.py * fix init of requests * debug recursive import + logging + metric execution calls * fix test call * simplified tests reading * review comment * Update src/lighteval/tasks/requests.py Co-authored-by: Nathan Habib <30601243+NathanHB@users.noreply.github.com> * made more programmatic for model creation too --------- Co-authored-by: Nathan Habib <30601243+NathanHB@users.noreply.github.com>
Author
Parents
Loading