lighteval
Programmatic interface + cleaner management of requests
#269
Merged

Programmatic interface + cleaner management of requests #269

clefourrier merged 25 commits into main from test_cleaning_up
clefourrier
clefourrier Added model info to models, edited mains to homogenenize them, added …
6e1eabee
clefourrier fix circular import
e0bd17be
clefourrier forgot one import
60cfef18
clefourrier mini fixes
796bc4df
clefourrier fix for config logging
9e5fb903
clefourrier fix tests
2f20a17e
clefourrier Merge branch 'main' into clem_add_pipeline
533c3332
clefourrier Merge branch 'main' into clem_add_pipeline
67c8e5cc
clefourrier style
5f1939dc
NathanHB Merge branch 'main' into clem_add_pipeline
c26cb034
clefourrier Merge branch 'main' into clem_add_pipeline
375b99b6
clefourrier code review
62a3d738
clefourrier added evaluator to pipeline, as these blocks are logically redundant
e5754d25
clefourrier clefourrier changed the base branch from main to clem_add_pipeline 1 year ago
clefourrier forgot to push the tests
6acd6e7f
clefourrier clefourrier changed the base branch from clem_add_pipeline to main 1 year ago
clefourrier Update __main__.py
6f917036
clefourrier fix init of requests
7d1fe3f4
clefourrier debug recursive import + logging + metric execution calls
7d77197f
clefourrier Merge branch 'main' into test_cleaning_up
cb2c41e9
clefourrier clefourrier changed the title Cleaning up step 1 Programmatic interface + cleaner management of requests 1 year ago
clefourrier fix test call
fe0adb0e
NathanHB
NathanHB commented on 2024-08-19
NathanHB
NathanHB commented on 2024-08-19
NathanHB
NathanHB commented on 2024-08-19
clefourrier simplified tests reading
f223f929
clefourrier review comment
cc81e407
clefourrier Update src/lighteval/tasks/requests.py
cecfa5b9
clefourrier Merge branch 'main' into test_cleaning_up
22a9a5fd
clefourrier made more programmatic for model creation too
9bb46b7a
clefourrier clefourrier requested a review from NathanHB NathanHB 1 year ago
clefourrier Merge branch 'main' into test_cleaning_up
783251f2
NathanHB
NathanHB approved these changes on 2024-08-21
clefourrier clefourrier merged 9c82fdb8 into main 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone