lighteval
Use the programmatic interface using an already in memory loaded model
#390
Merged

Use the programmatic interface using an already in memory loaded model #390

clefourrier merged 9 commits into main from clem_in_mem_model
clefourrier
clefourrier adding an init call to load models from an already in mem model
b107db7f
clefourrier pipeline working
8909bcaf
clefourrier
clefourrier add chat template as param
e43840e9
clefourrier manage accelerate if needed
cb8dd5bb
clefourrier fix tests
0f204ffc
clefourrier clefourrier requested a review from lewtun lewtun 1 year ago
clefourrier clefourrier requested a review from NathanHB NathanHB 1 year ago
clefourrier Merge branch 'main' into clem_in_mem_model
f2438a5f
clefourrier Merge branch 'main' into clem_in_mem_model
5edd48a8
NathanHB Merge branch 'main' into clem_in_mem_model
fb69543e
NathanHB
NathanHB commented on 2024-11-18
clefourrier
clefourrier commented on 2024-11-18
clefourrier Update src/lighteval/models/base_model.py
2dde33f9
NathanHB
NathanHB approved these changes on 2024-11-18
clefourrier
clefourrier clefourrier merged db609f79 into main 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone