lighteval
Implemented the possibility to load predictions from details files and continue evaluating from there
#488
Merged
Merged
Implemented the possibility to load predictions from details files and continue evaluating from there #488
NathanHB
merged
10 commits into
huggingface:main
from
JoelNiklaus:load-details
Implemented the possibility to load predictions from details files an…
a95156e8
Run model as fallback when no details can be loaded.
66244528
Merge branch 'main' into load-details
ed676249
Merge branch 'main' into load-details
874541bd
Improved loading speed and added more useful error messages.
742a6724
Fixed typo.
eaedd04c
Fixed gnarly bug with details loading to prevent loading too many exa…
ca8331a9
Unpacking predictions to fix issue with weirdly saved predictions.
3a22d93d
Made bulk loading easier by also allowing first timestamp more genera…
dae2d2bc
Made loading details more robust against tensors being saved in the d…
299b90ce
clefourrier
approved these changes
on 2025-01-29
NathanHB
approved these changes
on 2025-01-29
Login to write a write a comment.
Login via GitHub