lighteval
94fc5a28 - Implemented the possibility to load predictions from details files and continue evaluating from there (#488)

Commit
1 year ago
Implemented the possibility to load predictions from details files and continue evaluating from there (#488) * Implemented the possibility to load predictions from details files and continue evaluating from there. * Run model as fallback when no details can be loaded. * Improved loading speed and added more useful error messages. * Fixed typo. * Fixed gnarly bug with details loading to prevent loading too many examples. * Unpacking predictions to fix issue with weirdly saved predictions. * Made bulk loading easier by also allowing first timestamp more generally. * Made loading details more robust against tensors being saved in the details files.
Author
Parents
Loading