Registry refactorisation #937
clefourrier
merged
19 commits into
main
from
clem-add-ifbench
init, wip
0ecd7b89
unrelated but these tasks were buggy
cfff0e90
better suite management: we don't load all optional deps all the time
197acb75
upgrade
09e3f97b
clefourrier
commented
on 2025-08-26
singleton + transformer sampling fix in config
0adf37e4
incredible how much code was just pulled from ifeval
bc882cdd
fix test 1
833e67dc
fix test 2
fbebba7b
fix tests part 1 - also removes fewshot truncation in the task name b…
70378150
fix registry mockup
65c13414
fixed last tests
fa9a4b8d
Merge branch 'main' into clem-add-ifbench
4f69c6ca
clefourrier
commented
on 2025-08-29
remove ifbench
27bdf898
allow old task name but logs a warning
a5e590c8
NathanHB
commented
on 2025-09-01
NathanHB
commented
on 2025-09-01
clefourrier
commented
on 2025-09-01
Update tests/utils.py
8f989faa
clefourrier
commented
on 2025-09-01
Update src/lighteval/tasks/registry.py
4b008569
NathanHB
commented
on 2025-09-01
NathanHB
commented
on 2025-09-01
NathanHB
approved these changes
on 2025-09-01
Update src/lighteval/tasks/registry.py
724ebf62
clefourrier
commented
on 2025-09-01
Update src/lighteval/tasks/registry.py
79f90fbd
style
64b23f4c
Login to write a write a comment.
Login via GitHub