lighteval
Add IFBench
#944
Merged
Overview
Commits
13
Changes
View On GitHub

Add IFBench #944

NathanHB merged 13 commits into main from clem-add-ifbench2
clefourrier
clefourrier init, wip
0ecd7b89
clefourrier unrelated but these tasks were buggy
cfff0e90
clefourrier better suite management: we don't load all optional deps all the time
197acb75
clefourrier upgrade
09e3f97b
clefourrier singleton + transformer sampling fix in config
0adf37e4
clefourrier incredible how much code was just pulled from ifeval
bc882cdd
clefourrier fix test 1
833e67dc
clefourrier fix test 2
fbebba7b
clefourrier fix tests part 1 - also removes fewshot truncation in the task name b…
70378150
clefourrier fix registry mockup
65c13414
clefourrier fixed last tests
fa9a4b8d
clefourrier Merge branch 'main' into clem-add-ifbench
4f69c6ca
clefourrier clefourrier marked this pull request as draft 133 days ago
HuggingFaceDocBuilderDev
clefourrier Merge branch 'main' into clem-add-ifbench2
31a53fc5
NathanHB
NathanHB approved these changes on 2025-09-15
NathanHB NathanHB added new-task
NathanHB NathanHB marked this pull request as ready for review 118 days ago
NathanHB NathanHB merged 3a71f688 into main 118 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
new-task
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum