huggingface/lighteval

Pull Requests Commits

modifs to multiturn api for inspect

NathanHB committed 125 days ago

7203bb53

Merge branch 'main' into akshath/issue-1019-v2

akshathmangudi committed 127 days ago

Verified 945d79bf

refactor: adding api_key param to litellm (#1114)

pjavanrood committed 130 days ago

Verified 36b3e6c8

Enable loading data sets from files for custom tasks (#1083)

davebiagioni committed 132 days ago

Verified 03d8c4ee

Refactor PR Style Bot workflow with new inputs (#1105)

NathanHB committed 154 days ago

Verified 6496d623

Update comment bot secrets in workflow (#1107)

paulinebm committed 154 days ago

Verified 7fba130d

Merge branch 'main' into akshath/issue-1019-v2

akshathmangudi committed 155 days ago

Verified 5f70e1a1

Comment out PR Style Bot workflow configuration

paulinebm committed 158 days ago

Verified f48af0b0

Refactor PR Style Bot workflow configuration

paulinebm committed 158 days ago

Verified 8238d3e1

Comment out PR Style Bot workflow configuration

paulinebm committed 158 days ago

Verified 0a8b90a9

Add TEST secret environment variable

paulinebm committed 158 days ago

Verified 22aa98c1

Refactor PR Style Bot workflow configuration

paulinebm committed 158 days ago

Verified a5d13a42

addressed comments

akshathmangudi committed 159 days ago

d6aa3817

Merge branch 'main' into akshath/issue-1019-v2

akshathmangudi committed 159 days ago

Verified 23acb0c2

Comment out PR Style Bot workflow configuration

paulinebm committed 160 days ago

Verified 6d1f147b

aime_avg was not added to TASKS_TABLE (#1098)

francesco-bertolotti committed 161 days ago

Verified c6e2ce70

feat: Add Kyrgyz LLM Bench multilingual tasks (#1070)

golden-ratio committed 161 days ago

Verified 2c98b542

update hf_revision hash for multilingual hellaswag (#1084)

rpm000 committed 164 days ago

Verified 557b8d55

[DOC] Fix dev dependencies install command (#1085)

jgyasu committed 164 days ago

Verified 6889901c

Update available-tasks.mdx (#1088)

bram-pramono committed 164 days ago

Verified 48dcd834

Add starred attribute to gpqa.py metadata

NathanHB committed 164 days ago

Verified 98ac1bf7

Fix the quickstart description? (#1091)

julien-c committed 170 days ago

Verified 99ef5b98

Merge branch 'main' into akshath/issue-1019-v2

akshathmangudi committed 174 days ago

Verified 4c87372c

addressed comments

akshathmangudi committed 174 days ago

4c572e58

bumping version

NathanHB committed 174 days ago

58038182

add to inspect (#1065)

NathanHB committed 174 days ago

Verified 9009723b

batched metric was not aggregated properly (#1067)

f14-bertolotti committed 175 days ago

Verified 943c4c37

Merge branch 'main' into akshath/issue-1019-v2

akshathmangudi committed 177 days ago

Verified c8ff7d37

docstring fixes

akshathmangudi committed 177 days ago

f1d82efe

multi challenge impl, ready for review

akshathmangudi committed 177 days ago

d4cda447

Older