huggingface/lighteval

Pull Requests Commits

Refactor PR Style Bot workflow configuration

paulinebm committed 33 days ago

Verified d7a752d1

Comment out PR Style Bot workflow configuration

paulinebm committed 33 days ago

Verified 0a8b90a9

Add TEST secret environment variable

paulinebm committed 33 days ago

Verified 22aa98c1

Refactor PR Style Bot workflow configuration

paulinebm committed 33 days ago

Verified a5d13a42

Comment out PR Style Bot workflow configuration

paulinebm committed 35 days ago

Verified 6d1f147b

aime_avg was not added to TASKS_TABLE (#1098)

francesco-bertolotti committed 36 days ago

Verified c6e2ce70

feat: Add Kyrgyz LLM Bench multilingual tasks (#1070)

golden-ratio committed 36 days ago

Verified 2c98b542

update hf_revision hash for multilingual hellaswag (#1084)

rpm000 committed 39 days ago

Verified 557b8d55

[DOC] Fix dev dependencies install command (#1085)

jgyasu committed 39 days ago

Verified 6889901c

Update available-tasks.mdx (#1088)

bram-pramono committed 39 days ago

Verified 48dcd834

Add starred attribute to gpqa.py metadata

NathanHB committed 39 days ago

Verified 98ac1bf7

Fix the quickstart description? (#1091)

julien-c committed 45 days ago

Verified 99ef5b98

bumping version

NathanHB committed 49 days ago

58038182

add to inspect (#1065)

NathanHB committed 49 days ago

Verified 9009723b

batched metric was not aggregated properly (#1067)

f14-bertolotti committed 50 days ago

Verified 943c4c37

Add style bot (#1079)

NathanHB committed 53 days ago

Verified 66ce47e3

Add style bot (#1078)

NathanHB committed 53 days ago

Verified a64541c6

Add style bot (#1077)

NathanHB committed 53 days ago

Verified d59ce259

Add style bot and other quality of life (#1076)

NathanHB committed 53 days ago

Verified 7f50228f

[FT] Add `py.typed` to `lighteval` (#1071)

akshathmangudi committed 53 days ago

Verified 14963552

removed duplicate code, useless function, added stronger deletion of items, plus updated the logic in generation size to respect what the user asks (#1073)

clefourrier committed 54 days ago

Verified 2236e17f

Fix task config metric typing to accept Metric enums (#1018)

emmanuel-ferdman committed 54 days ago

Verified 99162f17

Adding AA Omniscience task (#1066)

NathanHB committed 55 days ago

Verified 5425c337

adding satrred tag for frontend

NathanHB committed 55 days ago

d9ea404f

One file one task definition (#1059)

NathanHB committed 56 days ago

Verified babeec92

use correct hf subset for ifbench multiturn (#1061)

sam-paech-liquid committed 57 days ago

Verified ad58fedd

Update LiteLLM configuration for hosted_vllm provider (#1060)

abhiram1809 committed 60 days ago

Verified af6b5b4f

Fix: correct argument order in MajAtN.compute (#1058)

WeiKangda committed 60 days ago

Verified 391d5b40

Fix set using wrong syntax (#1057)

f14-bertolotti committed 61 days ago

Verified cb97d5c8

add a task dump in registry for better documentation of tasks (#1052)

NathanHB committed 61 days ago

Verified b8ccd20c

Older