huggingface/lighteval

Pull Requests Commits

adds tasks that are defined in inspect

NathanHB committed 172 days ago

07c88f43

adding tasks to inspect

NathanHB committed 172 days ago

624bb211

adding tasks to inspect

NathanHB committed 172 days ago

8b8667f9

Apply style fixes

github-actions[bot] committed 175 days ago

e358e701

Merge branch 'main' into nathan-add-to-inspect

NathanHB committed 175 days ago

Verified 97adfdc8

Add style bot (#1079)

NathanHB committed 175 days ago

Verified 66ce47e3

Apply suggestion from @NathanHB

NathanHB committed 175 days ago

Verified ffac6515

Merge branch 'main' into nathan-add-to-inspect

NathanHB committed 175 days ago

Verified 873334bc

Add style bot (#1078)

NathanHB committed 175 days ago

Verified a64541c6

Add style bot (#1077)

NathanHB committed 175 days ago

Verified d59ce259

Add style bot and other quality of life (#1076)

NathanHB committed 175 days ago

Verified 7f50228f

[FT] Add `py.typed` to `lighteval` (#1071)

akshathmangudi committed 176 days ago

Verified 14963552

removed duplicate code, useless function, added stronger deletion of items, plus updated the logic in generation size to respect what the user asks (#1073)

clefourrier committed 176 days ago

Verified 2236e17f

Fix task config metric typing to accept Metric enums (#1018)

emmanuel-ferdman committed 176 days ago

Verified 99162f17

Adding AA Omniscience task (#1066)

NathanHB committed 178 days ago

Verified 5425c337

adding satrred tag for frontend

NathanHB committed 178 days ago

d9ea404f

Merge branch 'main' into nathan-add-to-inspect

NathanHB committed 179 days ago

Verified cd11000f

One file one task definition (#1059)

NathanHB committed 179 days ago

Verified babeec92

add mixeval and musr

NathanHB committed 179 days ago

8a7ff37d

NathanHB committed 179 days ago

b610504e

NathanHB committed 179 days ago

6c00e572

NathanHB committed 179 days ago

5f1cbc47

remove LETTER_INDEX

NathanHB committed 179 days ago

55c1e77e

use correct hf subset for ifbench multiturn (#1061)

sam-paech-liquid committed 179 days ago

Verified ad58fedd

prompt function names end with _prompt

NathanHB committed 182 days ago

97d9680d

NathanHB committed 182 days ago

700524be

prompt function names end with _prompt

NathanHB committed 182 days ago

a898375d

Update LiteLLM configuration for hosted_vllm provider (#1060)

abhiram1809 committed 182 days ago

Verified af6b5b4f

Fix: correct argument order in MajAtN.compute (#1058)

WeiKangda committed 182 days ago

Verified 391d5b40

move prompt function to task files

NathanHB committed 182 days ago

0f49df68

Older