huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into add-style-bot

NathanHB committed 24 days ago

Verified 26a7b4cd

Merge branch 'add-style-bot' of github.com:huggingface/lighteval into add-style-bot

NathanHB committed 24 days ago

e7b4c87e

NathanHB committed 24 days ago

64e0fbc5

Add style bot (#1078)

NathanHB committed 24 days ago

Verified a64541c6

Merge branch 'main' into add-style-bot

NathanHB committed 24 days ago

Verified acc4d57d

NathanHB committed 24 days ago

283b114d

NathanHB committed 24 days ago

75eb3b7a

Add style bot (#1077)

NathanHB committed 24 days ago

Verified d59ce259

Merge branch 'main' into add-style-bot

NathanHB committed 24 days ago

Verified 2f0ee90b

Merge branch 'add-style-bot' of github.com:huggingface/lighteval into add-style-bot

NathanHB committed 24 days ago

2838ad2b

NathanHB committed 24 days ago

7f978679

Add style bot and other quality of life (#1076)

NathanHB committed 24 days ago

Verified 7f50228f

Apply suggestion from @NathanHB

NathanHB committed 24 days ago

Verified bdba77a8

Apply suggestion from @NathanHB

NathanHB committed 24 days ago

Verified 3a2404ff

Apply suggestion from @NathanHB

NathanHB committed 24 days ago

Verified aab1d2a3

Apply suggestion from @NathanHB

NathanHB committed 24 days ago

Verified 0a608384

Apply suggestion from @NathanHB

NathanHB committed 24 days ago

Verified 97f84802

NathanHB committed 24 days ago

290d7bfa

[FT] Add `py.typed` to `lighteval` (#1071)

akshathmangudi committed 25 days ago

Verified 14963552

removed duplicate code, useless function, added stronger deletion of items, plus updated the logic in generation size to respect what the user asks (#1073)

clefourrier committed 25 days ago

Verified 2236e17f

Fix task config metric typing to accept Metric enums (#1018)

emmanuel-ferdman committed 25 days ago

Verified 99162f17

Adding AA Omniscience task (#1066)

NathanHB committed 27 days ago

Verified 5425c337

adding satrred tag for frontend

NathanHB committed 27 days ago

d9ea404f

One file one task definition (#1059)

NathanHB committed 28 days ago

Verified babeec92

use correct hf subset for ifbench multiturn (#1061)

sam-paech-liquid committed 28 days ago

Verified ad58fedd

Update LiteLLM configuration for hosted_vllm provider (#1060)

abhiram1809 committed 31 days ago

Verified af6b5b4f

Fix: correct argument order in MajAtN.compute (#1058)

WeiKangda committed 31 days ago

Verified 391d5b40

Fix set using wrong syntax (#1057)

f14-bertolotti committed 32 days ago

Verified cb97d5c8

add a task dump in registry for better documentation of tasks (#1052)

NathanHB committed 33 days ago

Verified b8ccd20c

Remove suites in task configs example and fix task with hf_filters (#1051)

NathanHB committed 33 days ago

Verified 35babcb1

Older