huggingface/lighteval

Pull Requests Commits

fix(security): remediate workflow vulnerability in .github/workflows/pr_style_bot.yaml

hf-security-analysis[bot] committed 63 days ago

Verified bb242c78

Fix/bump style bot sha (#1223)

paulinebm committed 63 days ago

Verified 6b9c415c

[CI] Bump style-bot-action to hardened SHA (TOCTOU fix) (#1222)

paulinebm committed 63 days ago

Verified 8e25dcfd

test: point style-bot to TOCTOU fix SHA (#1220)

paulinebm committed 64 days ago

Verified 726807db

chore: bump doc-builder SHA for PR upload workflow (#1213)

rtrompier committed 83 days ago

Verified 10b9104e

Add support for vllm >= 0.19.0 (#1211)

lewtun committed 85 days ago

Verified 34889df3

🔒 Pin GitHub Actions to commit SHAs (#1201)

paulinebm committed 91 days ago

Verified e274b378

Add test on main branch of vllm (#1175)

NathanHB committed 125 days ago

Verified 33acf35f

Upgrade vLLM from 0.10.1.1 to 0.14.1 (#1173)

NathanHB committed 125 days ago

Verified 0a74a170

add eval results tip (#1126)

burtenshaw committed 167 days ago

Verified 06aee5b2

Fix typo in few_shots_select option error message. ('fbalanced' -> 'balanced') (#1111)

jayminban committed 174 days ago

Verified 6ce93d53

NathanHB committed 174 days ago

Verified f8888587

long horizon execution (#1119)

NathanHB committed 174 days ago

Verified 61c547b8

Mathvista (#1118)

NathanHB committed 175 days ago

Verified e7048c30

refactor: add formatted response to litellm (#1116)

pjavanrood committed 175 days ago

Verified 845c9899

multi challenge (#1120)

NathanHB committed 175 days ago

Verified d9a9401c

refactor: adding api_key param to litellm (#1114)

pjavanrood committed 180 days ago

Verified 36b3e6c8

Enable loading data sets from files for custom tasks (#1083)

davebiagioni committed 182 days ago

Verified 03d8c4ee

Refactor PR Style Bot workflow with new inputs (#1105)

NathanHB committed 204 days ago

Verified 6496d623

Update comment bot secrets in workflow (#1107)

paulinebm committed 204 days ago

Verified 7fba130d

Comment out PR Style Bot workflow configuration

paulinebm committed 208 days ago

Verified f48af0b0

Refactor PR Style Bot workflow configuration

paulinebm committed 208 days ago

Verified 8238d3e1

Comment out PR Style Bot workflow configuration

paulinebm committed 208 days ago

Verified 0a8b90a9

Add TEST secret environment variable

paulinebm committed 209 days ago

Verified 22aa98c1

Refactor PR Style Bot workflow configuration

paulinebm committed 209 days ago

Verified a5d13a42

Comment out PR Style Bot workflow configuration

paulinebm committed 210 days ago

Verified 6d1f147b

aime_avg was not added to TASKS_TABLE (#1098)

francesco-bertolotti committed 211 days ago

Verified c6e2ce70

feat: Add Kyrgyz LLM Bench multilingual tasks (#1070)

golden-ratio committed 211 days ago

Verified 2c98b542

update hf_revision hash for multilingual hellaswag (#1084)

rpm000 committed 215 days ago

Verified 557b8d55

[DOC] Fix dev dependencies install command (#1085)

jgyasu committed 215 days ago

Verified 6889901c

Older