Pull Requests huggingface/lighteval

Update comment bot secrets in workflow

#1107 by paulinebm was merged 2025-12-15 11:04

Refactor PR Style Bot workflow with new inputs

#1105 by NathanHB was merged 2025-12-15 11:16

test

#1104 by paulinebm was closed 2025-12-11 08:25

Refactor PR Style Bot workflow configuration

#1103 by paulinebm was closed 2025-12-11 07:59

check details

#1101 by paulinebm was closed 2025-12-11 07:59

aime_avg was not added to TASKS_TABLE

#1098 by francesco-bertolotti was merged 2025-12-08 10:11

Update setup.py to include system command

#1097 by hdavenew was closed 2025-12-04 10:37

Refactor pyproject.toml for GitHub Actions integration

#1095 by hdavenew was closed 2025-12-03 10:47

Fix the quickstart description?

#1091 by julien-c was merged 2025-11-28 16:14

Update available-tasks.mdx

#1088 by bram-pramono was merged 2025-12-04 16:17

[DOC] Fix Dev Dependencies Install Command

#1085 by jgyasu was merged 2025-12-04 16:17

update `hf_revision` hash for multilingual hellaswag

#1084 by rpm000 was merged 2025-12-04 16:17

Add style bot ignore-for-release

#1079 by NathanHB was merged 2025-11-21 13:49

Add style bot ignore-for-release

#1078 by NathanHB was merged 2025-11-21 13:39

Add style bot ignore-for-release

#1077 by NathanHB was merged 2025-11-21 13:32

Add style bot and other quality of life feature enhancement

#1076 by NathanHB was merged 2025-11-21 13:18

Fix autobatch size issue bug

#1073 by clefourrier was merged 2025-11-20 13:35

[EVAL] Long Horizon Execution

#1072 by akshathmangudi was closed 2025-11-21 08:29

[FT] Add `py.typed` to `lighteval` enhancement

#1071 by akshathmangudi was merged 2025-11-20 13:57

feat: Add Kyrgyz LLM Bench multilingual tasks new-task

#1070 by golden-ratio was merged 2025-12-08 10:05

[EVAL] Long Horizon Execution

#1069 by akshathmangudi was closed 2025-11-20 12:42

batched metric was not aggregated properly bug

#1067 by f14-bertolotti was merged 2025-11-24 11:02

Adding AA Omniscience task new-task

#1066 by NathanHB was merged 2025-11-18 16:16

add to inspect task-update

#1065 by NathanHB was merged 2025-11-24 15:27

Use correct hf subset for ifbench multiturn bug

#1061 by sam-paech-liquid was merged 2025-11-17 10:14

Update LiteLLM configuration for hosted_vllm provider bug

#1060 by abhiram1809 was merged 2025-11-14 13:20

One file one task definition refacto breaking

#1059 by NathanHB was merged 2025-11-17 17:07

Fix: correct argument order in MajAtN.compute bug

#1058 by WeiKangda was merged 2025-11-14 12:47

Fix set using wrong syntax enhancement

#1057 by f14-bertolotti was merged 2025-11-13 13:06

add a task dump in registry for better documentation of tasks feature

#1052 by NathanHB was merged 2025-11-12 16:24