huggingface/lighteval

Pull Requests Commits
Open Closed
Fix caching logic
#994 opened 2025-09-25 22:05 by jxmorris12
Fix deberta overflow error bug
#990 opened 2025-09-24 07:14 by amstu2
vllm 0.10.2 makes integration tests fail bug ignore-for-release
#980 opened 2025-09-22 13:33 by NathanHB
added HELMET task with json datasets and tests new-task
#971 opened 2025-09-17 01:21 by nayana1729
Add ChartQA new-task
#954 opened 2025-09-11 01:31 by 0xjunhao
adds `concurrent_requests` parameter for litellm backend enhancement
#953 opened 2025-09-10 21:32 by anupam-dewan
[RFC] Rework the suites to be inferred feature refacto breaking
#952 opened 2025-09-09 15:32 by LysandreJik
Debug continuous batching
#900 opened 2025-08-05 11:11 by clefourrier
Fix #742
#860 opened 2025-07-14 19:06 by mcleish7
Multilingual Overhaul
#833 opened 2025-06-25 21:08 by hynky1999
Adding a range of multilingual evals
#832 opened 2025-06-25 14:32 by clefourrier
Add Chinese (zh) Translation of Documentation documentation
#744 opened 2025-05-19 11:43 by CassiopeiaCode
Adds RULER benchmark new-task
#722 opened 2025-05-15 11:45 by NathanHB
[WIP] Fix nanotron compatibility
#706 opened 2025-05-06 17:17 by duynht
added vllm lora support. feature
#611 opened 2025-03-11 05:07 by haizhou-shi
Add CodeElo new-task
#575 opened 2025-02-19 07:49 by plaguss
Multi node vLLM
#530 opened 2025-01-31 13:53 by ncassereau
feat: add JGLUE tasks
#469 opened 2024-12-19 16:15 by ryan-minato
Terms Of Use Privacy Policy Refund Policy Impressum