huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into mini-fixes

clefourrier committed 141 days ago

Verified 8282d84b

Fix 999: always provide parameters in the metric name to allow using several combinations (#1017)

clefourrier committed 141 days ago

Verified 70acb852

Fix nltk import failing (#1013)

clefourrier committed 141 days ago

Verified 3af89255

Fixing mixeval (#1006)

clefourrier committed 141 days ago

Verified 090630eb

Merge branch 'main' into mini-fixes

clefourrier committed 141 days ago

Verified 20fafe4b

Split up enhancement and features in release notes template (#984)

NathanHB committed 141 days ago

Verified c2b83e20

Fix broken link (#1014)

JoelNiklaus committed 142 days ago

Verified b63348d6

fix semaphore calls (#1012)

clefourrier committed 146 days ago

Verified c819e179

clefourrier committed 148 days ago

Verified ba607569

Added litellm model config options and improved `_prepare_max_new_tokens` (#967)

rolshoven committed 149 days ago

Verified e98e4639

Fix None Doc (#1008)

lewtun committed 150 days ago

Verified 7a456fd4

Revert extraction setting for `IndicesExtractionConfig` (#998)

cmpatino committed 155 days ago

Verified b1d45e36

Adding New Task SLR-Bench as a Community Task : Scalable Logical Reasoning Benchmark (#983)

Ahmad21Omar committed 160 days ago

Verified c7a063ae

clefourrier committed 162 days ago

2e435557

clefourrier committed 162 days ago

00d6309c

clefourrier committed 162 days ago

238729dd

clefourrier committed 162 days ago

038e64c0

clefourrier committed 162 days ago

3082a030

clefourrier committed 162 days ago

3d260734

restore rm import

clefourrier committed 162 days ago

ce3e9435

clefourrier committed 162 days ago

393c4305

updated aime, last metric fixs

clefourrier committed 162 days ago

4db46392

homogeneize k and n in parametrizable metrics

clefourrier committed 162 days ago

96020089

Fix AvgAtK num_samples method (#987)

amstu2 committed 162 days ago

Verified 5137e03f

Fix gsm8k HF repo (#986)

amstu2 committed 162 days ago

Verified 3ec1992b

fx lcb metric (#981)

NathanHB committed 163 days ago

Verified 0b16f8a5

adds `enable_prefix_caching` option to VLLMModelConfig (#945)

GAD-cell committed 163 days ago

Verified 16c26303

Bump for release v0.11.0

NathanHB committed 163 days ago

5a0e8972

Sample to sample compare for integration tests (#977)

NathanHB committed 163 days ago

Verified 35ae2d15

[RFC] Rework the dependencies to be more versatile (#951)

LysandreJik committed 166 days ago

Verified 6ee4ff81

Older