huggingface/lighteval

Pull Requests Commits

updated var names

clefourrier committed 113 days ago

fa3e9f71

update new metrics name

clefourrier committed 113 days ago

c6cb0350

clefourrier committed 113 days ago

68158576

clefourrier committed 113 days ago

331b0ac6

clefourrier committed 113 days ago

50acdd35

fix unit tests 2

clefourrier committed 113 days ago

39ddda25

Merge branch 'main' into clem_fix_999

clefourrier committed 113 days ago

Verified 1777d033

clefourrier committed 113 days ago

c25508e5

added a warning message

clefourrier committed 113 days ago

f15cd6a8

clefourrier committed 113 days ago

a866aefd

Fix broken link (#1014)

JoelNiklaus committed 113 days ago

Verified b63348d6

fix semaphore calls (#1012)

clefourrier committed 118 days ago

Verified c819e179

clefourrier committed 120 days ago

Verified ba607569

Added litellm model config options and improved `_prepare_max_new_tokens` (#967)

rolshoven committed 121 days ago

Verified e98e4639

Fix None Doc (#1008)

lewtun committed 121 days ago

Verified 7a456fd4

Revert extraction setting for `IndicesExtractionConfig` (#998)

cmpatino committed 127 days ago

Verified b1d45e36

Adding New Task SLR-Bench as a Community Task : Scalable Logical Reasoning Benchmark (#983)

Ahmad21Omar committed 132 days ago

Verified c7a063ae

Fix AvgAtK num_samples method (#987)

amstu2 committed 134 days ago

Verified 5137e03f

Fix gsm8k HF repo (#986)

amstu2 committed 134 days ago

Verified 3ec1992b

fx lcb metric (#981)

NathanHB committed 134 days ago

Verified 0b16f8a5

adds `enable_prefix_caching` option to VLLMModelConfig (#945)

GAD-cell committed 134 days ago

Verified 16c26303

Bump for release v0.11.0

NathanHB committed 135 days ago

5a0e8972

Sample to sample compare for integration tests (#977)

NathanHB committed 135 days ago

Verified 35ae2d15

[RFC] Rework the dependencies to be more versatile (#951)

LysandreJik committed 138 days ago

Verified 6ee4ff81

Refine acknowledgements in README.md (#976)

clefourrier committed 139 days ago

Verified e61b868a

Support local GGUF in VLLM and use HF tokenizer #943 (#972)

JIElite committed 139 days ago

Verified d6a65ca5

Add auto tests for metrics (#939)

NathanHB committed 140 days ago

Verified 16318bb4

Add IFBench (#944)

clefourrier committed 141 days ago

Verified 3a71f688

Added `backend_options` parameter to llm judges. (#963)

rolshoven committed 141 days ago

Verified 9ba430f1

Multilingual extractiveness (#956)

rolshoven committed 141 days ago

Verified 2dc17885

Older