huggingface/lighteval

Pull Requests Commits

updated var names

clefourrier committed 62 days ago

fa3e9f71

update new metrics name

clefourrier committed 62 days ago

c6cb0350

clefourrier committed 62 days ago

68158576

clefourrier committed 62 days ago

331b0ac6

clefourrier committed 62 days ago

50acdd35

fix unit tests 2

clefourrier committed 62 days ago

39ddda25

Merge branch 'main' into clem_fix_999

clefourrier committed 62 days ago

Verified 1777d033

clefourrier committed 62 days ago

c25508e5

added a warning message

clefourrier committed 62 days ago

f15cd6a8

clefourrier committed 62 days ago

a866aefd

Fix broken link (#1014)

JoelNiklaus committed 62 days ago

Verified b63348d6

fix semaphore calls (#1012)

clefourrier committed 67 days ago

Verified c819e179

clefourrier committed 69 days ago

Verified ba607569

Added litellm model config options and improved `_prepare_max_new_tokens` (#967)

rolshoven committed 70 days ago

Verified e98e4639

Fix None Doc (#1008)

lewtun committed 70 days ago

Verified 7a456fd4

Revert extraction setting for `IndicesExtractionConfig` (#998)

cmpatino committed 76 days ago

Verified b1d45e36

Adding New Task SLR-Bench as a Community Task : Scalable Logical Reasoning Benchmark (#983)

Ahmad21Omar committed 81 days ago

Verified c7a063ae

Fix AvgAtK num_samples method (#987)

amstu2 committed 83 days ago

Verified 5137e03f

Fix gsm8k HF repo (#986)

amstu2 committed 83 days ago

Verified 3ec1992b

fx lcb metric (#981)

NathanHB committed 83 days ago

Verified 0b16f8a5

adds `enable_prefix_caching` option to VLLMModelConfig (#945)

GAD-cell committed 83 days ago

Verified 16c26303

Bump for release v0.11.0

NathanHB committed 84 days ago

5a0e8972

Sample to sample compare for integration tests (#977)

NathanHB committed 84 days ago

Verified 35ae2d15

[RFC] Rework the dependencies to be more versatile (#951)

LysandreJik committed 87 days ago

Verified 6ee4ff81

Refine acknowledgements in README.md (#976)

clefourrier committed 88 days ago

Verified e61b868a

Support local GGUF in VLLM and use HF tokenizer #943 (#972)

JIElite committed 88 days ago

Verified d6a65ca5

Add auto tests for metrics (#939)

NathanHB committed 89 days ago

Verified 16318bb4

Add IFBench (#944)

clefourrier committed 90 days ago

Verified 3a71f688

Added `backend_options` parameter to llm judges. (#963)

rolshoven committed 90 days ago

Verified 9ba430f1

Multilingual extractiveness (#956)

rolshoven committed 90 days ago

Verified 2dc17885

Older