huggingface/lighteval

Pull Requests Commits

updated var names

clefourrier committed 347 days ago

fa3e9f71

update new metrics name

clefourrier committed 347 days ago

c6cb0350

clefourrier committed 347 days ago

68158576

clefourrier committed 347 days ago

331b0ac6

clefourrier committed 347 days ago

50acdd35

fix unit tests 2

clefourrier committed 347 days ago

39ddda25

Merge branch 'main' into clem_fix_999

clefourrier committed 347 days ago

Verified 1777d033

clefourrier committed 347 days ago

c25508e5

added a warning message

clefourrier committed 347 days ago

f15cd6a8

clefourrier committed 347 days ago

a866aefd

Fix broken link (#1014)

JoelNiklaus committed 347 days ago

Verified b63348d6

fix semaphore calls (#1012)

clefourrier committed 352 days ago

Verified c819e179

clefourrier committed 353 days ago

Verified ba607569

Added litellm model config options and improved `_prepare_max_new_tokens` (#967)

rolshoven committed 355 days ago

Verified e98e4639

Fix None Doc (#1008)

lewtun committed 355 days ago

Verified 7a456fd4

Revert extraction setting for `IndicesExtractionConfig` (#998)

cmpatino committed 361 days ago

Verified b1d45e36

Adding New Task SLR-Bench as a Community Task : Scalable Logical Reasoning Benchmark (#983)

Ahmad21Omar committed 1 year ago

Verified c7a063ae

Fix AvgAtK num_samples method (#987)

amstu2 committed 1 year ago

Verified 5137e03f

Fix gsm8k HF repo (#986)

amstu2 committed 1 year ago

Verified 3ec1992b

fx lcb metric (#981)

NathanHB committed 1 year ago

Verified 0b16f8a5

adds `enable_prefix_caching` option to VLLMModelConfig (#945)

GAD-cell committed 1 year ago

Verified 16c26303

Bump for release v0.11.0

NathanHB committed 1 year ago

5a0e8972

Sample to sample compare for integration tests (#977)

NathanHB committed 1 year ago

Verified 35ae2d15

[RFC] Rework the dependencies to be more versatile (#951)

LysandreJik committed 1 year ago

Verified 6ee4ff81

Refine acknowledgements in README.md (#976)

clefourrier committed 1 year ago

Verified e61b868a

Support local GGUF in VLLM and use HF tokenizer #943 (#972)

JIElite committed 1 year ago

Verified d6a65ca5

Add auto tests for metrics (#939)

NathanHB committed 1 year ago

Verified 16318bb4

Add IFBench (#944)

clefourrier committed 1 year ago

Verified 3a71f688

Added `backend_options` parameter to llm judges. (#963)

rolshoven committed 1 year ago

Verified 9ba430f1

Multilingual extractiveness (#956)

rolshoven committed 1 year ago

Verified 2dc17885

Older