huggingface/lighteval

Pull Requests Commits

NathanHB committed 90 days ago

fd27034e

Merge branch 'main' into nathan-add-tests-for-metrics

NathanHB committed 90 days ago

Verified dab1dae6

remove breakpoint

NathanHB committed 90 days ago

432345e3

remove breakpoint

NathanHB committed 90 days ago

c4aebcec

NathanHB committed 90 days ago

048b4072

Update tests/unit/metrics/test_metrics_automated.py

NathanHB committed 90 days ago

Verified 23e97144

Add IFBench (#944)

clefourrier committed 90 days ago

Verified 3a71f688

Added `backend_options` parameter to llm judges. (#963)

rolshoven committed 90 days ago

Verified 9ba430f1

Multilingual extractiveness (#956)

rolshoven committed 90 days ago

Verified 2dc17885

Fixed bug that prevented the metrics from being mixed (some batched and others not batched) (#958)

rolshoven committed 91 days ago

Verified 96a6882e

Update readme (#961)

NathanHB committed 91 days ago

Verified c409f3f9

Merge remote-tracking branch 'origin/main' into nathan-add-tests-for-metrics

NathanHB committed 91 days ago

86892e91

use SKIPPED_METRIC list instead of hardcoding all metric names

NathanHB committed 91 days ago

f903ee0b

re-add test-files to actual repo

NathanHB committed 91 days ago

ef216dcb

remove test files from git lfs cache

NathanHB committed 91 days ago

bf740a3d

set upper bound on vllm version (#964)

NathanHB committed 91 days ago

Verified fc50ca09

MMLU Redux and Fixing the caching (#883)

clefourrier committed 95 days ago

Verified eda7eed3

NathanHB committed 97 days ago

b5b82a89

Merge branch 'nathan-add-tests-for-metrics' of github.com:huggingface/lighteval into nathan-add-tests-for-metrics

NathanHB committed 98 days ago

3c9aec63

test simpleqa judge

NathanHB committed 98 days ago

6384835e

Delete tests/slow_tests/test_sglang_model.py

NathanHB committed 98 days ago

Verified 70a5a10a

fix tests after merge

NathanHB committed 98 days ago

51db8280

Merge branch 'main' into nathan-add-tests-for-metrics

NathanHB committed 98 days ago

Verified e1279552

Update docs and enforces google's docstring style (#941)

NathanHB committed 98 days ago

Verified 7ed2636e

fix bleu metric

NathanHB committed 103 days ago

c5740356

fix bleu metric

NathanHB committed 103 days ago

fc01e6b7

adds corpus level metric testing

NathanHB committed 103 days ago

594c2691

fix faithfullness metric

NathanHB committed 104 days ago

0c4a5544

NathanHB committed 105 days ago

3d7b448b

Merge remote-tracking branch 'origin/main' into nathan-add-tests-for-metrics

NathanHB committed 105 days ago

5f323b76

Older