Add automatic tests for metrics #939
NathanHB
merged
34 commits into
main
from
nathan-add-tests-for-metrics
Fixe Sampling Metrics and Evals
d8cfc2e3
remove breakpoint
7ae5da53
add auto tests for metrics
a00f3c03
Merge branch 'main' into nathan-add-tests-for-metrics
a892260c
Delete tests/unit/metrics/test_cases/README.md
bf252114
Delete tests/unit/metrics/test_unit_harness_metrics.py
2b65d084
add pip as test dependency, for spacy to work correctly
594b9423
Merge branch 'nathan-add-tests-for-metrics' of github.com:huggingface…
6db82638
NathanHB
commented
on 2025-08-27
fix tests and reorg files
9f7c2be5
fix tests and reorg files
e1a55ac4
better tests, passing
c9e7243a
Merge remote-tracking branch 'origin/main' into nathan-add-tests-for-…
e493b49b
Merge remote-tracking branch 'origin/main' into nathan-add-tests-for-…
5f323b76
fix tests
3d7b448b
fix faithfullness metric
0c4a5544
adds corpus level metric testing
594c2691
fix bleu metric
fc01e6b7
fix bleu metric
c5740356
Merge branch 'main' into nathan-add-tests-for-metrics
e1279552
fix tests after merge
51db8280
Delete tests/slow_tests/test_sglang_model.py
70a5a10a
test simpleqa judge
6384835e
Merge branch 'nathan-add-tests-for-metrics' of github.com:huggingface…
3c9aec63
fix avg at k
b5b82a89
remove test files from git lfs cache
bf740a3d
re-add test-files to actual repo
ef216dcb
NathanHB
commented
on 2025-09-15
use SKIPPED_METRIC list instead of hardcoding all metric names
f903ee0b
Merge remote-tracking branch 'origin/main' into nathan-add-tests-for-…
86892e91
clefourrier
approved these changes
on 2025-09-16
Update tests/unit/metrics/test_metrics_automated.py
23e97144
fix tests
048b4072
remove breakpoint
c4aebcec
remove breakpoint
432345e3
Merge branch 'main' into nathan-add-tests-for-metrics
dab1dae6
fix quality
fd27034e
Reviewers
Assignees
Labels
feature
Milestone
No milestone
Login to write a write a comment.
Login via GitHub