lighteval
Add automatic tests for metrics
#939
Merged

Commits
  • Fixe Sampling Metrics and Evals
    NathanHB committed 209 days ago
  • remove breakpoint
    NathanHB committed 209 days ago
  • add auto tests for metrics
    NathanHB committed 209 days ago
  • Merge branch 'main' into nathan-add-tests-for-metrics
    NathanHB committed 209 days ago
  • Delete tests/unit/metrics/test_cases/README.md
    NathanHB committed 209 days ago
  • Delete tests/unit/metrics/test_unit_harness_metrics.py
    NathanHB committed 209 days ago
  • add pip as test dependency, for spacy to work correctly
    NathanHB committed 209 days ago
  • Merge branch 'nathan-add-tests-for-metrics' of github.com:huggingface/lighteval into nathan-add-tests-for-metrics
    NathanHB committed 209 days ago
  • fix tests and reorg files
    NathanHB committed 208 days ago
  • fix tests and reorg files
    NathanHB committed 208 days ago
  • better tests, passing
    NathanHB committed 204 days ago
  • Merge remote-tracking branch 'origin/main' into nathan-add-tests-for-metrics
    NathanHB committed 204 days ago
  • Merge remote-tracking branch 'origin/main' into nathan-add-tests-for-metrics
    NathanHB committed 204 days ago
  • fix tests
    NathanHB committed 204 days ago
  • fix faithfullness metric
    NathanHB committed 203 days ago
  • adds corpus level metric testing
    NathanHB committed 202 days ago
  • fix bleu metric
    NathanHB committed 202 days ago
  • fix bleu metric
    NathanHB committed 202 days ago
  • Merge branch 'main' into nathan-add-tests-for-metrics
    NathanHB committed 197 days ago
  • fix tests after merge
    NathanHB committed 197 days ago
  • Delete tests/slow_tests/test_sglang_model.py
    NathanHB committed 197 days ago
  • test simpleqa judge
    NathanHB committed 197 days ago
  • Merge branch 'nathan-add-tests-for-metrics' of github.com:huggingface/lighteval into nathan-add-tests-for-metrics
    NathanHB committed 197 days ago
  • fix avg at k
    NathanHB committed 196 days ago
  • remove test files from git lfs cache
    NathanHB committed 190 days ago
  • re-add test-files to actual repo
    NathanHB committed 190 days ago
  • use SKIPPED_METRIC list instead of hardcoding all metric names
    NathanHB committed 190 days ago
  • Merge remote-tracking branch 'origin/main' into nathan-add-tests-for-metrics
    NathanHB committed 190 days ago
  • Update tests/unit/metrics/test_metrics_automated.py
    NathanHB committed 189 days ago
  • fix tests
    NathanHB committed 189 days ago
  • remove breakpoint
    NathanHB committed 189 days ago
  • remove breakpoint
    NathanHB committed 189 days ago
  • Merge branch 'main' into nathan-add-tests-for-metrics
    NathanHB committed 189 days ago
  • fix quality
    NathanHB committed 189 days ago
Loading