lighteval
Probability Metric + New Normalization
#276
Merged
Overview
Commits
20
Changes
View On GitHub
Commits
  • add new acci + prob metrics
    hynky1999 committed 1 year ago
  • Add logic for handli PMI + add tests for requests
    hynky1999 committed 1 year ago
  • formatting + nits
    hynky1999 committed 1 year ago
  • nicer comments
    hynky1999 committed 1 year ago
  • simplify normalization name, fix bug with ignore space
    hynky1999 committed 1 year ago
  • better docs for uncoditioned_query
    hynky1999 committed 1 year ago
  • resolving gh comments
    hynky1999 committed 1 year ago
  • nits + fix tests
    hynky1999 committed 1 year ago
  • formatting
    hynky1999 committed 1 year ago
  • fix metric category separation of requests
    hynky1999 committed 1 year ago
  • Update src/lighteval/logging/info_loggers.py
    hynky1999 committed 1 year ago
  • Update src/lighteval/metrics/__init__.py
    hynky1999 committed 1 year ago
  • Update src/lighteval/tasks/requests.py
    hynky1999 committed 1 year ago
  • Update tests/metrics/test_metric_requests.py
    hynky1999 committed 1 year ago
  • rework perplexity routing, move probabilities to target_perplexity
    hynky1999 committed 1 year ago
  • fix typo
    hynky1999 committed 1 year ago
  • Update src/lighteval/metrics/sample_preparator.py
    NathanHB committed 1 year ago
  • Update src/lighteval/tasks/lighteval_task.py
    hynky1999 committed 1 year ago
  • ruff
    hynky1999 committed 1 year ago
  • Merge branch 'main' into prob_metrics_and_more_norms
    hynky1999 committed 1 year ago
FAQ Terms Privacy Refunds Impressum
Loading