lighteval
Add maj@k metric
#158
Merged
Overview
Commits
16
Changes
View On GitHub
Commits
  • init
    clefourrier committed 1 year ago
  • wip
    clefourrier committed 1 year ago
  • testing how to pad and gather with an added dimension for the num_samples
    clefourrier committed 1 year ago
  • now working, need to check why the metric is not displayed
    clefourrier committed 1 year ago
  • seems to be working!
    clefourrier committed 1 year ago
  • add maj at 4 for math with preprocessing
    clefourrier committed 1 year ago
  • Uses a homogeneized system for all greedy evaluations - we can do evals in one single step
    clefourrier committed 1 year ago
  • edit to prevent sampling for providing too many answers to some metrics
    clefourrier committed 1 year ago
  • added some doc
    clefourrier committed 1 year ago
  • Merge branch 'main' into add_maj_at_k
    clefourrier committed 1 year ago
  • neither nanotron nor endpoints models cover sampling atm
    clefourrier committed 1 year ago
  • add readme
    clefourrier committed 1 year ago
  • Merge branch 'main' into add_maj_at_k
    NathanHB committed 1 year ago
  • Update src/lighteval/metrics/metrics_sample.py
    clefourrier committed 1 year ago
  • added review change
    clefourrier committed 1 year ago
  • Merge branch 'main' into add_maj_at_k
    NathanHB committed 1 year ago
FAQ Terms Privacy Refunds Impressum
Loading