lighteval
Adding custom metric system + IFEval as an example
#48
Merged

Commits
  • init ifeval, now need to add loading custom metric system
    clefourrier committed 2 years ago
  • Merge branch 'main' into clem_customizable_metrics
    clefourrier committed 2 years ago
  • custom metrics working! need to update the readme
    clefourrier committed 2 years ago
  • update doc
    clefourrier committed 2 years ago
  • fix eos token + eval script
    clefourrier committed 2 years ago
  • Update tasks_examples/custom_tasks_with_custom_metrics/ifeval/ifeval.py
    clefourrier committed 2 years ago
  • Merge branch 'main' into clem_customizable_metrics
    NathanHB committed 2 years ago
  • changed eos token
    clefourrier committed 2 years ago
  • Merge branch 'clem_customizable_metrics' of github.com:huggingface/lighteval into clem_customizable_metrics
    clefourrier committed 2 years ago
  • wip
    clefourrier committed 2 years ago
  • Merge branch 'main' into clem_customizable_metrics
    lewtun committed 2 years ago
  • Merge branch 'main' into clem_customizable_metrics
    clefourrier committed 2 years ago
  • more info about new tasks
    clefourrier committed 2 years ago
  • Merge branch 'clem_customizable_metrics' of github.com:huggingface/lighteval into clem_customizable_metrics
    clefourrier committed 2 years ago
  • fix
    clefourrier committed 2 years ago
Loading