lighteval
Now only uses functions for prompt definition
#213
Merged

Commits
  • add function prompt assigment
    hynky1999 committed 1 year ago
  • add json casting
    hynky1999 committed 1 year ago
  • fix ruff setting + fmt
    hynky1999 committed 1 year ago
  • Merge branch 'main' into function_prompts
    clefourrier committed 1 year ago
  • Merge branch 'main' into function_prompts
    clefourrier committed 1 year ago
  • replaced json tasks by python tasks, step 1
    clefourrier committed 1 year ago
  • wip
    clefourrier committed 1 year ago
  • Merge branch 'main' into simplify_task_system
    clefourrier committed 1 year ago
  • simplification part 1
    clefourrier committed 1 year ago
  • fix extended tasks + typo
    clefourrier committed 1 year ago
  • fix
    clefourrier committed 1 year ago
  • fix nanotron example
    clefourrier committed 1 year ago
  • small fix
    clefourrier committed 1 year ago
  • Merge branch 'main' into function_prompts
    clefourrier committed 1 year ago
  • Merge branch 'simplify_task_system' into hynek_function
    clefourrier committed 1 year ago
  • now use function, not string, to pass prompts in examples
    clefourrier committed 1 year ago
  • moved everyone to function calling
    clefourrier committed 1 year ago
  • LightevalTask now only takes functions
    clefourrier committed 1 year ago
  • removed templated type which messed up the test suite
    clefourrier committed 1 year ago
  • last fix + doc udpate
    clefourrier committed 1 year ago
  • Update src/lighteval/tasks/registry.py
    clefourrier committed 1 year ago
  • Merge branch 'main' into simplify_task_system
    clefourrier committed 1 year ago
  • Merge branch 'simplify_task_system' into hynek_function
    clefourrier committed 1 year ago
  • Merge branch 'main' into hynek_function
    clefourrier committed 1 year ago
Loading