PR #722 Adds RULER benchmark

Adds RULER benchmark #722

NathanHB wants to merge 11 commits into main from nathan-adds-helet

adds RULE

65275d57

adds RULE

0ef15e3f

adds RULE

9cafd755

use llama 3.2 no chat template

ed3d9076

NathanHB added new-task

clefourrier approved these changes on 2025-05-19

Merge branch 'main' into nathan-adds-helet

a4394ad7

NathanHB requested a review from

copilot-pull-request-reviewer 245 days ago

NathanHB commented on 2025-05-21

copilot-pull-request-reviewer commented on 2025-05-21

Update src/lighteval/tasks/default_prompts.py

248bb678

NathanHB commented on 2025-05-21

Update src/lighteval/models/vllm/vllm_model.py

a1aee681

Merge branch 'main' into nathan-adds-helet

775705c5

fix typo

461b8cbf

put tuler in extedned tasks

57f29215

NathanHB commented on 2025-06-18

added params for Nouamane

79e6a6e0

NathanHB commented on 2025-06-26

Reviewers

clefourrier

Assignees

No one assigned

Labels

new-task

Milestone

No milestone