lighteval
add a regex to remove think tags before evaluating ifeval
#791

Merged

add a regex to remove think tags before evaluating ifeval #791

lewtun merged 2 commits into main from nathan-remove-think-tags-for-ifeval

add a regex to remove think tags before evaluating ifeval

725b4235

NathanHB commented on 2025-06-04

Update src/lighteval/models/transformers/transformers_model.py

1303bc00

clefourrier approved these changes on 2025-06-04

lewtun approved these changes on 2025-06-04

lewtun merged 8260f590 into main 1 year ago

NathanHB added ignore-for-release

Reviewers

lewtun

clefourrier

Assignees

No one assigned

Labels

ignore-for-release

Milestone

No milestone