Added post processing (for reasoning tokens) to pipeline #882
added post processing
44bd18ff
default factory for dataclass
d32d6836
style
90f69692
fix
33ae811b
fix, tokens should be list of tuples
772e9f71
couple bug fixes with the linter + an actual bug when updating the da…
dfa9b01d
lewtun
commented
on 2025-07-25
doc update for reasoning_pair kwarg
2ff36268
manage user args
7083da44
add aime avg@64 like in qwen paper
4fa53fb1
clefourrier
marked this pull request as draft 216 days ago
small fix max_len for vllm models
4b8c7c5c
up metric
9525a29e
unrelated, updated doc which was completely outdated
18a53968
more robust reasoning token management
6349a791
small reorg of lighteval task class to allow mocking
17008e8a
test suite
40d04c36
Merge branch 'main' into think
8a64c6d9
fix tests
b948696e
update doc
94c756df
clefourrier
marked this pull request as ready for review 213 days ago
Merge branch 'main' into think
3f56c4fb
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub