lighteval
Added post processing (for reasoning tokens) to pipeline
#882
Merged

Added post processing (for reasoning tokens) to pipeline #882

clefourrier merged 19 commits into main from think
clefourrier
clefourrier added post processing
44bd18ff
clefourrier default factory for dataclass
d32d6836
HuggingFaceDocBuilderDev
clefourrier style
90f69692
clefourrier fix
33ae811b
clefourrier fix, tokens should be list of tuples
772e9f71
clefourrier couple bug fixes with the linter + an actual bug when updating the da…
dfa9b01d
clefourrier clefourrier requested a review from lewtun lewtun 220 days ago
clefourrier
clefourrier commented on 2025-07-25
lewtun
lewtun commented on 2025-07-25
clefourrier
clefourrier doc update for reasoning_pair kwarg
2ff36268
clefourrier manage user args
7083da44
clefourrier add aime avg@64 like in qwen paper
4fa53fb1
lewtun
clefourrier clefourrier marked this pull request as draft 216 days ago
clefourrier
clefourrier small fix max_len for vllm models
4b8c7c5c
clefourrier up metric
9525a29e
clefourrier unrelated, updated doc which was completely outdated
18a53968
clefourrier more robust reasoning token management
6349a791
clefourrier small reorg of lighteval task class to allow mocking
17008e8a
clefourrier test suite
40d04c36
clefourrier Merge branch 'main' into think
8a64c6d9
clefourrier fix tests
b948696e
clefourrier update doc
94c756df
clefourrier
clefourrier commented on 2025-07-31
clefourrier
clefourrier clefourrier marked this pull request as ready for review 213 days ago
clefourrier Merge branch 'main' into think
3f56c4fb
clefourrier
clefourrier clefourrier merged d7beacbc into main 210 days ago
lewtun
clefourrier
NathanHB NathanHB added feature

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone