lighteval
Added post processing (for reasoning tokens) to pipeline
#882
Merged
Overview
Commits
19
Changes
View On GitHub
Commits
  • added post processing
    clefourrier committed 316 days ago
  • default factory for dataclass
    clefourrier committed 316 days ago
  • style
    clefourrier committed 316 days ago
  • fix
    clefourrier committed 316 days ago
  • fix, tokens should be list of tuples
    clefourrier committed 316 days ago
  • couple bug fixes with the linter + an actual bug when updating the dataclass values
    clefourrier committed 316 days ago
  • doc update for reasoning_pair kwarg
    clefourrier committed 313 days ago
  • manage user args
    clefourrier committed 313 days ago
  • add aime avg@64 like in qwen paper
    clefourrier committed 313 days ago
  • small fix max_len for vllm models
    clefourrier committed 312 days ago
  • up metric
    clefourrier committed 312 days ago
  • unrelated, updated doc which was completely outdated
    clefourrier committed 312 days ago
  • more robust reasoning token management
    clefourrier committed 310 days ago
  • small reorg of lighteval task class to allow mocking
    clefourrier committed 310 days ago
  • test suite
    clefourrier committed 310 days ago
  • Merge branch 'main' into think
    clefourrier committed 310 days ago
  • fix tests
    clefourrier committed 310 days ago
  • update doc
    clefourrier committed 310 days ago
  • Merge branch 'main' into think
    clefourrier committed 306 days ago
FAQ Terms Privacy Refunds Impressum
Loading