lighteval
Fix PERPLEXITY task
#1037
Open

Fix PERPLEXITY task #1037

ScottHoang wants to merge 7 commits into huggingface:main from ScottHoang:main
ScottHoang
fix perplexity metric issues
9b2ca83b
HuggingFaceDocBuilderDev
NathanHB
ScottHoang
ScottHoang
NathanHB
NathanHB
Fix TruthfulQA generative evaluation bugs
ff898bbd
ScottHoang ScottHoang force pushed from 11521c0d to ff898bbd 7 days ago
Fix TruthfulQA generative evaluation metrics
6ac50ceb
Revert TruthfulQA metrics back to exact_match
1c82ca5b
Fix TypeError in simpleqa prompt function - remove unnecessary eval()…
6be2bc9d
Add custom TruthfulQA task with LLM-as-judge evaluation
1c918d41
updates
fd790ba8

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone