lighteval
Fix PERPLEXITY task
#1037
Open

Fix PERPLEXITY task #1037

ScottHoang wants to merge 7 commits into huggingface:main from ScottHoang:main
ScottHoang
fix perplexity metric issues
9b2ca83b
HuggingFaceDocBuilderDev
NathanHB
ScottHoang
ScottHoang
NathanHB
NathanHB
Fix TruthfulQA generative evaluation bugs
ff898bbd
ScottHoang ScottHoang force pushed from 11521c0d to ff898bbd 104 days ago
Fix TruthfulQA generative evaluation metrics
6ac50ceb
Revert TruthfulQA metrics back to exact_match
1c82ca5b
Fix TypeError in simpleqa prompt function - remove unnecessary eval()…
6be2bc9d
Add custom TruthfulQA task with LLM-as-judge evaluation
1c918d41
updates
fd790ba8

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone