lighteval
Fix PERPLEXITY task
#1037
Open
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
7
Changes
View On
GitHub
Fix PERPLEXITY task
#1037
ScottHoang
wants to merge 7 commits into
huggingface:main
from
ScottHoang:main
fix perplexity metric issues
9b2ca83b
Fix TruthfulQA generative evaluation bugs
ff898bbd
ScottHoang
force pushed
from
11521c0d
to
ff898bbd
7 days ago
Fix TruthfulQA generative evaluation metrics
6ac50ceb
Revert TruthfulQA metrics back to exact_match
1c82ca5b
Fix TypeError in simpleqa prompt function - remove unnecessary eval()…
6be2bc9d
Add custom TruthfulQA task with LLM-as-judge evaluation
1c918d41
updates
fd790ba8
Login to write a write a comment.
Login via GitHub
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub