lighteval
Fix PERPLEXITY task
#1037
Open
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
7
Changes
View On
GitHub
Fix PERPLEXITY task
#1037
ScottHoang
wants to merge 7 commits into
huggingface:main
from
ScottHoang:main
fix perplexity metric issues
9b2ca83b
Fix TruthfulQA generative evaluation bugs
ff898bbd
ScottHoang
force pushed
from
11521c0d
to
ff898bbd
104 days ago
Fix TruthfulQA generative evaluation metrics
6ac50ceb
Revert TruthfulQA metrics back to exact_match
1c82ca5b
Fix TypeError in simpleqa prompt function - remove unnecessary eval()…
6be2bc9d
Add custom TruthfulQA task with LLM-as-judge evaluation
1c918d41
updates
fd790ba8
Login to write a write a comment.
Login via GitHub
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub