lighteval
adds llm as judge using transformers
#223
Merged
Overview
Commits
23
Changes
View On GitHub

adds llm as judge using transformers #223

NathanHB merged 23 commits into main from nathan-add-judge-transformers
NathanHB
anilaltuner Transformers as Judge added
fdb22c7d
anilaltuner Transformers as Judge added
6906b04f
anilaltuner Formatting fix
8a33c121
anilaltuner Check model from HfApi
aef34a7c
clefourrier Merge branch 'main' into main
8ebfb165
clefourrier Merge branch 'main' into main
c8e26f06
NathanHB Merge branch 'main' into main
6f976c7b
NathanHB fixes after merge with main
1e0a7200
NathanHB NathanHB marked this pull request as draft 1 year ago
NathanHB linting
a54b8883
NathanHB fix doc
ba8c7bf1
NathanHB Merge remote-tracking branch 'origin/main' into nathan-add-judge-tran…
36ed5099
NathanHB merge
e6c9a998
NathanHB readd openai and adds llama 3 405b as judge
a75d0576
clefourrier Merge branch 'main' into nathan-add-judge-transformers
27585fa6
clefourrier
clefourrier commented on 2024-07-25
NathanHB fixing PR comments
0ce15da0
NathanHB Merge branch 'nathan-add-judge-transformers' of github.com:huggingfac…
131c90ef
clefourrier
clefourrier approved these changes on 2024-07-31
NathanHB Update src/lighteval/metrics/llm_as_judge.py
bb742c99
NathanHB add nits
2b8a078c
NathanHB fix tests
3109dcda
NathanHB fix tests
5df8df31
clefourrier Merge branch 'main' into nathan-add-judge-transformers
ea121854
NathanHB fix tests
97b7b428
NathanHB Merge branch 'main' into nathan-add-judge-transformers
5633fdc2
NathanHB NathanHB marked this pull request as ready for review 1 year ago
NathanHB NathanHB merged cb32024d into main 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum