huggingface/lighteval

Pull Requests Commits
[FIX] Fixes vllm backend (#317)
NathanHB committed 1 year ago
Verified 4b06b944
fix test
hynky1999 committed 1 year ago
f26e88cb
nit
hynky1999 committed 1 year ago
d8f56b80
add even more docstring
hynky1999 committed 1 year ago
4216ae29
add nice doscrings 📃
hynky1999 committed 1 year ago
3c9eb211
nicer todo
hynky1999 committed 1 year ago
2bff9633
nicers tests + fix them
hynky1999 committed 1 year ago
44aeecfc
Merge branch 'geneartive_dynamic_metrics' into config_templates
hynky1999 committed 1 year ago
db36e166
fix utils
hynky1999 committed 1 year ago
fa1fa834
when in rome do as romans do (handle error messages the same way)
Hynek Kydlicek committed 1 year ago
0fbc7313
resolve nits
Hynek Kydlicek committed 1 year ago
9356cc62
finish implementation of templates + move stuff around
Hynek Kydlicek committed 1 year ago
91d9d4f7
Merge branch 'main' into geneartive_dynamic_metrics
NathanHB committed 1 year ago
Verified f2a801d0
fix doc in readme (#303)
NathanHB committed 1 year ago
Verified 7295c78f
skip tests if secrets not provided (#304)
hynky1999 committed 1 year ago
Verified 6b943ecb
fix readme doc about custom tasks (#300)
NathanHB committed 1 year ago
Verified 3dd7d500
Fixes bug: You can't create a model without either a list of model_args or a model_config_path when model_config_path was submited (#298)
NathanHB committed 1 year ago
Verified 8d833565
Merge branch 'main' into geneartive_dynamic_metrics
clefourrier committed 1 year ago
Verified 92daf909
Task config (#289)
hynky1999 committed 1 year ago
Verified 919be479
Merge branch 'main' into geneartive_dynamic_metrics
NathanHB committed 1 year ago
Verified f99e330d
remove unused import
Hynek Kydlicek committed 1 year ago
75f7ac5d
Tokenization-wise encoding (#287)
hynky1999 committed 1 year ago
Verified 5034a962
fix imports
Hynek Kydlicek committed 1 year ago
532bdadd
Update src/lighteval/metrics/normalizations.py
hynky1999 committed 1 year ago
Verified d80b3bac
Update src/lighteval/utils/imports.py
hynky1999 committed 1 year ago
Verified 227f5729
use punkt tab
hynky1999 committed 1 year ago
f5a8717e
update tokenizers + install nltk reqs
hynky1999 committed 1 year ago
b8f90a9e
Merge branch 'main' into geneartive_dynamic_metrics
hynky1999 committed 1 year ago
Verified 3aa05796
finish multichoice config
hynky1999 committed 1 year ago
95729ee5
draft
hynky1999 committed 1 year ago
2df9a082
Terms Of Use Privacy Policy Refund Policy Impressum