huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into albertvillanova-patch-1

albertvillanova committed 1 year ago

Verified 0bd49aff

Add EvaluationTracker to docs and fix its docstring (#464)

albertvillanova committed 1 year ago

Verified 988fa94d

Merge branch 'main' into albertvillanova-patch-1

NathanHB committed 1 year ago

Verified cc661e3f

fix: CACHE_DIR Default Value in Accelerate Pipeline (#461)

ryan-minato committed 1 year ago

Verified c45e3c8b

albertvillanova committed 1 year ago

Verified eb5353dd

Remove unnecessary deepcopy in evaluation_tracker

albertvillanova committed 1 year ago

Verified b9447ae6

Upgrade deprecated GH Action cache@v2 (#456)

albertvillanova committed 1 year ago

Verified 0977fde6

Adds serverless endpoints back (#445)

clefourrier committed 1 year ago

Verified 51ca581f

use concrete version instead of latest (#452)

ErikKaum committed 1 year ago

Verified bc62cb98

Implement TGI model config from path (#448)

albertvillanova committed 1 year ago

Verified 1b9e2c3c

Fix minor typos (#449)

albertvillanova committed 1 year ago

Verified 0ebc7ec0

Fix wrong instructions and code for custom tasks (#450)

albertvillanova committed 1 year ago

Verified 500632a0

Fix imports from model_config (#443)

albertvillanova committed 1 year ago

Verified 93a056fe

Fix custom arabic tasks (#440)

clefourrier committed 1 year ago

Verified 0135c2e6

Fix a tiny bug in `PromptManager::FewShotSampler::_init_fewshot_sampling_random` (#423)

sadra-barikbin committed 1 year ago

Verified ca2fdcbb

Allow AdapterModels to have custom tokens (#306)

mapmeld committed 1 year ago

Verified 54244b39

Test inference endpoint model config parsing from path (#434)

albertvillanova committed 1 year ago

Verified f907a343

Add new Arabic benchmarks (5) and enhance existing tasks (#372)

alielfilali01 committed 1 year ago

Verified de8dba39

Deprecate Obsolete Config Properties (#433)

ParagEkbote committed 1 year ago

Verified 6ad7276e

Fix ignored reuse_existing in config file (#431)

albertvillanova committed 1 year ago

Verified f2e1f697

Update docs about inference endpoints (#432)

albertvillanova committed 1 year ago

Verified 075a2660

Add trufflehog secrets detection (#429)

albertvillanova committed 1 year ago

Verified c0966cfd

add configs with their models (#421)

clefourrier committed 1 year ago

Verified 9315f0d4

Adds Global MLMU (#426)

hynky1999 committed 1 year ago

Verified 412ccfc1

option to list custom tasks (#425)

NathanHB committed 1 year ago

Verified f2d0a65e

redo logging (#415)

NathanHB committed 1 year ago

Verified 1fb79686

Autoscaling inference endpoints (#412)

clefourrier committed 1 year ago

Verified b68d5bc9

Add missing models to docs (#419)

albertvillanova committed 1 year ago

Verified 39298254

Nathan refacto cli (#407)

NathanHB committed 1 year ago

Verified 6e2754e6

Speed up Bootstrapping Computation (#409)

JoelNiklaus committed 1 year ago

Verified 8e977cbb

Older