huggingface/lighteval

Pull Requests Commits

Adds serverless endpoints back (#445)

clefourrier committed 1 year ago

Verified 51ca581f

use concrete version instead of latest (#452)

ErikKaum committed 1 year ago

Verified bc62cb98

Merge branch 'main' into clem_homogeneize_generation_params

clefourrier committed 1 year ago

8e3b7e2e

removed temperature from default vllm params as it should be passed via the generationparams instead

clefourrier committed 1 year ago

dece2f9b

Implement TGI model config from path (#448)

albertvillanova committed 1 year ago

Verified 1b9e2c3c

Fix minor typos (#449)

albertvillanova committed 1 year ago

Verified 0ebc7ec0

Merge branch 'main' into clem_homogeneize_generation_params

clefourrier committed 1 year ago

Verified e8b90579

Update src/lighteval/models/transformers/transformers_model.py

clefourrier committed 1 year ago

Verified be99c5ed

Apply suggestions from code review

clefourrier committed 1 year ago

Verified fb4ecdc6

Fix wrong instructions and code for custom tasks (#450)

albertvillanova committed 1 year ago

Verified 500632a0

Fix imports from model_config (#443)

albertvillanova committed 1 year ago

Verified 93a056fe

Merge branch 'main' into clem_homogeneize_generation_params

clefourrier committed 1 year ago

Verified 431b4f27

fix #16 by also allowing a generationconfig object to be passed programmatically if needed

clefourrier committed 1 year ago

30bed896

clefourrier committed 1 year ago

48339297

clefourrier committed 1 year ago

f9ab29b8

removed the use of a GenerationConfig object, as it's got lots of params set by default which slow down generations

clefourrier committed 1 year ago

a585701c

Fix custom arabic tasks (#440)

clefourrier committed 1 year ago

Verified 0135c2e6

rename base_model to transformers_model

clefourrier committed 1 year ago

3eb7d0ff

Merge branch 'main' into clem_homogeneize_generation_params

clefourrier committed 1 year ago

e1bd34fb

updated launchers

clefourrier committed 1 year ago

c088ab67

Fix a tiny bug in `PromptManager::FewShotSampler::_init_fewshot_sampling_random` (#423)

sadra-barikbin committed 1 year ago

Verified ca2fdcbb

Allow AdapterModels to have custom tokens (#306)

mapmeld committed 1 year ago

Verified 54244b39

Test inference endpoint model config parsing from path (#434)

albertvillanova committed 1 year ago

Verified f907a343

Merge branch 'main' into clem_homogeneize_generation_params

clefourrier committed 1 year ago

Verified 91363fea

Add new Arabic benchmarks (5) and enhance existing tasks (#372)

alielfilali01 committed 1 year ago

Verified de8dba39

Deprecate Obsolete Config Properties (#433)

ParagEkbote committed 1 year ago

Verified 6ad7276e

clefourrier committed 1 year ago

521559f7

Fix ignored reuse_existing in config file (#431)

albertvillanova committed 1 year ago

Verified f2e1f697

Update docs about inference endpoints (#432)

albertvillanova committed 1 year ago

Verified 075a2660

Add trufflehog secrets detection (#429)

albertvillanova committed 1 year ago

Verified c0966cfd

Newer Older