huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into add_model_config_files

clefourrier committed 1 year ago

Verified 1356b6bf

edited task examples path

clefourrier committed 1 year ago

29403934

Fix max_length type in base_model.py (#138)

csarron committed 1 year ago

Verified ce087cda

clefourrier committed 1 year ago

31612ad9

Merge branch 'main' into add_model_config_files

NathanHB committed 1 year ago

Verified ee500b09

NathanHB committed 1 year ago

Verified 017581f7

Merge branch 'main' into add_model_config_files

clefourrier committed 1 year ago

Verified fd359b34

Add mt-bench (#75)

NathanHB committed 1 year ago

Verified af24080e

Merge branch 'main' into add_model_config_files

clefourrier committed 1 year ago

Verified 956d82b6

Update test workflow name to 'Tests' (#134)

Wauplin committed 1 year ago

Verified bbe3b5f8

Merge branch 'main' into add_model_config_files

clefourrier committed 1 year ago

Verified c8159443

Do not use deprecated list_files_info (#133)

Wauplin committed 1 year ago

Verified 7f25cce7

Merge branch 'main' into add_model_config_files

clefourrier committed 1 year ago

Verified 78a63188

removed useless call

clefourrier committed 1 year ago

21ff928a

clefourrier committed 1 year ago

25b10c21

clefourrier committed 1 year ago

40742fd7

clefourrier committed 1 year ago

4ac60507

Simplified system for extended tasks (#123)

clefourrier committed 1 year ago

Verified e941a552

fix main + refacto

clefourrier committed 1 year ago

590c475f

clefourrier committed 1 year ago

0d79c98e

updated 8bit/4bit calls throughout the code

clefourrier committed 1 year ago

364ede00

clefourrier committed 1 year ago

99e9fa8c

v0 - added the different configs through yaml files, need to document

clefourrier committed 1 year ago

197b715a

Adding support for Arabic benchmarks : AlGhafa benchmarking suite (#95)

alielfilali01 committed 1 year ago

Verified ef631cf5

Fix TextGenerationResponse import from hfh (#129)

Wauplin committed 1 year ago

Verified 53cc1360

Added revision parameter for Inference Endpoint deployment (#127)

shaltielshmid committed 1 year ago

Verified a82387e6

Added support for launching inference endpoint with different model dtypes (#124)

shaltielshmid committed 1 year ago

Verified 07ca0b28

Adding BBH subsets back (#126)

bilgehanertan committed 1 year ago

Verified eb0d898e

fixed the loglikelihood models, was not returning the boolean value (#119)

clefourrier committed 1 year ago

Verified 9a1697d7

Fix import typo autogptq (#116)

clefourrier committed 1 year ago

Verified 50b6ed33

Older