huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into nathan-add-logging-to-metrics

NathanHB committed 2 years ago

Verified 6f89ce14

Fix nanotron models input size bug (#156)

clefourrier committed 2 years ago

Verified 6ea07cd7

Merge branch 'main' into nathan-add-logging-to-metrics

NathanHB committed 2 years ago

Verified c529f03c

NathanHB committed 2 years ago

f4e4c902

NathanHB committed 2 years ago

b68222db

NathanHB committed 2 years ago

7cec7e6d

CLI list tasks (#142)

DimbyTa committed 2 years ago

Verified f28a270a

homogenize logging for metrics

Nathan Habib committed 2 years ago

8c0fb237

Add llm as judge in metrics (#146)

NathanHB committed 2 years ago

Verified 7f6f8077

Added Namespace parameter for InferenceEndpoints, added option for passing model config directly (#147)

shaltielshmid committed 2 years ago

Verified 23987aa7

Add `Ger-RAG-eval`tasks. (#149)

PhilipMay committed 2 years ago

Verified 5a732e6c

Add fun widgets to the README (#145)

clefourrier committed 2 years ago

Verified 996b5042

Add config files for models (#131)

clefourrier committed 2 years ago

Verified efa17331

Fix max_length type in base_model.py (#138)

csarron committed 2 years ago

Verified ce087cda

NathanHB committed 2 years ago

Verified 017581f7

Add mt-bench (#75)

NathanHB committed 2 years ago

Verified af24080e

Update test workflow name to 'Tests' (#134)

Wauplin committed 2 years ago

Verified bbe3b5f8

Do not use deprecated list_files_info (#133)

Wauplin committed 2 years ago

Verified 7f25cce7

Simplified system for extended tasks (#123)

clefourrier committed 2 years ago

Verified e941a552

Adding support for Arabic benchmarks : AlGhafa benchmarking suite (#95)

alielfilali01 committed 2 years ago

Verified ef631cf5

Fix TextGenerationResponse import from hfh (#129)

Wauplin committed 2 years ago

Verified 53cc1360

Added revision parameter for Inference Endpoint deployment (#127)

shaltielshmid committed 2 years ago

Verified a82387e6

Added support for launching inference endpoint with different model dtypes (#124)

shaltielshmid committed 2 years ago

Verified 07ca0b28

Adding BBH subsets back (#126)

bilgehanertan committed 2 years ago

Verified eb0d898e

fixed the loglikelihood models, was not returning the boolean value (#119)

clefourrier committed 2 years ago

Verified 9a1697d7

Fix import typo autogptq (#116)

clefourrier committed 2 years ago

Verified 50b6ed33

Add AGIEval (#121)

clefourrier committed 2 years ago

Verified 133cf9b8

NathanHB committed 2 years ago

Verified ce6a4cc4

Small fixes to InferenceEndpointModel (#112)

shaltielshmid committed 2 years ago

Verified 491a3a76

Fix push details to hub (#98)

NathanHB committed 2 years ago

Verified b1aa6262

Older