huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into clem_extended_tasks_in_core

NathanHB committed 1 year ago

Verified e7f3f995

Adding support for Arabic benchmarks : AlGhafa benchmarking suite (#95)

alielfilali01 committed 1 year ago

Verified ef631cf5

Merge branch 'main' into clem_extended_tasks_in_core

clefourrier committed 1 year ago

Verified 44026a76

Fix TextGenerationResponse import from hfh (#129)

Wauplin committed 1 year ago

Verified 53cc1360

Merge branch 'main' into clem_extended_tasks_in_core

clefourrier committed 1 year ago

Verified 09c979fa

Added revision parameter for Inference Endpoint deployment (#127)

shaltielshmid committed 1 year ago

Verified a82387e6

Merge branch 'main' into clem_extended_tasks_in_core

clefourrier committed 1 year ago

Verified 5829c1a5

Added support for launching inference endpoint with different model dtypes (#124)

shaltielshmid committed 1 year ago

Verified 07ca0b28

Update README.md

clefourrier committed 1 year ago

Verified 8cea30fb

Adding BBH subsets back (#126)

bilgehanertan committed 1 year ago

Verified eb0d898e

Merge branch 'main' into clem_extended_tasks_in_core

clefourrier committed 1 year ago

Verified 0a905cba

fixed the loglikelihood models, was not returning the boolean value (#119)

clefourrier committed 1 year ago

Verified 9a1697d7

Fix import typo autogptq (#116)

clefourrier committed 1 year ago

Verified 50b6ed33

Merge branch 'main' into clem_extended_tasks_in_core

clefourrier committed 1 year ago

Verified 49f559d4

Add AGIEval (#121)

clefourrier committed 1 year ago

Verified 133cf9b8

clefourrier committed 1 year ago

14bee225

fixed imports to avoid logger crashing

clefourrier committed 1 year ago

5948aea0

Merge branch 'main' into clem_extended_tasks_in_core

clefourrier committed 1 year ago

Verified c1aa2960

simplified system for extended tasks

clefourrier committed 1 year ago

956ec574

NathanHB committed 1 year ago

Verified ce6a4cc4

Small fixes to InferenceEndpointModel (#112)

shaltielshmid committed 1 year ago

Verified 491a3a76

Fix push details to hub (#98)

NathanHB committed 1 year ago

Verified b1aa6262

Ensure chat models terminate generation with EOS token (#115)

lewtun committed 1 year ago

Verified 11874009

Fix extended tasks usage in README (#108)

lewtun committed 1 year ago

Verified 6d20cb58

Adding TinyBench (#104)

clefourrier committed 1 year ago

Verified 058f3038

Reorder addition of instruction in chat template (#111)

clefourrier committed 1 year ago

Verified 1532a732

Supports extended tasks (#101)

clefourrier committed 1 year ago

Verified df21407d

Fixes input length management for generative evals (#103)

clefourrier committed 1 year ago

Verified e8e4df70

clefourrier committed 1 year ago

Verified e324a83a

Rolling management (#78)

clefourrier committed 1 year ago

Verified bca2b1df

Older