huggingface/lighteval

Pull Requests Commits

Update examples/model_configs/endpoint_model_lite.yaml

clefourrier committed 1 year ago

Verified 2f61f1b1

Merge branch 'main' into clem_inference_endpoint_autoscale

clefourrier committed 1 year ago

Verified 1193875a

Add missing models to docs (#419)

albertvillanova committed 1 year ago

Verified 39298254

fix default batch size override

clefourrier committed 1 year ago

8b061043

fix to parallelism manager - no need for endpoint

clefourrier committed 1 year ago

99607333

Merge branch 'main' into clem_inference_endpoint_autoscale

clefourrier committed 1 year ago

aa0e9e5e

Nathan refacto cli (#407)

NathanHB committed 1 year ago

Verified 6e2754e6

clefourrier committed 1 year ago

b39131f5

Merge branch 'main' into clem_inference_endpoint_autoscale

clefourrier committed 1 year ago

Verified 72a978f1

Speed up Bootstrapping Computation (#409)

JoelNiklaus committed 1 year ago

Verified 8e977cbb

clefourrier committed 1 year ago

3ea93e9d

restore endpoint name vs model name diff

clefourrier committed 1 year ago

cb6ea93e

added pause option

clefourrier committed 1 year ago

b59f8973

should be working now!

clefourrier committed 1 year ago

18a88418

upgraded autoscale

clefourrier committed 1 year ago

e69c321b

Merge branch 'main' into clem_inference_endpoint_autoscale

clefourrier committed 1 year ago

Verified 56111ca9

Add docstring docs (#413)

albertvillanova committed 1 year ago

Verified 9bfa1ead

adding better management for restarts and resizes

clefourrier committed 1 year ago

b4c98948

first draft of autoscale

clefourrier committed 1 year ago

19ab5159

Set up docs (#403)

albertvillanova committed 1 year ago

Verified 0c808016

Add doc-builder doc-pr-upload GH Action (#411)

albertvillanova committed 1 year ago

Verified f109de1b

Fixes an error with getting the golds from the formatted_docs. (#388)

JoelNiklaus committed 1 year ago

Verified 95e1e4bf

Typo in feature-request.md (#406)

albertvillanova committed 1 year ago

Verified de73cc7f

Fix splitting for generative tasks (#400)

NathanHB committed 1 year ago

Verified ea46419a

Considering the case empty request list is given to base model (#250)

sadra-barikbin committed 1 year ago

Verified 2c9bf97e

Allowing a single prompt to use several formats for one eval (#398)

clefourrier committed 1 year ago

Verified 24d5feb5

Update instance type/size in endpoint model_config example (#401)

albertvillanova committed 1 year ago

Verified 3744fe26

Pr sadra (#393)

clefourrier committed 1 year ago

Verified e25af7b9

fix repeated cleanup (#399)

anton-l committed 1 year ago

Verified 85c0d9f0

fix ukr/rus (#394)

hynky1999 committed 1 year ago

Verified c173871b

Older