huggingface/lighteval

Pull Requests Commits

hynky1999 committed 1 year ago

5632589b

redo logging (#415)

NathanHB committed 1 year ago

Verified 1fb79686

Autoscaling inference endpoints (#412)

clefourrier committed 1 year ago

Verified b68d5bc9

Add missing models to docs (#419)

albertvillanova committed 1 year ago

Verified 39298254

Nathan refacto cli (#407)

NathanHB committed 1 year ago

Verified 6e2754e6

Speed up Bootstrapping Computation (#409)

JoelNiklaus committed 1 year ago

Verified 8e977cbb

Add docstring docs (#413)

albertvillanova committed 1 year ago

Verified 9bfa1ead

Hynek Kydlicek committed 1 year ago

f1eaca57

Set up docs (#403)

albertvillanova committed 1 year ago

Verified 0c808016

Add doc-builder doc-pr-upload GH Action (#411)

albertvillanova committed 1 year ago

Verified f109de1b

Hynek Kydlicek committed 1 year ago

85fe583d

Fix splitting for generative tasks (#400)

NathanHB committed 1 year ago

08ab5069

Considering the case empty request list is given to base model (#250)

sadra-barikbin committed 1 year ago

54e6973f

Allowing a single prompt to use several formats for one eval (#398)

clefourrier committed 1 year ago

ee815418

Update instance type/size in endpoint model_config example (#401)

albertvillanova committed 1 year ago

c9bedf62

Pr sadra (#393)

clefourrier committed 1 year ago

ad0ba3a5

fix repeated cleanup (#399)

anton-l committed 1 year ago

dba45cca

fix ukr/rus (#394)

hynky1999 committed 1 year ago

5b50dab8

Use the programmatic interface using an already in memory loaded model (#390)

clefourrier committed 1 year ago

62c87be2

Adds template for translation tasks (#391)

hynky1999 committed 1 year ago

f235abc3

Fixes a TypeError in Sacrebleu. (#387)

JoelNiklaus committed 1 year ago

6af52801

Update README.md

clefourrier committed 1 year ago

dcdf53a7

Fixes a TypeError for generative metrics. (#386)

JoelNiklaus committed 1 year ago

99ed6ed5

added tatar literals (#383)

gaydmi committed 1 year ago

1a7729bc

greedy_until() fix (#344)

vsabolcec committed 1 year ago

19da3316

fix: cache directory variable (#378)

NazimHAli committed 1 year ago

3a341855

This PR adds translation literals for Belarusian language. (#382)

Kryuski committed 1 year ago

1eb7bbe6

Add Udmurt (udm) translation literals (#381)

codemurt committed 1 year ago

340c1272

Hynek Kydlicek committed 1 year ago

9a97dede

Hynek Kydlicek committed 1 year ago

d765a53f

Newer Older