huggingface/lighteval

Pull Requests Commits

option to list custom tasks

NathanHB committed 1 year ago

78cc3313

redo logging (#415)

NathanHB committed 1 year ago

Verified 1fb79686

Autoscaling inference endpoints (#412)

clefourrier committed 1 year ago

Verified b68d5bc9

Add missing models to docs (#419)

albertvillanova committed 1 year ago

Verified 39298254

Nathan refacto cli (#407)

NathanHB committed 1 year ago

Verified 6e2754e6

Speed up Bootstrapping Computation (#409)

JoelNiklaus committed 1 year ago

Verified 8e977cbb

Add docstring docs (#413)

albertvillanova committed 1 year ago

Verified 9bfa1ead

Set up docs (#403)

albertvillanova committed 1 year ago

Verified 0c808016

Add doc-builder doc-pr-upload GH Action (#411)

albertvillanova committed 1 year ago

Verified f109de1b

Fixes an error with getting the golds from the formatted_docs. (#388)

JoelNiklaus committed 1 year ago

Verified 95e1e4bf

Typo in feature-request.md (#406)

albertvillanova committed 1 year ago

Verified de73cc7f

Fix splitting for generative tasks (#400)

NathanHB committed 1 year ago

Verified ea46419a

Considering the case empty request list is given to base model (#250)

sadra-barikbin committed 1 year ago

Verified 2c9bf97e

Allowing a single prompt to use several formats for one eval (#398)

clefourrier committed 1 year ago

Verified 24d5feb5

Update instance type/size in endpoint model_config example (#401)

albertvillanova committed 1 year ago

Verified 3744fe26

Pr sadra (#393)

clefourrier committed 1 year ago

Verified e25af7b9

fix repeated cleanup (#399)

anton-l committed 1 year ago

Verified 85c0d9f0

fix ukr/rus (#394)

hynky1999 committed 1 year ago

Verified c173871b

Use the programmatic interface using an already in memory loaded model (#390)

clefourrier committed 1 year ago

Verified db609f79

Adds template for translation tasks (#391)

hynky1999 committed 1 year ago

Verified fd8a6820

Fixes a TypeError in Sacrebleu. (#387)

JoelNiklaus committed 1 year ago

Verified 9b43560f

Update README.md

clefourrier committed 1 year ago

Verified 1faa3b2c

Fixes a TypeError for generative metrics. (#386)

JoelNiklaus committed 1 year ago

Verified 9be2a387

added tatar literals (#383)

gaydmi committed 1 year ago

Verified 853e10be

greedy_until() fix (#344)

vsabolcec committed 1 year ago

Verified 2f03df01

fix: cache directory variable (#378)

NazimHAli committed 1 year ago

Verified e51be17e

This PR adds translation literals for Belarusian language. (#382)

Kryuski committed 1 year ago

Verified 78d97854

Add Udmurt (udm) translation literals (#381)

codemurt committed 1 year ago

Verified 39a68da8

added musr (#375)

clefourrier committed 1 year ago

Verified a53bba61

add Shan (shn) translation literals (#376)

NoerNova committed 1 year ago

Verified 083154d2

Older