huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into pr_sadra

clefourrier committed 1 year ago

Verified 777c8c5d

fix repeated cleanup (#399)

anton-l committed 1 year ago

Verified 85c0d9f0

Merge branch 'main' into pr_sadra

NathanHB committed 1 year ago

Verified cc09ac30

fix ukr/rus (#394)

hynky1999 committed 1 year ago

Verified c173871b

clefourrier committed 1 year ago

c72982a5

Use the programmatic interface using an already in memory loaded model (#390)

clefourrier committed 1 year ago

Verified db609f79

clefourrier committed 1 year ago

Verified 63edb8e8

Merge branch 'main' into pr_sadra

NathanHB committed 1 year ago

Verified b5f22cfa

Adds template for translation tasks (#391)

hynky1999 committed 1 year ago

Verified fd8a6820

clefourrier committed 1 year ago

0c651c01

correct community tasks

clefourrier committed 1 year ago

85ddfa9e

added class for few shot back

clefourrier committed 1 year ago

05217d01

Merge branch 'main' into deciding-target-for-fewshot-sorting

clefourrier committed 1 year ago

Verified 8b51d613

removing doc_to_target from task as it's now in the prompt manager

clefourrier committed 1 year ago

Verified 3d967340

Update prompt_manager.py

clefourrier committed 1 year ago

Verified c5458633

Update requests.py

clefourrier committed 1 year ago

Verified c5c9936a

Fixes a TypeError in Sacrebleu. (#387)

JoelNiklaus committed 1 year ago

Verified 9b43560f

Update piqa_helm

sadra-barikbin committed 1 year ago

656a03fd

Apply review comments

sadra-barikbin committed 1 year ago

aa36d2d1

Update README.md

clefourrier committed 1 year ago

Verified 1faa3b2c

Fixes a TypeError for generative metrics. (#386)

JoelNiklaus committed 1 year ago

Verified 9be2a387

added tatar literals (#383)

gaydmi committed 1 year ago

Verified 853e10be

greedy_until() fix (#344)

vsabolcec committed 1 year ago

Verified 2f03df01

fix: cache directory variable (#378)

NazimHAli committed 1 year ago

Verified e51be17e

This PR adds translation literals for Belarusian language. (#382)

Kryuski committed 1 year ago

Verified 78d97854

Add Udmurt (udm) translation literals (#381)

codemurt committed 1 year ago

Verified 39a68da8

added musr (#375)

clefourrier committed 1 year ago

Verified a53bba61

add Shan (shn) translation literals (#376)

NoerNova committed 1 year ago

Verified 083154d2

add bashkir variants (#374)

AigizK committed 1 year ago

Verified 7a82c86b

fix typo (#366)

martinscooper committed 1 year ago

Verified ca4139c2

Older