huggingface/lighteval

Pull Requests Commits

add templated mmlu

hynky1999 committed 1 year ago

ccd30dfd

Merge branch 'main' into main

NathanHB committed 1 year ago

Verified bcc48856

fix ukr/rus (#394)

hynky1999 committed 1 year ago

Verified c173871b

Merge branch 'main' into main

NathanHB committed 1 year ago

Verified 9ba81fa9

Use the programmatic interface using an already in memory loaded model (#390)

clefourrier committed 1 year ago

Verified db609f79

Adds template for translation tasks (#391)

hynky1999 committed 1 year ago

Verified fd8a6820

Update all_arabic_tasks.txt

alielfilali01 committed 1 year ago

Verified 7e163e29

Update all_arabic_tasks.txt

alielfilali01 committed 1 year ago

Verified 91aa0e18

Merge branch 'main' into main

clefourrier committed 1 year ago

Verified 3fccdc35

Fixes a TypeError in Sacrebleu. (#387)

JoelNiklaus committed 1 year ago

Verified 9b43560f

Update README.md

clefourrier committed 1 year ago

Verified 1faa3b2c

Merge branch 'main' into main

clefourrier committed 1 year ago

Verified 506e5d18

Fixes a TypeError for generative metrics. (#386)

JoelNiklaus committed 1 year ago

Verified 9be2a387

added tatar literals (#383)

gaydmi committed 1 year ago

Verified 853e10be

greedy_until() fix (#344)

vsabolcec committed 1 year ago

Verified 2f03df01

fix: cache directory variable (#378)

NazimHAli committed 1 year ago

Verified e51be17e

This PR adds translation literals for Belarusian language. (#382)

Kryuski committed 1 year ago

Verified 78d97854

Add Udmurt (udm) translation literals (#381)

codemurt committed 1 year ago

Verified 39a68da8

Merge branch 'main' into main

clefourrier committed 1 year ago

Verified abb7244f

Update arabic_evals.py

alielfilali01 committed 1 year ago

Verified b6d61dcf

added musr (#375)

clefourrier committed 1 year ago

Verified a53bba61

add Shan (shn) translation literals (#376)

NoerNova committed 1 year ago

Verified 083154d2

add bashkir variants (#374)

AigizK committed 1 year ago

Verified 7a82c86b

Merge branch 'main' into main

clefourrier committed 1 year ago

Verified 71c31679

fix typo (#366)

martinscooper committed 1 year ago

Verified ca4139c2

Fix: missing property tag in inference endpoints (#368)

clefourrier committed 1 year ago

Verified 11849add

Adds Baseline workflow + fixes (#363)

hynky1999 committed 1 year ago

Verified 5d7a6b9b

Update all_arabic_tasks.txt

alielfilali01 committed 1 year ago

Verified a1644720

Create OALL_v2_tasks.txt

alielfilali01 committed 1 year ago

Verified f2596d50

Update and rename OALL_tasks.txt to OALL_v1_tasks.txt

alielfilali01 committed 1 year ago

Verified 64d4e116

Older