huggingface/lighteval

Pull Requests Commits

Update src/lighteval/models/base_model.py

clefourrier committed 1 year ago

Verified 2dde33f9

Merge branch 'main' into clem_in_mem_model

NathanHB committed 1 year ago

Verified fb69543e

Adds template for translation tasks (#391)

hynky1999 committed 1 year ago

Verified fd8a6820

Merge branch 'main' into clem_in_mem_model

clefourrier committed 1 year ago

Verified 5edd48a8

Fixes a TypeError in Sacrebleu. (#387)

JoelNiklaus committed 1 year ago

Verified 9b43560f

Update README.md

clefourrier committed 1 year ago

Verified 1faa3b2c

Merge branch 'main' into clem_in_mem_model

clefourrier committed 1 year ago

Verified f2438a5f

Fixes a TypeError for generative metrics. (#386)

JoelNiklaus committed 1 year ago

Verified 9be2a387

clefourrier committed 1 year ago

0f204ffc

manage accelerate if needed

clefourrier committed 1 year ago

cb8dd5bb

added tatar literals (#383)

gaydmi committed 1 year ago

Verified 853e10be

add chat template as param

clefourrier committed 1 year ago

e43840e9

pipeline working

clefourrier committed 1 year ago

8909bcaf

adding an init call to load models from an already in mem model

clefourrier committed 1 year ago

b107db7f

greedy_until() fix (#344)

vsabolcec committed 1 year ago

Verified 2f03df01

fix: cache directory variable (#378)

NazimHAli committed 1 year ago

Verified e51be17e

This PR adds translation literals for Belarusian language. (#382)

Kryuski committed 1 year ago

Verified 78d97854

Add Udmurt (udm) translation literals (#381)

codemurt committed 1 year ago

Verified 39a68da8

added musr (#375)

clefourrier committed 1 year ago

Verified a53bba61

add Shan (shn) translation literals (#376)

NoerNova committed 1 year ago

Verified 083154d2

add bashkir variants (#374)

AigizK committed 1 year ago

Verified 7a82c86b

fix typo (#366)

martinscooper committed 1 year ago

Verified ca4139c2

Fix: missing property tag in inference endpoints (#368)

clefourrier committed 1 year ago

Verified 11849add

Adds Baseline workflow + fixes (#363)

hynky1999 committed 1 year ago

Verified 5d7a6b9b

selected tasks for multilingual evaluation (#371)

hynky1999 committed 1 year ago

Verified 7fe7b12d

Translation literals (#356)

hynky1999 committed 1 year ago

Verified 84372272

Update pyproject.toml (#369)

clefourrier committed 1 year ago

Verified 5f22e345

Fix the dataset loading for custom tasks (#364)

clefourrier committed 1 year ago

Verified d9dced1d

adds openai models (#359)

NathanHB committed 1 year ago

Verified 8b47ec18

Fix BLEURT evaluation errors (#316)

chuandudx committed 1 year ago

Verified d84c3783

Older