huggingface/lighteval

Pull Requests Commits

cheaper oai model

hynky1999 committed 1 year ago

05371061

Merge remote-tracking branch 'origin/main' into baseline_model

hynky1999 committed 1 year ago

00aa6db7

hynky1999 committed 1 year ago

2ee188e6

Update pyproject.toml (#369)

clefourrier committed 1 year ago

Verified 5f22e345

Fix the dataset loading for custom tasks (#364)

clefourrier committed 1 year ago

Verified d9dced1d

adds openai models (#359)

NathanHB committed 1 year ago

Verified 8b47ec18

Fix BLEURT evaluation errors (#316)

chuandudx committed 1 year ago

Verified d84c3783

Adding OZ Eval task (#225)

Stopwolf committed 1 year ago

Verified e27aa0e6

Merge branch 'translation_literals' into baseline_model

hynky1999 committed 1 year ago

fabfcc47

different model name so that the naming is consitent with normal models

hynky1999 committed 1 year ago

d3b52eaf

hynky1999 committed 1 year ago

364f5246

add baseline + fix tasks arg

hynky1999 committed 1 year ago

49c80ca2

clefourrier committed 1 year ago

Verified 9134ca8c

Serbian LLM Benchmark Task (#340)

DeanChugall committed 1 year ago

Verified 635e5812

Merge branch 'main' into translation_literals

clefourrier committed 1 year ago

Verified 976ba44e

add iroko bench + nicer output on task search failure (#357)

hynky1999 committed 1 year ago

Verified c1366677

add missing languags to translation literals

hynky1999 committed 1 year ago

272bb6b2

Merge branch 'translation_literals' of github.com:huggingface/lighteval into translation_literals

hynky1999 committed 1 year ago

16abd55c

hynky1999 committed 1 year ago

941094ad

Merge branch 'main' into translation_literals

hynky1999 committed 1 year ago

Verified 292e313f

hynky1999 committed 1 year ago

10f86159

true/false/or/neither for canaries + nit

hynky1999 committed 1 year ago

fffca194

small nits to translation literals

hynky1999 committed 1 year ago

fd32651a

Misc-multilingual tasks (#339)

hynky1999 committed 1 year ago

Verified b018c9c7

Fix Tokenization + misc fixes (#354)

hynky1999 committed 1 year ago

Verified 1dfd77d1

Selecting tasks using their superset (#308)

hynky1999 committed 1 year ago

Verified 78cda93f

add translaiton literals

hynky1999 committed 1 year ago

060c3ae1

Nathan llm judge quickfix (#350)

NathanHB committed 1 year ago

Verified b8923aa7

Nathan llm judge quickfix (#348)

NathanHB committed 1 year ago

Verified a6cf5cb3

NathanHB committed 1 year ago

Verified cf40366d

Older