huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into clefourrier-patch-1

clefourrier committed 2 years ago

Verified b0a9d578

Now manages no generation size is set in a generative task description (#76)

clefourrier committed 2 years ago

Verified e49585da

Fixes wikitext prompts + some patches on tg models (#64)

clefourrier committed 2 years ago

Verified cabef7c4

Merge branch 'main' into clefourrier-patch-1

clefourrier committed 2 years ago

Verified 738df61b

clefourrier committed 2 years ago

5580b60f

clefourrier committed 2 years ago

ecbef105

test: should allow ruff to follow the pyproject.toml

clefourrier committed 2 years ago

d37db54b

Adding custom metric system + IFEval as an example (#48)

clefourrier committed 2 years ago

Verified acffc1a8

Just adding the custom metrics system (#65)

clefourrier committed 2 years ago

Verified 3785d852

clefourrier committed 2 years ago

Verified cb566e51

Fixes chat template application to choices (#67)

clefourrier committed 2 years ago

Verified 49074998

Remove the eos token override in the Default Config Task (#54)

clefourrier committed 2 years ago

Verified 449817f6

thomwolf committed 2 years ago

Verified 589e6b0d

Update leaderboard task set (#60)

lewtun committed 2 years ago

Verified 6a3e3b92

Tweak installation / usage sections of README (#55)

lewtun committed 2 years ago

Verified 480d85ef

Adding support for Arabic benchmarks : AceGPT benchmarking suite (#44)

alielfilali01 committed 2 years ago

Verified 090101f1

New mechanism for evaluation contributions (#47)

clefourrier committed 2 years ago

Verified 92e9b505

clefourrier committed 2 years ago

Verified 831ad47b

Improve the current chat template system (#38)

clefourrier committed 2 years ago

Verified 81fc8fda

bump transformers to 4.38 (#46)

NathanHB committed 2 years ago

Verified fb57ffc6

Add an automatic system to compute average for tasks with subtasks

clefourrier committed 2 years ago

Verified 62abc78c

Update README.md (#37)

clefourrier committed 2 years ago

Verified 77c20164

tolgacangoz committed 2 years ago

Verified c62e48ef

Patch fix to match with config update/simplification in nanotron (#35)

thomwolf committed 2 years ago

Verified 69897372

oneonlee committed 2 years ago

Verified 30ce66d5

Fix doc path in README (#30)

baskrahmer committed 2 years ago

Verified 1886fa6c

path metadatatable path in readme (#28)

NathanHB committed 2 years ago

Verified ae9eb5f7

Fix git clone in README (#27)

maziyarpanahi committed 2 years ago

Verified 3b90455f

Update README.md (#26)

ledrui committed 2 years ago

Verified fedadcdf

thomwolf committed 2 years ago

adf1031f

Older