huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into clem_add_gpqa

clefourrier committed 1 year ago

Verified 810768c6

Improve the current chat template system (#38)

clefourrier committed 1 year ago

Verified 81fc8fda

bump transformers to 4.38 (#46)

NathanHB committed 1 year ago

Verified fb57ffc6

clefourrier committed 1 year ago

30c19a1f

Update src/lighteval/tasks/tasks_prompt_formatting.py

clefourrier committed 1 year ago

Verified 1b812fb2

Add an automatic system to compute average for tasks with subtasks

clefourrier committed 1 year ago

Verified 62abc78c

Update README.md (#37)

clefourrier committed 1 year ago

Verified 77c20164

changed prompt slightly

clefourrier committed 1 year ago

f1b5f01f

Merge branch 'main' into clem_add_gpqa

clefourrier committed 1 year ago

Verified e8c53cd0

clefourrier committed 1 year ago

400ba1bf

tolgacangoz committed 1 year ago

Verified c62e48ef

Patch fix to match with config update/simplification in nanotron (#35)

thomwolf committed 1 year ago

Verified 69897372

oneonlee committed 1 year ago

Verified 30ce66d5

Fix doc path in README (#30)

baskrahmer committed 1 year ago

Verified 1886fa6c

path metadatatable path in readme (#28)

NathanHB committed 1 year ago

Verified ae9eb5f7

Fix git clone in README (#27)

maziyarpanahi committed 1 year ago

Verified 3b90455f

Update README.md (#26)

ledrui committed 1 year ago

Verified fedadcdf

thomwolf committed 1 year ago

adf1031f

bump to dev version (#24)

NathanHB committed 1 year ago

Verified fa4e8259

Last PR to make custom tasks work for everyone (#23)

thomwolf committed 1 year ago

Verified bc0b8bc4

change dependencies so that we can upload on pypi (#22)

NathanHB committed 1 year ago

Verified f8bd2ab4

fixing nanotron (#21)

NathanHB committed 1 year ago

Verified 59891e0c

Update README (#19)

clefourrier committed 1 year ago

Verified b409d957

Support for nanotron (#11)

thomwolf committed 1 year ago

Verified 8aaf51c5

Adding inference endpoints models (#12)

clefourrier committed 1 year ago

Verified 1e837a97

Adding the target perplexity fix back (#15)

clefourrier committed 1 year ago

Verified 77eee8cb

Revert "moving custom tasks to code"

thomwolf committed 1 year ago

37db422f

moving custom tasks to code

thomwolf committed 1 year ago

cb163be1

Documentation and typing of functions (#5)

NathanHB committed 1 year ago

Verified 059e100b

Revert "Merge pull request #10 from huggingface/fix-target-perplexity" (#14)

NathanHB committed 1 year ago

Verified c50e19f6

Older