huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into GSM8K_change_eos_condition

clefourrier committed 1 year ago

Verified 8daf7916

Fix parallel data processing bug (#92)

clefourrier committed 1 year ago

Verified 3b0aa23d

add license header to src files (#89)

NathanHB committed 1 year ago

Verified 2d529ac8

Update README.md

clefourrier committed 1 year ago

Verified 35a0a6f8

Merge branch 'main' into GSM8K_change_eos_condition

clefourrier committed 1 year ago

Verified bb3e60ed

Sets a max length for the MATH task (#83)

clefourrier committed 1 year ago

Verified 458d50b0

Merge branch 'main' into GSM8K_change_eos_condition

clefourrier committed 1 year ago

Verified 77dc1898

update task table ^^''

clefourrier committed 1 year ago

5f2c1e36

updated to leaderboard tasks vs normal tasks

clefourrier committed 1 year ago

607a1eb9

bump git python (#90)

NathanHB committed 1 year ago

Verified 5ba92603

update pyproject ruff config to match new version

Nathan Habib committed 1 year ago

410fd908

Merge branch 'main' into GSM8K_change_eos_condition

clefourrier committed 1 year ago

Verified ea738d2b

Tidy up dependency groups (#81)

lewtun committed 1 year ago

Verified 7bf40877

Create LICENSE (#86)

clefourrier committed 1 year ago

Verified 927e63ef

Merge branch 'main' into GSM8K_change_eos_condition

clefourrier committed 1 year ago

Verified 3f918bfa

Upgrade huggingface_hub to fix datasets import and add trust_remote_code in datasets (#84)

clefourrier committed 1 year ago

Verified 9ecab065

clefourrier committed 1 year ago

e201451e

change GSM8K conf

clefourrier committed 1 year ago

d22f7ac4

Relax sentencepiece version (#74)

lewtun committed 1 year ago

Verified b9d02770

Update ruff (#71)

clefourrier committed 1 year ago

Verified 030945b1

Now manages no generation size is set in a generative task description (#76)

clefourrier committed 1 year ago

Verified e49585da

Fixes wikitext prompts + some patches on tg models (#64)

clefourrier committed 1 year ago

Verified cabef7c4

Adding custom metric system + IFEval as an example (#48)

clefourrier committed 1 year ago

Verified acffc1a8

Just adding the custom metrics system (#65)

clefourrier committed 1 year ago

Verified 3785d852

Fixes chat template application to choices (#67)

clefourrier committed 1 year ago

Verified 49074998

Remove the eos token override in the Default Config Task (#54)

clefourrier committed 1 year ago

Verified 449817f6

thomwolf committed 1 year ago

Verified 589e6b0d

Update leaderboard task set (#60)

lewtun committed 1 year ago

Verified 6a3e3b92

Tweak installation / usage sections of README (#55)

lewtun committed 1 year ago

Verified 480d85ef

Adding support for Arabic benchmarks : AceGPT benchmarking suite (#44)

alielfilali01 committed 1 year ago

Verified 090101f1

Older