huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into nathan_fix_push_details

clefourrier committed 1 year ago

Verified 35352192

added info back from orig PR

clefourrier committed 1 year ago

7342c39a

Ensure chat models terminate generation with EOS token (#115)

lewtun committed 1 year ago

Verified 11874009

Merge branch 'main' into nathan_fix_push_details

clefourrier committed 1 year ago

a3710f85

Fix extended tasks usage in README (#108)

lewtun committed 1 year ago

Verified 6d20cb58

Merge branch 'main' into nathan_fix_push_details

clefourrier committed 1 year ago

Verified 0b46890e

Adding TinyBench (#104)

clefourrier committed 1 year ago

Verified 058f3038

Reorder addition of instruction in chat template (#111)

clefourrier committed 1 year ago

Verified 1532a732

Merge branch 'main' into nathan_fix_push_details

clefourrier committed 1 year ago

Verified 693a1d65

Supports extended tasks (#101)

clefourrier committed 1 year ago

Verified df21407d

Fixes input length management for generative evals (#103)

clefourrier committed 1 year ago

Verified e8e4df70

clefourrier committed 1 year ago

Verified e324a83a

Rolling management (#78)

clefourrier committed 1 year ago

Verified bca2b1df

NathanHB committed 1 year ago

bb5cca2e

Makes it clearer in the README that the leaderboard uses the harness (#94)

clefourrier committed 1 year ago

Verified 988959cb

Release: v0.2.0 (#77)

NathanHB committed 1 year ago

Verified 13d7946d

Change the eos condition for GSM8K (#85)

clefourrier committed 1 year ago

Verified 9b3813ff

Fix parallel data processing bug (#92)

clefourrier committed 1 year ago

Verified 3b0aa23d

add license header to src files (#89)

NathanHB committed 1 year ago

Verified 2d529ac8

Sets a max length for the MATH task (#83)

clefourrier committed 1 year ago

Verified 458d50b0

bump git python (#90)

NathanHB committed 1 year ago

Verified 5ba92603

update pyproject ruff config to match new version

Nathan Habib committed 1 year ago

410fd908

Tidy up dependency groups (#81)

lewtun committed 1 year ago

Verified 7bf40877

Create LICENSE (#86)

clefourrier committed 1 year ago

Verified 927e63ef

Upgrade huggingface_hub to fix datasets import and add trust_remote_code in datasets (#84)

clefourrier committed 1 year ago

Verified 9ecab065

Relax sentencepiece version (#74)

lewtun committed 1 year ago

Verified b9d02770

Update ruff (#71)

clefourrier committed 1 year ago

Verified 030945b1

Now manages no generation size is set in a generative task description (#76)

clefourrier committed 1 year ago

Verified e49585da

Fixes wikitext prompts + some patches on tg models (#64)

clefourrier committed 1 year ago

Verified cabef7c4

Adding custom metric system + IFEval as an example (#48)

clefourrier committed 1 year ago

Verified acffc1a8

Older