huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into test_cleaning_up

clefourrier committed 1 year ago

Verified 783251f2

Add grammar option to generation (#242)

sadra-barikbin committed 1 year ago

Verified e43c9490

made more programmatic for model creation too

clefourrier committed 1 year ago

9bb46b7a

Merge branch 'main' into test_cleaning_up

clefourrier committed 1 year ago

Verified 22a9a5fd

Update src/lighteval/tasks/requests.py

clefourrier committed 1 year ago

Verified cecfa5b9

clefourrier committed 1 year ago

cc81e407

simplified tests reading

clefourrier committed 1 year ago

f223f929

updates ifeval repo (#268)

NathanHB committed 1 year ago

Verified cf87de99

clefourrier committed 1 year ago

fe0adb0e

Merge branch 'main' into test_cleaning_up

clefourrier committed 1 year ago

Verified cb2c41e9

debug recursive import + logging + metric execution calls

clefourrier committed 1 year ago

7d77197f

fix init of requests

clefourrier committed 1 year ago

7d1fe3f4

Update __main__.py

clefourrier committed 1 year ago

Verified 6f917036

forgot to push the tests

clefourrier committed 1 year ago

6acd6e7f

added evaluator to pipeline, as these blocks are logically redundant

clefourrier committed 1 year ago

e5754d25

fix the location of tasks list in the readme (#267)

NathanHB committed 1 year ago

Verified 194e742f

change priority when choosing model dtype (#263)

NathanHB committed 1 year ago

Verified 5c1ae855

clefourrier committed 1 year ago

62a3d738

Merge branch 'main' into clem_add_pipeline

clefourrier committed 1 year ago

Verified 375b99b6

Fix missing json file (#264)

NathanHB committed 1 year ago

Verified 01a5129f

A small improvement in `metrics_sample.py::ROUGE` (#217)

sadra-barikbin committed 1 year ago

Verified b54c1896

Merge branch 'main' into clem_add_pipeline

NathanHB committed 1 year ago

Verified c26cb034

adds llm as judge using transformers (#223)

NathanHB committed 1 year ago

Verified cb32024d

Fix IFEval metric (#259)

lewtun committed 1 year ago

Verified 38c03ad2

clefourrier committed 1 year ago

5f1939dc

Merge branch 'main' into clem_add_pipeline

clefourrier committed 1 year ago

Verified 67c8e5cc

Fixing issues with multichoice_continuations_start_space - was not parsed properly (#232)

clefourrier committed 1 year ago

Verified 6041e36e

Expose samples via the CLI (#228)

clefourrier committed 1 year ago

Verified cbae17dc

Fix inference endpoint config (#244)

clefourrier committed 1 year ago

Verified f047874a

uses torch compile if provided (#248)

clefourrier committed 1 year ago

Verified 4751027a

Older