huggingface/lighteval

Pull Requests Commits

clefourrier committed 1 year ago

62a3d738

Merge branch 'main' into clem_add_pipeline

clefourrier committed 1 year ago

Verified 375b99b6

Fix missing json file (#264)

NathanHB committed 1 year ago

Verified 01a5129f

A small improvement in `metrics_sample.py::ROUGE` (#217)

sadra-barikbin committed 1 year ago

Verified b54c1896

Merge branch 'main' into clem_add_pipeline

NathanHB committed 1 year ago

Verified c26cb034

adds llm as judge using transformers (#223)

NathanHB committed 1 year ago

Verified cb32024d

Fix IFEval metric (#259)

lewtun committed 1 year ago

Verified 38c03ad2

clefourrier committed 1 year ago

5f1939dc

Merge branch 'main' into clem_add_pipeline

clefourrier committed 1 year ago

Verified 67c8e5cc

Fixing issues with multichoice_continuations_start_space - was not parsed properly (#232)

clefourrier committed 1 year ago

Verified 6041e36e

Expose samples via the CLI (#228)

clefourrier committed 1 year ago

Verified cbae17dc

Fix inference endpoint config (#244)

clefourrier committed 1 year ago

Verified f047874a

uses torch compile if provided (#248)

clefourrier committed 1 year ago

Verified 4751027a

Merge branch 'main' into clem_add_pipeline

clefourrier committed 1 year ago

Verified 533c3332

clefourrier committed 1 year ago

2f20a17e

fix for config logging

clefourrier committed 1 year ago

9e5fb903

clefourrier committed 1 year ago

796bc4df

udpated piqa (#222)

clefourrier committed 1 year ago

Verified 506abda3

clefourrier committed 1 year ago

Verified db502dde

Removes default bert scorer init (#234)

clefourrier committed 1 year ago

Verified 2b4b637e

forgot one import

clefourrier committed 1 year ago

60cfef18

fix circular import

clefourrier committed 1 year ago

e0bd17be

Added model info to models, edited mains to homogenenize them, added a pipeline for neater launches

clefourrier committed 1 year ago

6e1eabee

remove latex writer since we don't use it (#231)

clefourrier committed 1 year ago

Verified 86fbe641

Update issue templates (#235)

clefourrier committed 1 year ago

Verified 003f05e2

Fix a tiny bug in DROP metric (#229)

sadra-barikbin committed 1 year ago

Verified 66ed7a28

Quantization related issues (#224)

clefourrier committed 1 year ago

Verified 44f9a461

Make evaluator invariant of input request type order (#215)

sadra-barikbin committed 1 year ago

Verified 951cd5b5

Fix _init_max_length in base_model.py (#185)

gucci-j committed 1 year ago

Verified d43c9a32

launch lighteval using `lighteval --args` (#152)

NathanHB committed 1 year ago

Verified 4550cb7e

Older