huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into nathan-add-judge-transformers

NathanHB committed 1 year ago

Verified 5633fdc2

NathanHB committed 1 year ago

97b7b428

Fix IFEval metric (#259)

lewtun committed 1 year ago

Verified 38c03ad2

Merge branch 'main' into nathan-add-judge-transformers

clefourrier committed 1 year ago

Verified ea121854

Fixing issues with multichoice_continuations_start_space - was not parsed properly (#232)

clefourrier committed 1 year ago

Verified 6041e36e

Expose samples via the CLI (#228)

clefourrier committed 1 year ago

Verified cbae17dc

Fix inference endpoint config (#244)

clefourrier committed 1 year ago

Verified f047874a

uses torch compile if provided (#248)

clefourrier committed 1 year ago

Verified 4751027a

NathanHB committed 1 year ago

5df8df31

NathanHB committed 1 year ago

3109dcda

NathanHB committed 1 year ago

2b8a078c

Update src/lighteval/metrics/llm_as_judge.py

NathanHB committed 1 year ago

Verified bb742c99

Merge branch 'nathan-add-judge-transformers' of github.com:huggingface/lighteval into nathan-add-judge-transformers

NathanHB committed 1 year ago

131c90ef

fixing PR comments

NathanHB committed 1 year ago

0ce15da0

Merge branch 'main' into nathan-add-judge-transformers

clefourrier committed 1 year ago

Verified 27585fa6

readd openai and adds llama 3 405b as judge

NathanHB committed 1 year ago

a75d0576

udpated piqa (#222)

clefourrier committed 1 year ago

Verified 506abda3

clefourrier committed 1 year ago

Verified db502dde

NathanHB committed 1 year ago

e6c9a998

Merge remote-tracking branch 'origin/main' into nathan-add-judge-transformers

NathanHB committed 1 year ago

36ed5099

NathanHB committed 1 year ago

ba8c7bf1

NathanHB committed 1 year ago

a54b8883

Removes default bert scorer init (#234)

clefourrier committed 1 year ago

Verified 2b4b637e

remove latex writer since we don't use it (#231)

clefourrier committed 1 year ago

Verified 86fbe641

Update issue templates (#235)

clefourrier committed 1 year ago

Verified 003f05e2

Fix a tiny bug in DROP metric (#229)

sadra-barikbin committed 1 year ago

Verified 66ed7a28

Quantization related issues (#224)

clefourrier committed 1 year ago

Verified 44f9a461

Make evaluator invariant of input request type order (#215)

sadra-barikbin committed 1 year ago

Verified 951cd5b5

Fix _init_max_length in base_model.py (#185)

gucci-j committed 1 year ago

Verified d43c9a32

launch lighteval using `lighteval --args` (#152)

NathanHB committed 1 year ago

Verified 4550cb7e

Older