huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into clem_bnb_gptq_config_bug

clefourrier committed 1 year ago

Verified b15a0e47

Make evaluator invariant of input request type order (#215)

sadra-barikbin committed 1 year ago

Verified 951cd5b5

Merge branch 'main' into clem_bnb_gptq_config_bug

clefourrier committed 1 year ago

Verified 8fc0526e

Fix _init_max_length in base_model.py (#185)

gucci-j committed 1 year ago

Verified d43c9a32

launch lighteval using `lighteval --args` (#152)

NathanHB committed 1 year ago

Verified 4550cb7e

Merge branch 'main' into clem_bnb_gptq_config_bug

clefourrier committed 1 year ago

Verified efce6dbf

Add metrics as functions (#214)

clefourrier committed 1 year ago

Verified aaf7e8af

Merge branch 'main' into clem_bnb_gptq_config_bug

clefourrier committed 1 year ago

Verified f1826dee

should fix most inference endpoints issues of version config (#226)

clefourrier committed 1 year ago

Verified 733257ff

clefourrier committed 1 year ago

7858e823

clefourrier committed 1 year ago

e0e99fc5

clefourrier committed 1 year ago

5e63a5c9

Data split depending on eval params (#169)

clefourrier committed 1 year ago

Verified 66e6aaeb

Now only uses functions for prompt definition (#213)

clefourrier committed 1 year ago

Verified 4651531e

Use only dataclasses for task init (#212)

clefourrier committed 1 year ago

Verified 3aaec227

Fix a few typos in `metrics.py` (#218)

sadra-barikbin committed 1 year ago

Verified 3f909509

Homogeneize logging system (#150)

clefourrier committed 1 year ago

Verified ac57b78e

Adds a dummy/random model for baseline init (#220)

guipenedo committed 1 year ago

Verified 70f7fc6d

Fix the bug (#216)

sadra-barikbin committed 1 year ago

Verified 0528f297

[Bugfix] Avoid truncating the outputs based on string lengths (#201)

anton-l committed 1 year ago

Verified 60646959

Fix a few typos and do a tiny refactor (#187)

sadra-barikbin committed 1 year ago

Verified 843a0f8c

ADD GPT-4 as Judge (#206)

philschmid committed 1 year ago

Verified 0bceaee0

fix llm as judge warnings (#173)

NathanHB committed 1 year ago

Verified 3a808336

Updated tgi_model and added parameters for endpoint_model (#208)

shaltielshmid committed 1 year ago

Verified 7fcaab35

Download BERT scorer lazily (#190)

sadra-barikbin committed 1 year ago

Verified a3d1eea1

Mention HF_TOKEN in readme (#194)

Wauplin committed 1 year ago

Verified a98210fd

fix typos (#189)

kashif committed 1 year ago

Verified ad42e43b

Fix a few comment and docstring typos and a typehint (#177)

sadra-barikbin committed 1 year ago

Verified 061283f5

Fix AIMO (#186)

lewtun committed 1 year ago

Verified 981e10ac

[MATH] Fix generation for chat models & fix normalization for predictions (#163)

lewtun committed 1 year ago

Verified 60438f3c

Older