huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into nathan-fix-slow-tests

NathanHB committed 352 days ago

Verified 6d8c0998

NathanHB committed 352 days ago

54de5367

NathanHB committed 352 days ago

b20e93f5

NathanHB committed 352 days ago

579e299a

NathanHB committed 352 days ago

7094936a

NathanHB committed 352 days ago

702b4fba

NathanHB committed 355 days ago

050189b4

NathanHB committed 355 days ago

6aa1ffb1

NathanHB committed 355 days ago

5a54bac2

NathanHB committed 355 days ago

cf879ccd

NathanHB committed 355 days ago

232b948d

NathanHB committed 355 days ago

d474468a

NathanHB committed 355 days ago

32f07b97

NathanHB committed 355 days ago

b9dc5eca

NathanHB committed 355 days ago

f80c7a54

adds wandb loging of metrics (#676)

NathanHB committed 357 days ago

Verified 989f5f55

adds simpleqa (#680)

NathanHB committed 358 days ago

Verified 69931dfd

Add G-Pass@k Metric (#589)

jnanliu committed 358 days ago

Verified 89ba8807

change tokenizer to pad to 'longest' sequence, instead of 'max_length' (#669)

xgwang committed 358 days ago

Verified 88e3a3bc

change inference provider model config to inherit from ModelConfig base class (#678)

NathanHB committed 358 days ago

Verified 5120c586

hardcode configs to not make lighteval crash if lcb repo unavailable (#677)

NathanHB committed 358 days ago

Verified 8e84e1ba

Update quicktour command (#679)

qubvel committed 358 days ago

Verified 1ae06841

Improve test (#674)

qubvel committed 364 days ago

Verified 2ef1bc53

Update README.md

NathanHB committed 1 year ago

Verified 4ab19e80

Nathan unify modelargs (#609)

NathanHB committed 1 year ago

Verified feb8b706

Parse string values for add_special_tokens in vLLM (#598)

eldarkurtic committed 1 year ago

Verified cc95ff27

update LCB prompt, fix newlines (#645)

rawsh committed 1 year ago

Verified d5efccf3

Lighteval math (#630)

HERIUN committed 1 year ago

Verified 2c3fdf36

Parse seed for vLLM (#602)

eldarkurtic committed 1 year ago

Verified 9ea7d6af

fix slow tests by removing HF_TOKEN (#667)

NathanHB committed 1 year ago

Verified 582d927f

Older