huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into nathan-fix-slow-tests

NathanHB committed 303 days ago

Verified 6d8c0998

NathanHB committed 303 days ago

54de5367

NathanHB committed 303 days ago

b20e93f5

NathanHB committed 303 days ago

579e299a

NathanHB committed 303 days ago

7094936a

NathanHB committed 303 days ago

702b4fba

NathanHB committed 306 days ago

050189b4

NathanHB committed 306 days ago

6aa1ffb1

NathanHB committed 306 days ago

5a54bac2

NathanHB committed 306 days ago

cf879ccd

NathanHB committed 306 days ago

232b948d

NathanHB committed 306 days ago

d474468a

NathanHB committed 306 days ago

32f07b97

NathanHB committed 306 days ago

b9dc5eca

NathanHB committed 306 days ago

f80c7a54

adds wandb loging of metrics (#676)

NathanHB committed 308 days ago

Verified 989f5f55

adds simpleqa (#680)

NathanHB committed 309 days ago

Verified 69931dfd

Add G-Pass@k Metric (#589)

jnanliu committed 309 days ago

Verified 89ba8807

change tokenizer to pad to 'longest' sequence, instead of 'max_length' (#669)

xgwang committed 309 days ago

Verified 88e3a3bc

change inference provider model config to inherit from ModelConfig base class (#678)

NathanHB committed 309 days ago

Verified 5120c586

hardcode configs to not make lighteval crash if lcb repo unavailable (#677)

NathanHB committed 309 days ago

Verified 8e84e1ba

Update quicktour command (#679)

qubvel committed 309 days ago

Verified 1ae06841

Improve test (#674)

qubvel committed 315 days ago

Verified 2ef1bc53

Update README.md

NathanHB committed 317 days ago

Verified 4ab19e80

Nathan unify modelargs (#609)

NathanHB committed 317 days ago

Verified feb8b706

Parse string values for add_special_tokens in vLLM (#598)

eldarkurtic committed 323 days ago

Verified cc95ff27

update LCB prompt, fix newlines (#645)

rawsh committed 323 days ago

Verified d5efccf3

Lighteval math (#630)

HERIUN committed 323 days ago

Verified 2c3fdf36

Parse seed for vLLM (#602)

eldarkurtic committed 323 days ago

Verified 9ea7d6af

fix slow tests by removing HF_TOKEN (#667)

NathanHB committed 323 days ago

Verified 582d927f

Older