huggingface/lighteval

Pull Requests Commits

Merge branch 'main' into nathan-fix-slow-tests

NathanHB committed 239 days ago

Verified 6d8c0998

NathanHB committed 239 days ago

54de5367

NathanHB committed 239 days ago

b20e93f5

NathanHB committed 239 days ago

579e299a

NathanHB committed 239 days ago

7094936a

NathanHB committed 239 days ago

702b4fba

NathanHB committed 242 days ago

050189b4

NathanHB committed 242 days ago

6aa1ffb1

NathanHB committed 242 days ago

5a54bac2

NathanHB committed 242 days ago

cf879ccd

NathanHB committed 242 days ago

232b948d

NathanHB committed 242 days ago

d474468a

NathanHB committed 242 days ago

32f07b97

NathanHB committed 242 days ago

b9dc5eca

NathanHB committed 242 days ago

f80c7a54

adds wandb loging of metrics (#676)

NathanHB committed 244 days ago

Verified 989f5f55

adds simpleqa (#680)

NathanHB committed 245 days ago

Verified 69931dfd

Add G-Pass@k Metric (#589)

jnanliu committed 245 days ago

Verified 89ba8807

change tokenizer to pad to 'longest' sequence, instead of 'max_length' (#669)

xgwang committed 245 days ago

Verified 88e3a3bc

change inference provider model config to inherit from ModelConfig base class (#678)

NathanHB committed 245 days ago

Verified 5120c586

hardcode configs to not make lighteval crash if lcb repo unavailable (#677)

NathanHB committed 245 days ago

Verified 8e84e1ba

Update quicktour command (#679)

qubvel committed 245 days ago

Verified 1ae06841

Improve test (#674)

qubvel committed 251 days ago

Verified 2ef1bc53

Update README.md

NathanHB committed 253 days ago

Verified 4ab19e80

Nathan unify modelargs (#609)

NathanHB committed 253 days ago

Verified feb8b706

Parse string values for add_special_tokens in vLLM (#598)

eldarkurtic committed 259 days ago

Verified cc95ff27

update LCB prompt, fix newlines (#645)

rawsh committed 259 days ago

Verified d5efccf3

Lighteval math (#630)

HERIUN committed 259 days ago

Verified 2c3fdf36

Parse seed for vLLM (#602)

eldarkurtic committed 259 days ago

Verified 9ea7d6af

fix slow tests by removing HF_TOKEN (#667)

NathanHB committed 259 days ago

Verified 582d927f

Older