huggingface/lighteval

Pull Requests Commits

fix config for transformers

NathanHB committed 1 year ago

513f5301

NathanHB committed 1 year ago

65c5f9aa

NathanHB committed 1 year ago

e83fa689

NathanHB committed 1 year ago

34a0eaa5

Merge branch 'nathan-unify-modelargs' of github.com:huggingface/lighteval into nathan-unify-modelargs

NathanHB committed 1 year ago

33d97085

NathanHB committed 1 year ago

21e9b15b

NathanHB committed 1 year ago

f716a4b2

Merge branch 'main' into nathan-unify-modelargs

NathanHB committed 1 year ago

Verified 99200bf5

Parse string values for add_special_tokens in vLLM (#598)

eldarkurtic committed 1 year ago

Verified cc95ff27

update LCB prompt, fix newlines (#645)

rawsh committed 1 year ago

Verified d5efccf3

Lighteval math (#630)

HERIUN committed 1 year ago

Verified 2c3fdf36

Parse seed for vLLM (#602)

eldarkurtic committed 1 year ago

Verified 9ea7d6af

Update docs/source/_toctree.yml

NathanHB committed 1 year ago

Verified 3897e37a

fix slow tests by removing HF_TOKEN (#667)

NathanHB committed 1 year ago

Verified 582d927f

NathanHB committed 1 year ago

63d7e6b0

Align AIME pass@1 with literature (#666)

lewtun committed 1 year ago

Verified bb14995c

NathanHB committed 1 year ago

b4c83298

NathanHB committed 1 year ago

f4d8e826

NathanHB committed 1 year ago

a1a348a2

Merge branch 'nathan-unify-modelargs' of github.com:huggingface/lighteval into nathan-unify-modelargs

NathanHB committed 1 year ago

98ee7e71

NathanHB committed 1 year ago

6eb34a30

fix doc building

NathanHB committed 1 year ago

80572a82

Update docs/source/use-litellm-as-backend.mdx

NathanHB committed 1 year ago

Verified a27ba6a4

NathanHB committed 1 year ago

07d9ade1

Merge remote-tracking branch 'origin/main' into nathan-unify-modelargs

NathanHB committed 1 year ago

30ff7a75

NathanHB committed 1 year ago

acd11d41

Fix passing of generation config to main_accelerate (#659)

algo-home committed 1 year ago

Verified 632b69b8

add cot_prompt in vllm (#654)

HERIUN committed 1 year ago

Verified f8ebe644

add uzbek literals (#664)

murodbecks committed 1 year ago

Verified dceb39d6

Better CI and tests (#655)

NathanHB committed 1 year ago

Verified 840a6a31

Older