huggingface/lighteval

Pull Requests Commits

Merge remote-tracking branch 'origin/main' into nathan-fix-vllm-from-file

NathanHB committed 331 days ago

87bdf845

allow max new token to be set in model config file

NathanHB committed 331 days ago

1a63efe3

Fix loading of vllm model from files (#533)

NathanHB committed 331 days ago

Verified d4e6f59b

NathanHB committed 335 days ago

952589e1

NathanHB committed 335 days ago

c75869bc

Merge branch 'nathan-fix-vllm-from-file' of github.com:huggingface/lighteval into nathan-fix-vllm-from-file

NathanHB committed 335 days ago

e75bb9e2

NathanHB committed 335 days ago

6ed696d8

Fix VLLM data-parallel (#541)

hynky1999 committed 335 days ago

Verified 86f62259

Bug fix extractive match (#540)

hynky1999 committed 335 days ago

Verified 3c9b0c9d

Update README.md (#539)

clefourrier committed 335 days ago

Verified f8405eee

Merge branch 'main' into nathan-fix-vllm-from-file

NathanHB committed 335 days ago

Verified 147211ce

clefourrier committed 335 days ago

Verified 441d7a4a

Make BLEURT lazy (#536)

hynky1999 committed 335 days ago

Verified 15bdbb81

Add GPQA for instruct models (#534)

lewtun committed 336 days ago

Verified 1ce7331f

Sync Math-verify (#535)

hynky1999 committed 336 days ago

Verified cb35beae

NathanHB committed 336 days ago

b4c2d778

Update src/lighteval/main_vllm.py

NathanHB committed 337 days ago

Verified 2802744a

NathanHB committed 337 days ago

8e21cd5c

NathanHB committed 337 days ago

a19e07c4

Add custom task (bac-fr) for evaluation of models in french (#518)

mdiazmel committed 338 days ago

Verified d7a1f112

Update french_evals.py

clefourrier committed 338 days ago

Verified be7da176

adds olympiad bench (#521)

NathanHB committed 341 days ago

Verified d332207b

Improve readability of the quick tour. (#501)

vxw3t8fhjsdkghvbdifuk committed 342 days ago

Verified 515bd01d

Implemented the possibility to load predictions from details files and continue evaluating from there (#488)

JoelNiklaus committed 343 days ago

Verified 94fc5a28

add missing inits (#524)

hynky1999 committed 343 days ago

Verified 48d0c284

Math extraction - allow only trying the first match, more customizable latex extraction + bump deps (#522)

hynky1999 committed 344 days ago

Verified 0e462692

Fixing commonsense qa: generative metrics, -1 gen length (#517)

clefourrier committed 346 days ago

Verified cb075a54

Fix Ukrainian indices and confirmation word (#516)

ayukh committed 346 days ago

Verified 499cc820

Fixed bug of import url_to_fs from fsspec (#507) (#512)

LoserCheems committed 348 days ago

Verified 4f381b35

Bump up the latex2sympy2_extended version + more tests (#510)

hynky1999 committed 349 days ago

Verified 0ab63d01

Older