huggingface/lighteval

Pull Requests Commits

it's beautfil now :)

hynky1999 committed 350 days ago

83e00a99

hynky1999 committed 350 days ago

5802a5d9

fix tests + make it pretty

hynky1999 committed 350 days ago

93a06bd3

fix token metrics, update nanotron to lighteval main

Hynek Kydlicek committed 350 days ago

9ddd98f3

Hynek Kydlicek committed 351 days ago

ff19cc84

Only use relevant parts of nanotron config / make qa evals cheaper for probs

Hynek Kydlicek committed 351 days ago

60631af9

NouamaneTazi committed 351 days ago

aca8ff4c

anton-l committed 351 days ago

a9c31e80

anton-l committed 351 days ago

3c9296ee

NouamaneTazi committed 351 days ago

14e4b33d

NouamaneTazi committed 351 days ago

4d37aa32

NouamaneTazi committed 351 days ago

a4bff20b

anton-l committed 351 days ago

189e6443

nanotron updates

anton-l committed 351 days ago

b820bde8

nanotron updates

anton-l committed 351 days ago

38dcfd90

Adds multimodal support and MMMU pro (#675)

NathanHB committed 351 days ago

Verified 1607dc10

Added Flores 200 (#717)

clefourrier committed 352 days ago

Verified 63be4b0f

Update main_endpoint.py (#739)

clefourrier committed 352 days ago

Verified d18f11ab

fix litellm (#736)

NathanHB committed 355 days ago

Verified a5903760

Adds More Generative tasks (#694)

hynky1999 committed 355 days ago

Verified c6d1231f

Update README.md (#733)

clefourrier committed 355 days ago

Verified f684d359

Fix revision arg for vLLM tokenizer (#721)

lewtun committed 356 days ago

Verified d3da6b9b

Added support for quantization in vLLM backend (#690)

SulRash committed 359 days ago

Verified 04a74a28

Fix tqdm logging (#711)

Vectorrent committed 359 days ago

Verified f7392fa0

add livecodebench v6 (#712)

Cppowboy committed 359 days ago

Verified 7477de09

Patch 0.9.1 (#708)

NathanHB committed 364 days ago

Verified c8714563

Bump dev version0.9.1.dev0 (#705)

NathanHB committed 1 year ago

Verified 20cff959

better release notes (#704)

NathanHB committed 1 year ago

Verified 42c9c61a

fix typos (#702)

omahs committed 1 year ago

Verified 77efde06

Update README.md (#703)

NathanHB committed 1 year ago

Verified 9bf210c0

Older