huggingface/lighteval

Pull Requests Commits

it's beautfil now :)

hynky1999 committed 219 days ago

83e00a99

hynky1999 committed 219 days ago

5802a5d9

fix tests + make it pretty

hynky1999 committed 219 days ago

93a06bd3

fix token metrics, update nanotron to lighteval main

Hynek Kydlicek committed 219 days ago

9ddd98f3

Hynek Kydlicek committed 220 days ago

ff19cc84

Only use relevant parts of nanotron config / make qa evals cheaper for probs

Hynek Kydlicek committed 220 days ago

60631af9

NouamaneTazi committed 220 days ago

aca8ff4c

anton-l committed 220 days ago

a9c31e80

anton-l committed 220 days ago

3c9296ee

NouamaneTazi committed 220 days ago

14e4b33d

NouamaneTazi committed 220 days ago

4d37aa32

NouamaneTazi committed 220 days ago

a4bff20b

anton-l committed 220 days ago

189e6443

nanotron updates

anton-l committed 220 days ago

b820bde8

nanotron updates

anton-l committed 220 days ago

38dcfd90

Adds multimodal support and MMMU pro (#675)

NathanHB committed 220 days ago

Verified 1607dc10

Added Flores 200 (#717)

clefourrier committed 220 days ago

Verified 63be4b0f

Update main_endpoint.py (#739)

clefourrier committed 220 days ago

Verified d18f11ab

fix litellm (#736)

NathanHB committed 223 days ago

Verified a5903760

Adds More Generative tasks (#694)

hynky1999 committed 223 days ago

Verified c6d1231f

Update README.md (#733)

clefourrier committed 224 days ago

Verified f684d359

Fix revision arg for vLLM tokenizer (#721)

lewtun committed 224 days ago

Verified d3da6b9b

Added support for quantization in vLLM backend (#690)

SulRash committed 227 days ago

Verified 04a74a28

Fix tqdm logging (#711)

Vectorrent committed 227 days ago

Verified f7392fa0

add livecodebench v6 (#712)

Cppowboy committed 227 days ago

Verified 7477de09

Patch 0.9.1 (#708)

NathanHB committed 232 days ago

Verified c8714563

Bump dev version0.9.1.dev0 (#705)

NathanHB committed 233 days ago

Verified 20cff959

better release notes (#704)

NathanHB committed 233 days ago

Verified 42c9c61a

fix typos (#702)

omahs committed 233 days ago

Verified 77efde06

Update README.md (#703)

NathanHB committed 233 days ago

Verified 9bf210c0

Older