huggingface/lighteval

Pull Requests Commits

fix tests + make it pretty

hynky1999 committed 210 days ago

93a06bd3

fix token metrics, update nanotron to lighteval main

Hynek Kydlicek committed 210 days ago

9ddd98f3

Hynek Kydlicek committed 211 days ago

ff19cc84

Only use relevant parts of nanotron config / make qa evals cheaper for probs

Hynek Kydlicek committed 211 days ago

60631af9

NouamaneTazi committed 211 days ago

aca8ff4c

anton-l committed 211 days ago

a9c31e80

anton-l committed 211 days ago

3c9296ee

NouamaneTazi committed 211 days ago

14e4b33d

NouamaneTazi committed 211 days ago

4d37aa32

NouamaneTazi committed 211 days ago

a4bff20b

anton-l committed 211 days ago

189e6443

nanotron updates

anton-l committed 211 days ago

b820bde8

nanotron updates

anton-l committed 211 days ago

38dcfd90

Adds multimodal support and MMMU pro (#675)

NathanHB committed 211 days ago

Verified 1607dc10

Added Flores 200 (#717)

clefourrier committed 211 days ago

Verified 63be4b0f

Update main_endpoint.py (#739)

clefourrier committed 211 days ago

Verified d18f11ab

fix litellm (#736)

NathanHB committed 214 days ago

Verified a5903760

Adds More Generative tasks (#694)

hynky1999 committed 214 days ago

Verified c6d1231f

Update README.md (#733)

clefourrier committed 215 days ago

Verified f684d359

Fix revision arg for vLLM tokenizer (#721)

lewtun committed 215 days ago

Verified d3da6b9b

Added support for quantization in vLLM backend (#690)

SulRash committed 218 days ago

Verified 04a74a28

Fix tqdm logging (#711)

Vectorrent committed 218 days ago

Verified f7392fa0

add livecodebench v6 (#712)

Cppowboy committed 218 days ago

Verified 7477de09

Patch 0.9.1 (#708)

NathanHB committed 223 days ago

Verified c8714563

Bump dev version0.9.1.dev0 (#705)

NathanHB committed 224 days ago

Verified 20cff959

better release notes (#704)

NathanHB committed 224 days ago

Verified 42c9c61a

fix typos (#702)

omahs committed 224 days ago

Verified 77efde06

Update README.md (#703)

NathanHB committed 224 days ago

Verified 9bf210c0

[FIX] Inference providers (#701)

clefourrier committed 224 days ago

Verified 039debce

docs: improve consistency in punctuation of metric list (#605)

mariagrandury committed 224 days ago

Verified 40626e7a

Older