huggingface/lighteval

Pull Requests Commits

Hynek Kydlicek committed 160 days ago

9070f7d6

lighteval tokenization

Hynek Kydlicek committed 258 days ago

6f7b2555

fix token metrics, update nanotron to lighteval main

Hynek Kydlicek committed 258 days ago

9ddd98f3

Hynek Kydlicek committed 259 days ago

ff19cc84

Only use relevant parts of nanotron config / make qa evals cheaper for probs

Hynek Kydlicek committed 259 days ago

60631af9

NouamaneTazi committed 259 days ago

aca8ff4c

anton-l committed 259 days ago

a9c31e80

anton-l committed 259 days ago

3c9296ee

NouamaneTazi committed 259 days ago

14e4b33d

NouamaneTazi committed 259 days ago

4d37aa32

NouamaneTazi committed 259 days ago

a4bff20b

anton-l committed 259 days ago

189e6443

nanotron updates

anton-l committed 259 days ago

b820bde8

nanotron updates

anton-l committed 259 days ago

38dcfd90

Adds multimodal support and MMMU pro (#675)

NathanHB committed 259 days ago

Verified 1607dc10

Added Flores 200 (#717)

clefourrier committed 259 days ago

Verified 63be4b0f

Update main_endpoint.py (#739)

clefourrier committed 259 days ago

Verified d18f11ab

fix litellm (#736)

NathanHB committed 262 days ago

Verified a5903760

Adds More Generative tasks (#694)

hynky1999 committed 262 days ago

Verified c6d1231f

Update README.md (#733)

clefourrier committed 263 days ago

Verified f684d359

Fix revision arg for vLLM tokenizer (#721)

lewtun committed 263 days ago

Verified d3da6b9b

Added support for quantization in vLLM backend (#690)

SulRash committed 266 days ago

Verified 04a74a28

Fix tqdm logging (#711)

Vectorrent committed 266 days ago

Verified f7392fa0

add livecodebench v6 (#712)

Cppowboy committed 266 days ago

Verified 7477de09

Patch 0.9.1 (#708)

NathanHB committed 271 days ago

Verified c8714563

Bump dev version0.9.1.dev0 (#705)

NathanHB committed 272 days ago

Verified 20cff959

better release notes (#704)

NathanHB committed 272 days ago

Verified 42c9c61a

fix typos (#702)

omahs committed 272 days ago

Verified 77efde06

Update README.md (#703)

NathanHB committed 272 days ago

Verified 9bf210c0

[FIX] Inference providers (#701)

clefourrier committed 272 days ago

Verified 039debce

Older