huggingface/lighteval

Pull Requests Commits

Hynek Kydlicek committed 295 days ago

9070f7d6

lighteval tokenization

Hynek Kydlicek committed 1 year ago

6f7b2555

fix token metrics, update nanotron to lighteval main

Hynek Kydlicek committed 1 year ago

9ddd98f3

Hynek Kydlicek committed 1 year ago

ff19cc84

Only use relevant parts of nanotron config / make qa evals cheaper for probs

Hynek Kydlicek committed 1 year ago

60631af9

NouamaneTazi committed 1 year ago

aca8ff4c

anton-l committed 1 year ago

a9c31e80

anton-l committed 1 year ago

3c9296ee

NouamaneTazi committed 1 year ago

14e4b33d

NouamaneTazi committed 1 year ago

4d37aa32

NouamaneTazi committed 1 year ago

a4bff20b

anton-l committed 1 year ago

189e6443

nanotron updates

anton-l committed 1 year ago

b820bde8

nanotron updates

anton-l committed 1 year ago

38dcfd90

Adds multimodal support and MMMU pro (#675)

NathanHB committed 1 year ago

Verified 1607dc10

Added Flores 200 (#717)

clefourrier committed 1 year ago

Verified 63be4b0f

Update main_endpoint.py (#739)

clefourrier committed 1 year ago

Verified d18f11ab

fix litellm (#736)

NathanHB committed 1 year ago

Verified a5903760

Adds More Generative tasks (#694)

hynky1999 committed 1 year ago

Verified c6d1231f

Update README.md (#733)

clefourrier committed 1 year ago

Verified f684d359

Fix revision arg for vLLM tokenizer (#721)

lewtun committed 1 year ago

Verified d3da6b9b

Added support for quantization in vLLM backend (#690)

SulRash committed 1 year ago

Verified 04a74a28

Fix tqdm logging (#711)

Vectorrent committed 1 year ago

Verified f7392fa0

add livecodebench v6 (#712)

Cppowboy committed 1 year ago

Verified 7477de09

Patch 0.9.1 (#708)

NathanHB committed 1 year ago

Verified c8714563

Bump dev version0.9.1.dev0 (#705)

NathanHB committed 1 year ago

Verified 20cff959

better release notes (#704)

NathanHB committed 1 year ago

Verified 42c9c61a

fix typos (#702)

omahs committed 1 year ago

Verified 77efde06

Update README.md (#703)

NathanHB committed 1 year ago

Verified 9bf210c0

[FIX] Inference providers (#701)

clefourrier committed 1 year ago

Verified 039debce

Older