huggingface/lighteval

Pull Requests Commits

Merge branch 'nathan-fix-753' of github.com:huggingface/lighteval into nathan-fix-753

NathanHB committed 215 days ago

78c496b6

apply suggestion

NathanHB committed 215 days ago

3be43be5

Update docs/source/saving-and-reading-results.mdx

NathanHB committed 215 days ago

Verified 98d5ad81

Update src/lighteval/logging/evaluation_tracker.py

NathanHB committed 215 days ago

Verified 4b04d82b

NathanHB committed 215 days ago

823347f3

NathanHB committed 215 days ago

571789a1

NathanHB committed 215 days ago

5f0bfe79

NathanHB committed 215 days ago

8fef1406

adds template for results saving path

NathanHB committed 215 days ago

7f62f03f

adds template for results saving path

NathanHB committed 215 days ago

4834f38b

Add MCQ support to Yourbench evaluation (#734)

alozowski committed 216 days ago

Verified 317cb504

Fix task metric type mismatch (#743)

Abelgurung committed 216 days ago

Verified 3bb8a50f

Adds multimodal support and MMMU pro (#675)

NathanHB committed 216 days ago

Verified 1607dc10

Added Flores 200 (#717)

clefourrier committed 217 days ago

Verified 63be4b0f

Update main_endpoint.py (#739)

clefourrier committed 217 days ago

Verified d18f11ab

fix litellm (#736)

NathanHB committed 219 days ago

Verified a5903760

Adds More Generative tasks (#694)

hynky1999 committed 219 days ago

Verified c6d1231f

Update README.md (#733)

clefourrier committed 220 days ago

Verified f684d359

Fix revision arg for vLLM tokenizer (#721)

lewtun committed 221 days ago

Verified d3da6b9b

Added support for quantization in vLLM backend (#690)

SulRash committed 224 days ago

Verified 04a74a28

Fix tqdm logging (#711)

Vectorrent committed 224 days ago

Verified f7392fa0

add livecodebench v6 (#712)

Cppowboy committed 224 days ago

Verified 7477de09

Patch 0.9.1 (#708)

NathanHB committed 229 days ago

Verified c8714563

Bump dev version0.9.1.dev0 (#705)

NathanHB committed 230 days ago

Verified 20cff959

better release notes (#704)

NathanHB committed 230 days ago

Verified 42c9c61a

fix typos (#702)

omahs committed 230 days ago

Verified 77efde06

Update README.md (#703)

NathanHB committed 230 days ago

Verified 9bf210c0

[FIX] Inference providers (#701)

clefourrier committed 230 days ago

Verified 039debce

docs: improve consistency in punctuation of metric list (#605)

mariagrandury committed 230 days ago

Verified 40626e7a

Update split iteration for DynamicBatchingDataset (#684)

qubvel committed 231 days ago

Verified d146f9b1

Older