huggingface/lighteval

Pull Requests Commits

Merge branch 'nathan-fix-753' of github.com:huggingface/lighteval into nathan-fix-753

NathanHB committed 271 days ago

78c496b6

apply suggestion

NathanHB committed 271 days ago

3be43be5

Update docs/source/saving-and-reading-results.mdx

NathanHB committed 271 days ago

Verified 98d5ad81

Update src/lighteval/logging/evaluation_tracker.py

NathanHB committed 272 days ago

Verified 4b04d82b

NathanHB committed 272 days ago

823347f3

NathanHB committed 272 days ago

571789a1

NathanHB committed 272 days ago

5f0bfe79

NathanHB committed 272 days ago

8fef1406

adds template for results saving path

NathanHB committed 272 days ago

7f62f03f

adds template for results saving path

NathanHB committed 272 days ago

4834f38b

Add MCQ support to Yourbench evaluation (#734)

alozowski committed 272 days ago

Verified 317cb504

Fix task metric type mismatch (#743)

Abelgurung committed 272 days ago

Verified 3bb8a50f

Adds multimodal support and MMMU pro (#675)

NathanHB committed 273 days ago

Verified 1607dc10

Added Flores 200 (#717)

clefourrier committed 273 days ago

Verified 63be4b0f

Update main_endpoint.py (#739)

clefourrier committed 273 days ago

Verified d18f11ab

fix litellm (#736)

NathanHB committed 276 days ago

Verified a5903760

Adds More Generative tasks (#694)

hynky1999 committed 276 days ago

Verified c6d1231f

Update README.md (#733)

clefourrier committed 277 days ago

Verified f684d359

Fix revision arg for vLLM tokenizer (#721)

lewtun committed 277 days ago

Verified d3da6b9b

Added support for quantization in vLLM backend (#690)

SulRash committed 280 days ago

Verified 04a74a28

Fix tqdm logging (#711)

Vectorrent committed 280 days ago

Verified f7392fa0

add livecodebench v6 (#712)

Cppowboy committed 280 days ago

Verified 7477de09

Patch 0.9.1 (#708)

NathanHB committed 285 days ago

Verified c8714563

Bump dev version0.9.1.dev0 (#705)

NathanHB committed 286 days ago

Verified 20cff959

better release notes (#704)

NathanHB committed 286 days ago

Verified 42c9c61a

fix typos (#702)

omahs committed 286 days ago

Verified 77efde06

Update README.md (#703)

NathanHB committed 286 days ago

Verified 9bf210c0

[FIX] Inference providers (#701)

clefourrier committed 286 days ago

Verified 039debce

docs: improve consistency in punctuation of metric list (#605)

mariagrandury committed 286 days ago

Verified 40626e7a

Update split iteration for DynamicBatchingDataset (#684)

qubvel committed 287 days ago

Verified d146f9b1

Older