huggingface/lighteval

Pull Requests Commits

added params for Nouamane

clefourrier committed 205 days ago

79e6a6e0

put tuler in extedned tasks

NathanHB committed 210 days ago

57f29215

eliebak committed 226 days ago

461b8cbf

Merge branch 'main' into nathan-adds-helet

NathanHB committed 231 days ago

Verified 775705c5

Adds GSM-PLUS (#780)

NathanHB committed 231 days ago

Verified 9619194b

Bump dev version to 0.10.1.dev0 (#777)

NathanHB committed 236 days ago

Verified 9dc2e538

Async vllm (#693)

clefourrier committed 237 days ago

Verified c4826ea9

Bump ruff version (#774)

NathanHB committed 237 days ago

Verified c9c19e12

Nanotron, Multilingual tasks update + misc (#756)

hynky1999 committed 237 days ago

Verified 034c23b7

Update src/lighteval/models/vllm/vllm_model.py

NathanHB committed 238 days ago

Verified a1aee681

Update src/lighteval/tasks/default_prompts.py

NathanHB committed 238 days ago

Verified 248bb678

Merge branch 'main' into nathan-adds-helet

NathanHB committed 238 days ago

Verified a4394ad7

add dependencies to run after pip install (#767)

NathanHB committed 238 days ago

Verified 26517504

fix custom model example (#766)

NathanHB committed 238 days ago

Verified cce0bfca

Adds template for custom path saving results (#755)

NathanHB committed 238 days ago

Verified b6816a87

Allow for model kwargs when loading transformers from pretrained (#754)

NathanHB committed 238 days ago

Verified ce1dbb5e

Add MCQ support to Yourbench evaluation (#734)

alozowski committed 239 days ago

Verified 317cb504

Fix task metric type mismatch (#743)

Abelgurung committed 239 days ago

Verified 3bb8a50f

Adds multimodal support and MMMU pro (#675)

NathanHB committed 239 days ago

Verified 1607dc10

Added Flores 200 (#717)

clefourrier committed 240 days ago

Verified 63be4b0f

Update main_endpoint.py (#739)

clefourrier committed 240 days ago

Verified d18f11ab

use llama 3.2 no chat template

NathanHB committed 240 days ago

ed3d9076

fix litellm (#736)

NathanHB committed 242 days ago

Verified a5903760

Adds More Generative tasks (#694)

hynky1999 committed 243 days ago

Verified c6d1231f

Update README.md (#733)

clefourrier committed 243 days ago

Verified f684d359

Fix revision arg for vLLM tokenizer (#721)

lewtun committed 244 days ago

Verified d3da6b9b

NathanHB committed 244 days ago

9cafd755

NathanHB committed 244 days ago

0ef15e3f

NathanHB committed 244 days ago

65275d57

Added support for quantization in vLLM backend (#690)

SulRash committed 247 days ago

Verified 04a74a28

Older