huggingface/lighteval

Pull Requests Commits

NathanHB committed 59 days ago

2d869486

t puMerge branch 'nathan-remove-suites' of github.com:huggingface/lighteval into nathan-remove-suites

NathanHB committed 59 days ago

79ffe301

fix try to cache functool.partial function

NathanHB committed 59 days ago

f6d07b0c

Merge branch 'main' into nathan-remove-suites

NathanHB committed 59 days ago

Verified f5763edd

remove suites from serbian_eval.py (#1044)

S-Y-A-N committed 59 days ago

Verified d04e4f9b

Remove suite argument iin task config

NathanHB committed 59 days ago

4237e083

Merge remote-tracking branch 'origin/main' into nathan-remove-suites

NathanHB committed 59 days ago

04504223

Remove suite argument iin task config

NathanHB committed 59 days ago

ea7c5732

put lower bound on typer to use literal type (#1042)

NathanHB committed 65 days ago

Verified 566a7be3

remove suites and make fewshot optional (#1038)

NathanHB committed 66 days ago

Verified 31433cc9

run all hf providers with `:all` (#1039)

NathanHB committed 66 days ago

Verified 5b7ca62f

NathanHB committed 66 days ago

04b58e4a

NathanHB committed 66 days ago

f0d52cb1

NathanHB committed 66 days ago

8dff44cf

NathanHB committed 66 days ago

01bd5988

NathanHB committed 66 days ago

b6cea076

NathanHB committed 66 days ago

478cbd8a

NathanHB committed 66 days ago

b31d892d

fix docs to remove suites and fewshots

NathanHB committed 66 days ago

dec9edc6

remove suites and make fewshot optional

NathanHB committed 66 days ago

8477c2e3

fix `lighteval task inspect` command and tiny bench task (#992)

NathanHB committed 66 days ago

Verified b5cbd91a

add openai and inspect ai lower bound (#1035)

NathanHB committed 67 days ago

Verified 5aa09c5a

Update huggingface-cli login to use newer hf auth login (#1034)

xeophon committed 67 days ago

Verified 97303acf

Fix inspect reasoning effrot (#1033)

NathanHB committed 67 days ago

Verified 17e024bc

adds mmlu-pro (#1031)

NathanHB committed 67 days ago

Verified fa4860f9

Adds inspectai (#1022)

NathanHB committed 68 days ago

Verified 880bebef

Move tasks to individual files (#1016)

NathanHB committed 73 days ago

Verified 3cd31fd1

add translation literals indic (#1015)

rpm000 committed 80 days ago

Verified bf8b5471

Fixing naming for sample evals + adding reqs in aime24 (#989)

clefourrier committed 88 days ago

Verified 161d47cc

added fallback for incomplete configs for vlm models launched as llms (#828)

clefourrier committed 88 days ago

Verified e7d885c3

Older