huggingface/lighteval

Pull Requests Commits

fixes from review

NathanHB committed 357 days ago

daad3437

fixes from review

NathanHB committed 357 days ago

a45f4996

fixes from review

NathanHB committed 357 days ago

efa8081e

Merge branch 'nathan-fix-897' of github.com:huggingface/lighteval into nathan-fix-897

NathanHB committed 357 days ago

9fcc81b0

fixes from review

NathanHB committed 357 days ago

47628f83

Apply suggestion from @Copilot

NathanHB committed 357 days ago

Verified a448eb38

fixes tests by adding model_configs where needed

NathanHB committed 361 days ago

7f07a260

removes mock accelerator from tests

NathanHB committed 361 days ago

0b6a1040

fixes from_model function and adds tests

NathanHB committed 361 days ago

2fef6ffa

Use lower bound for httpx (#920)

lewtun committed 362 days ago

Verified 76e5affe

making inspect working again (#887)

uralik committed 362 days ago

Verified af52de69

Trying to fix xet bug in test suite (#917)

clefourrier committed 364 days ago

Verified ecef2c66

Fix path in cache (#915)

clefourrier committed 364 days ago

Verified a88a5269

Adds the option to override the chat template (#914)

clefourrier committed 364 days ago

Verified 02bf1355

Update dep (#913)

clefourrier committed 364 days ago

Verified af211932

Caching samples PR (#909)

clefourrier committed 364 days ago

Verified df3a82d9

Fix vLLM doc (#912)

lewtun committed 364 days ago

Verified bfa60767

Fix log system prompt (#907)

clefourrier committed 1 year ago

Verified 7693a0fd

Moved some files (#905)

clefourrier committed 1 year ago

Verified d0cd4c91

Debug log likelihood evals which are broken for accelerate (#901)

clefourrier committed 1 year ago

Verified ea1dd184

Number of fixes to run accelerate evaluations (#898)

clefourrier committed 1 year ago

Verified 64f93b0e

Update transformers and vllm dependencies (#899)

clefourrier committed 1 year ago

Verified 865335e4

Added post processing (for reasoning tokens) to pipeline (#882)

clefourrier committed 1 year ago

Verified d7beacbc

fix path concatenation (#891)

clefourrier committed 1 year ago

Verified 994e9e07

Fix DP>1 & TP>1 evals with vllm (#841)

nmntz committed 1 year ago

Verified 24895519

Adds continuous batching (#850)

NathanHB committed 1 year ago

Verified 99bfd9f2

Fix typo: CONCURENT_CALLS -> CONCURRENT_CALLS (#884)

muupan committed 1 year ago

Verified 1404ba1d

Fixed typo in Python API documentation (#862)

dtung8068 committed 1 year ago

Verified 3b1126ad

Automatically infer whether to use a chat template or not instead of using kwargs (#885)

clefourrier committed 1 year ago

Verified e7d70902

Pin transforers version to fix broken test suite due to mismatch with vllm (#886)

clefourrier committed 1 year ago

Verified bc5e450a

Older