huggingface/lighteval

Pull Requests Commits

Allow runtime spacy model downloads in the unit-test container

Nathan Habib committed 30 days ago

b9a1e605

Run unit tests and vLLM-main tests in prebuilt containers

Nathan Habib committed 30 days ago

8bfbade1

Regenerate SmolLM2 slow-test references for transformers 5 / vllm 0.30

Nathan Habib committed 30 days ago

1958f0d2

TEMP: tar regenerated references before upload

Nathan Habib committed 31 days ago

b079b43d

TEMP: regenerate slow-test references on the CI GPU

Nathan Habib committed 31 days ago

6b5908dc

Stop passing swap_space to vllm engine args

Nathan Habib committed 31 days ago

ae0d5a88

Use the namespaced openai/gsm8k repo in the slow-test custom task

Nathan Habib committed 31 days ago

dfd89f85

Mark the workspace as a safe git directory in the container

Nathan Habib committed 31 days ago

10124efe

fix(ci): harden workflow files flagged on #1403 (#1404)

hf-security-analysis[bot] committed 31 days ago

Verified cd04d40a

Run slow tests in the pytorch/pytorch CUDA container

Nathan Habib committed 31 days ago

1f2f8c6a

Fix DetailsLogger hashing with xxhash 4.0 (#1402)

NathanHB committed 31 days ago

Verified b634749d

Pin GitHub Actions to commit SHAs (#1394)

hf-security-analysis[bot] committed 36 days ago

Verified 6b9d193b

Scope GITHUB_TOKEN permissions per job (#1393)

hf-security-analysis[bot] committed 36 days ago

Verified 66f44bd7

chore: enable Dependabot weekly GitHub Actions bumps (#1246)

hf-dependantbot-rollout[bot] committed 42 days ago

Verified 6ba40c42

deps: bump nltk to 3.10.3 (#1380)

katsugtgz committed 50 days ago

Verified a8007c15

Store provider credentials as SecretStr in model configs (#1326)

NathanHB committed 79 days ago

Verified 932e1f2f

Only the main process writes the sample cache under data-parallel (#1271)

shipbehaves committed 122 days ago

Verified 64f4f5ae

add move_trailing_context_space flag for answer-only bits-per-byte (#1264)

kashif committed 128 days ago

Verified 95ad3bcb

fix rolling perplexity on the transformers backend (#1252)

kashif committed 142 days ago

Verified 78dbee22

Add multilingual task loading to vLLM (#1248)

JoelNiklaus committed 153 days ago

Verified 4d470292

Add LEXam legal exam benchmark to Swiss legal evals (#1243)

JoelNiklaus committed 153 days ago

Verified 9e427838

Add Pillow dependency (#1242)

JoelNiklaus committed 157 days ago

Verified 89f9395b

Legal NLP tasks on Swiss data (#1032)

rolshoven committed 162 days ago

Verified 8d29839e

[CI] Bump style-bot to hardened TOCTOU-fix SHA (#1233)

paulinebm committed 177 days ago

Verified 3fd15266

Fix/bump style bot sha (#1232)

paulinebm committed 177 days ago

Verified 3e75d1f7

[CI] Bump style-bot to hardened TOCTOU-fix SHA (#1230)

paulinebm committed 177 days ago

Verified ba82a295

Fix/bump style bot sha (#1229)

paulinebm committed 177 days ago

Verified 8aac2b78

Fix/bump style bot sha (#1228)

paulinebm committed 177 days ago

Verified a67c5576

Fix/bump style bot sha (#1227)

paulinebm committed 177 days ago

Verified 4ea6bce1

Fix/bump style bot sha (#1226)

paulinebm committed 177 days ago

Verified 2c7d1c2e

Older