PR #693 Async vllm - SemanticDiff

Async vllm #693

clefourrier merged 17 commits into main from clem_async_vllm

fix pyproject

5950eb0f

async

8be711f3

wip logprobs

b184f522

moved adapter/delta cleanup to avoid messing up the pipeline

bc577b50

cleaner shutdown

6e6c8e41

remove useless waits

50d9338e

now we manage async models at the pipeline level to have a single eve…

94ad7123

clefourrier requested a review from

NathanHB 262 days ago

clefourrier commented on 2025-04-29

lewtun commented on 2025-04-30

Update src/lighteval/models/vllm/vllm_model.py

d4c0ece2

removing dead code from PR

35a9fd53

updated docstring

d3dddb5d

clefourrier force pushed from 50acc39e to d3dddb5d 262 days ago

NathanHB approved these changes on 2025-04-30

lol you need to iterate on the generator to actually get it to generate

17969d47

remove dead code

c0c9e3a4

NathanHB added feature

clefourrier requested a review from

copilot-pull-request-reviewer 241 days ago

Merge branch 'main' into clem_async_vllm

0fdcd538

copilot-pull-request-reviewer commented on 2025-05-20

Update src/lighteval/models/vllm/vllm_model.py

be6e6eda

add warning about sampling for now

526eac56

mini fix

e7fb765a

Merge branch 'main' into clem_async_vllm

fd010439

clefourrier merged c4826ea9 into main 240 days ago

Reviewers

NathanHB

lewtun

copilot-pull-request-reviewer

Assignees

No one assigned

Labels

feature

Milestone

No milestone

lighteval Async vllm #693 Merged

Async vllm #693

lighteval
Async vllm
#693

Merged