PR #850 Adds continuous batching

Adds continuous batching #850

clefourrier merged 17 commits into main from nathan-add-continious-batching

update for CB

41838c00

update

f7a3c2f3

push

c9b3467a

Merge branch 'main' into add-fast-generate

796ef5a0

c'est une honte, 0.2.... ruff....

a7e2751b

Merge branch 'add-fast-generate' of github.com:ArthurZucker/lighteval…

a1c4c00f

Merge branch 'main' into add-fast-generate

2b162f7f

Merge branch 'main' into add-fast-generate

101083e0

merge main

0f772b1a

fix model

df98d9be

fix model

1da56bdd

fix tests

fe6f24c4

fix slow tests

96466e4e

fix slow tests

8344961f

reset vllm model file config

7453c6f2

NathanHB requested a review from

copilot-pull-request-reviewer 339 days ago

copilot-pull-request-reviewer commented on 2025-07-08

clefourrier commented on 2025-07-16

Merge branch 'main' into nathan-add-continious-batching

84237ad4

clefourrier commented on 2025-08-01

Apply suggestions from code review

c179876e

clefourrier approved these changes on 2025-08-01

clefourrier merged 99bfd9f2 into main 315 days ago

NathanHB added feature

Reviewers

clefourrier

copilot-pull-request-reviewer

Assignees

No one assigned

Labels

feature

Milestone

No milestone

lighteval Adds continuous batching #850 Merged

Adds continuous batching #850

lighteval
Adds continuous batching
#850

Merged