PR #50359 Run Qwen4-Exp under continuous batching

Run Qwen4-Exp under continuous batching #50359

qgallouedec wants to merge 4 commits into cb-cache-layout from cb-indexed-attention

WIP indexed attention and Qwen4-Exp under the engine

b9bd4fd5

Merge branch 'cb-cache-layout' into cb-indexed-attention

8a373081

Run Qwen4-Exp under continuous batching: indexed attention and per-la…

d75219d9

Merge branch 'cb-cache-layout' into cb-indexed-attention

77d19134

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone