PR #41847 docs: add continuous batching page

docs: add continuous batching page #41847

McPatate merged 8 commits into main from docs/add_continuous_batching

McPatate requested a review from

ArthurZucker 115 days ago

McPatate requested a review from

remi-or 115 days ago

McPatate force pushed from ce9d16be to 58e19421 112 days ago

docs: add continuous batching page

b84acca1

docs(cb): add `generate_batch` example

35feaf36

docs(cb): add `opentelemtry` and `serving` section

25e06259

feat: add `TODO` note about opentelemetry dependency

3dbc3728

McPatate force pushed from db7d68a7 to 3dbc3728 112 days ago

docs(cb): add supported features

4ba9208a

docs(cb): add unsupported features

cb436b63

ArthurZucker commented on 2025-10-29

LysandreJik approved these changes on 2025-10-31

docs(cb): add `ContinuousBatchingManager` example

7023aebd

McPatate force pushed from 236f6307 to 7023aebd 105 days ago

docs(cb): x reference CB in optimizing inference

6a1a3bb4

McPatate marked this pull request as ready for review 105 days ago

McPatate merged 22e39dfb into main 105 days ago

McPatate deleted the docs/add_continuous_batching branch 105 days ago

Reviewers

LysandreJik

ArthurZucker

remi-or

Assignees

No one assigned

Labels

None yet

Milestone

No milestone