PR #6231 server : enable continuous batching by default

server : enable continuous batching by default #6231

ggerganov merged 1 commit into master from gg/enable-cb-default

server : enable continuous batching by default

31f2d03f

phymbert approved these changes on 2024-03-22

ggerganov merged 68e210b3 into master 1 year ago

ericcurtin deleted the gg/enable-cb-default branch 139 days ago

Reviewers

phymbert

Assignees

No one assigned

Labels

None yet

Milestone

No milestone