text-generation-inference
feat(router): add max_batch_size
#1542
Merged
Overview
Commits
4
Changes
View On GitHub

feat(router): add max_batch_size #1542

Narsil merged 4 commits into main from feat/max_batch_size
OlivierDehaene
OlivierDehaene feat(router): add max_batch_size
faaa9dfe
OlivierDehaene update doc
9e042bd1
HuggingFaceDocBuilderDev
OlivierDehaene use max_size in the batch task
2af011a1
OlivierDehaene my b
55e29c95
dacorvo
dacorvo approved these changes on 2024-02-08
Narsil
Narsil approved these changes on 2024-02-08
Narsil Narsil merged 53214633 into main 1 year ago
Narsil Narsil deleted the feat/max_batch_size branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum