text-generation-inference
Changing the waiting_served_ratio default (stack more aggressively by default).
#1820

Merged

Changing the waiting_served_ratio default (stack more aggressively by default). #1820

Narsil merged 2 commits into main from changing_waiting_served_ratio_default

Changing the waiting_served_ratio default (stack more aggressively by

80c23bdd

Fix tests.

5373fc47

Narsil merged 007d5e54 into main 1 year ago

Narsil deleted the changing_waiting_served_ratio_default branch 1 year ago

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone