Fix tail latency #2016
withinboredom
wants to merge
16 commits into
main
from
fix/latency
dunglas
commented
on 2025-11-22
AlliBalliBaba
commented
on 2025-11-22
AlliBalliBaba
commented
on 2025-11-22
AlliBalliBaba
commented
on 2025-11-23
fix latency
36ff408b
no rejection needed here, I dont think
8a0db868
we do not want to use the request context
294b8263
handle max wait time differently since we do not need to use the spec…
0f2b0d39
handle timeouts and scaling
5600586e
handle autoscaling better
b747c141
add back commented debug
91ad29b6
use the same semaphore approach for workers as well
1bcef8e8
ensure metrics dequeue workers
8eab4b72
move logic to a central place
34ca35dc
add a fast path when there is no contention
cedfa408
add back worker fast path
61b475e6
Use sync.Pool to remove channel contention (#2025)
9822b384
handle transitions when thread is still in pool
41771756
address feedback
c2124e80
revert usage of context
0a56469f
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub