Fix litellm connection pool limiting concurrent_requests #1190
sihyeonn
wants to merge
1 commit into
huggingface:main
from
sihyeonn:fix/litellm-concurrent-requests-pool-limit
Fix LiteLLM concurrent_requests exceeding 100 being capped by httpx d…
5cb71bc0
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub