PR #40599 feat: support request cancellation

feat: support request cancellation #40599

McPatate merged 5 commits into main from feat/support_request_cancellation

McPatate requested a review from

gante 1 year ago

McPatate requested a review from

LysandreJik 1 year ago

McPatate requested a review from

ArthurZucker 1 year ago

McPatate requested a review from

remi-or 1 year ago

LysandreJik changed the base branch from main to fix/continuous_batching_serve 1 year ago

LysandreJik commented on 2025-09-02

Base automatically changed from fix/continuous_batching_serve to main 1 year ago

McPatate force pushed from a8d6c891 to b3578be0 1 year ago

McPatate force pushed from bf9b27c3 to 882b0b55 1 year ago

McPatate force pushed from b9836e11 to f34d4c22 1 year ago

LysandreJik approved these changes on 2025-09-03

McPatate force pushed from fd8885a0 to 7ba48fec 1 year ago

McPatate force pushed from 7ba48fec to 9345f06e 1 year ago

feat: support request cancellation

7288b5d5

test: add cancellation test

78f220a1

refactor: use exisitng fn to check req cancellation

89bfd966

feat(cb): make cancellation thread safe

873db960

refactor(serve): update test to use `requests` instead of `httpx`

a0d9b884

McPatate force pushed from 83670d71 to a0d9b884 1 year ago

McPatate merged 9a6c6568 into main 1 year ago

McPatate deleted the feat/support_request_cancellation branch 1 year ago

Reviewers

LysandreJik

gante

ArthurZucker

remi-or

Assignees

No one assigned

Labels

None yet

Milestone

No milestone