omnibus actual concurrency and major refactor #1530
technillogue
merged
96 commits into
async
from
syl/more-refactor
add concurrency to config
d1158d3e
this basically works!
c75606e0
more descriptive names for predict functions
a73fbcee
maybe pass through prediction id and try to make cancelation do both?
c7a775db
don't cancel from signal handler if a loop is running. expose worker …
c6b03aa7
move handle_event_stream to PredictionEventHandler
d5962735
make setup and canceling work
cd2d1153
drop some checks around cancelation
52ccf7bb
try out eager_predict_state_change
faed8c1e
keep track of multiple runner prediction tasks to make idempotent end…
9f0e8d01
fix idempotent tests
5ab395f1
fix remaining errors?
9c2f1bff
worker predict_generator shouldn't be eager
dc126b32
wip: make the stuff that handles events and sends webhooks etc async
d3e3337b
drop Runner._result
d637e564
drop comments
60fc4234
inline client code
27a25c18
get started
09790875
inline webhooks
ddf6fbd0
move clients into runner, switch to httpx, move create_event_handler …
14f7862a
add some comments
0cc4ec19
more notes
c8c8add1
rip out webhooks and most of files and put them in a new ClientManage…
65680832
move create_event_handler into PredictionEventHandler.__init__
bc717e09
fix one test
0cce2f9d
break out Path.validate into value_to_path and inline get_filename an…
624ceb6e
split out URLPath into BackwardsCompatibleDataURLTempFilePath and URL…
ea7fa78a
let's make DataURLTempFilePath also use convert and move value_to_pat…
412b3342
use httpx for downloading input urls and follow redirects
6e11f58a
take get_filename back out for tests
e70c42be
don't upload in http and delete cog/files.py
988d1d17
drop should_cancel
7ab2b63e
prediction->request
3ad1322b
split up predict/inner/prediction_ctx into enter_predict/exit_predict…
960ad748
bigish change: inline predict_and_handle_errors
419e8195
inline make_error_handler into setup
22dfb2f1
move runner.setup into runner.Runner.setup
0e1323af
add concurrency to config in go
a85cb38a
try explicitly using prediction_ctx __enter__ and __exit__
8f04cd9b
make runner setup more correct and marginally better
20a221fb
fix a few tests
d2150e21
notes
08b24581
wip ClientManager.convert
83413852
relax setup argument requirement to str
8bd2fbcb
glom worker into runner
974675f9
add logging message
4eefaba2
fix prediction retry and improve logging
a9a92f70
split out handle_event
9e27b97b
use CURL_CA_BUNDLE for file upload
edde23ec
clean up comments
7b9179b4
dubious upload fix
6996db3c
small fixes
a2003461
attempt to add context logging?
cb3a9dec
tweak names
d62eec33
fix error for predictionOutputType(multi=False)
5fbe634b
improve comments
252f3acb
fix lints
41b47f4f
skip worker and webhook tests since those were erroring on removed im…
c36221d5
upload in http instead of PredictionEventHandler. this makes tests pa…
3104fd00
format
6e8e1176
fix some new-style type signatures and drop 3.8 support
d2fbe71b
drop 3.7 in code
f7196531
add logging around webhook status to debug out-of-order webhooks
9356a966
loosen httpx version requirement
09988977
tweak names
8ec2a172
partially revert "upload in http instead of PredictionEventHandler. t…
9672103b
validate prediction response to raise errors, but return the unvalida…
de2a8284
notes
69cfeac8
expose concurrency in healthcheck
a27048cc
pass through verify to wrapped transport
065c483c
validate prediction response to raise errors, but return the unvalida…
de2a8284
notes
69cfeac8
expose concurrency in healthcheck
a27048cc
error in activity_info
c08f4d19
mediocre logging that works like print
86585cc8
COG_DISABLE_CANCEL to ignore cancelations
5e14ac90
COG_CONCURRENCY_OVERRIDE
405936cd
add ready probe as an http route
85adde5b
encode webhooks only after knowing they will be sent, and bail our of…
0f6d8d43
remove threading for the pipe by using AsyncConnection
d18e1300
drop race!
d1efaa50
type hints
93d58f5f
fix for older python
fc9bc479
optimize logging by binding structlog proxies
3d8f8c17
don't validate outputs
2a84cb7d
format and lint
3262996b
add AsyncConcatenateIterator
b2e27fac
apply a partial merge of async with comments and stuff
e01ee613
should_exit is not actually used by http
3ca8aec3
format
77b34438
replace requests with httpx and factor out clients (#1574)
2d9454d9
implement mp.Connection with async streams (#1640)
4ca470a3
AsyncConcatenateIterator
3e97cc87
fix type hint
9ca6a6ba
merge async
4cf75661
clean up
6b8ab71d
nickstenning
commented
on 2024-05-10
nickstenning
commented
on 2024-05-10
nickstenning
commented
on 2024-05-10
nickstenning
commented
on 2024-05-10
nickstenning
commented
on 2024-05-10
nickstenning
commented
on 2024-05-10
nickstenning
commented
on 2024-05-10
nickstenning
commented
on 2024-05-10
nickstenning
commented
on 2024-05-10
codecov
f69667f1
describe the remaining problems with this PR and add comments about c…
e7808347
add a test
40bdb541
Login to write a write a comment.
Login via GitHub