async release channel #1512
technillogue
wants to merge
55 commits into
main
from
async
run CI for this branch the same way as for main
0df9b82f
async runner (#1352)
2eb3b482
support async predict functions (#1350)
d5e6f731
create event loop before predictor setup (#1366)
8f3fe086
lints
ff754f3a
minimal async worker (#1410)
31123807
format
37922024
Mux prediction events (#1405)
ce189649
Scary temporary commit for a hemorrhaging-edge release
335f67b1
Revert "Scary temporary commit for a hemorrhaging-edge release"
1af5eda8
replace requests with httpx and factor out clients (#1574)
7ee96ba1
format
95386730
implement mp.Connection with async streams (#1640)
bb01c856
AsyncConcatenateIterator
12b0abe9
optimize webhook serialization and logging (#1651)
08f3780b
tweak names and style
c62cf676
omnibus actual concurrency and major refactor (#1530)
0ebfc547
fix test (#1669)
fb498be3
predict_time_share metric (#1643)
f44b67f0
function to emit metrics (#1649)
b35d1f7c
allow setting both max and target concurrency in cog.yaml (#1672)
e32f5cc5
predict_time_share needs to be set before sending the completed webho…
1728da7c
allow disabling time share metric with COG_DISABLE_TIME_SHARE_METRIC
07eabfd9
drop default_target (#1685)
07314465
Set VSCode default formatter to charliermarsh.ruff (#1547)
4e48c289
Update VSCode workspace settings (#1545)
fe0d2dbb
fix config schema
e07dc078
Backport `Secret` type to async branch (#1706)
8dc4890d
stick a %s on line 190 clients.py (#1707)
c5ad13b1
local upload server can be called cluster.local in addition to .inter…
6b6ac5f8
log traceback properly (#1734)
42c6617c
add batch size metric (#1750)
adf88944
Revert "should_exit is not actually used by http". It was being used …
b93f2334
fix ruff check
81187f4f
Poison model healthcheck on shutdown
a4b86cd5
Fix broken `make go-test` command
99a26d42
Add fixes for ruff issues (#1799)
8d834f06
Propagate trace context to webhook and upload requests
5d38ae7d
[async] Include prediction id upload request (#1788)
b9df82a3
patch cancel bug: immediately mark predictions as cancelled (#1798)
5464c438
syl/fix setup shutdown bug (#1819)
9f49b292
fix incorrect strutlog usage throwing an error when setup fails
acbb2836
move runner.terminate into runner.shutdown after waiting for predicti…
0976a05c
[async] Support URLFile in the upload_file function (#1987)
b29c93c3
Fix type annotations in Input
3edefe40
Validate url passed to URLFile conforms to HTTP protocol
05a13bfa
Support custom filename to be provided to URLFile (#1997)
3805e2e5
Add support for image/webp to mimetypes package (#2002)
12d5a4cf
Add .envrc for asdf
a60d1516
direnv: use `layout python` to automatically use venv (#1970)
b710b33e
Add dotenv_if_exists to .envrc
2dcdf643
Propagate the `name` attribute of URLFile across serializers (#2000)
9cb5f353
Provide User-Agent and Accept headers in URLFile requests (#2011)
426b1124
pin httpx to <0.28.0 (#2075)
9b75c82c
fix GHA
32c7408b
Reviewers
No reviews
Assignees
No one assigned
Labels
async
Milestone
No milestone
Login to write a write a comment.
Login via GitHub