End-to-end support for concurrent async models #2066
aron
merged
16 commits into
main
from
support-concurrent-predictions-in-child
yorickvP
commented
on 2024-11-26
cog build: validate python version is new enough to support concurrency
85039416
End-to-end support for concurrent async models
a81fa32a
Fix typing of CogConcurrencyConfig
54ed2ae3
Improve consistency of error messages for async predict method
62ab15d0
Re-word internal use of id to tag
1db221ea
fix test failure
6e560b95
Remove tasks from _predict_tasks in callback
0e115c94
Ensure SimpleStreamWrapper flushes on newlines
ee3dce50
Add deprecated `emit_metric()` helper to cog interface
bc0a81d5
Pass min_python into WorkerConfig tests
f3b8338d
Add AsyncConcatenateIterator to exported types
89e05271
Dynamically add self.log onto the Predictor instance
155e79e3
Do not include trailing newline in log implementation
25f1d862
linting
7c939a04
Ignore type issue
da89d959
Add missing is_async flag to emit_metrics commit
925ad8d8
Login to write a write a comment.
Login via GitHub