diffusers
Add RequestScopedPipeline for safe concurrent inference, tokenizer lock and non-mutating retrieve_timesteps
#12328
Merged
Merged
Add RequestScopedPipeline for safe concurrent inference, tokenizer lock and non-mutating retrieve_timesteps #12328
sayakpaul
merged
38 commits into
huggingface:main
from
FredyRivera-dev:main
Basic implementation of request scheduling
bbfc5f4a
Basic editing in SD and Flux Pipelines
a308e3ed
Small Fix
4799b8ea
Fix
eda58477
Update for more pipelines
6b5e6be1
Add examples/server-async
df2933f7
Add examples/server-async
5c7c7c60
Merge branch 'huggingface:main' into main
e3cd3685
Merge branch 'huggingface:main' into main
09bf7964
Updated RequestScopedPipeline to handle a single tokenizer lock to av…
bd3e48a2
Fix
534710c8
Fix _TokenizerLockWrapper
4d7c64fe
Fix _TokenizerLockWrapper
18db9e6f
Delete _TokenizerLockWrapper
8f0efb1a
Fix tokenizer
b4790391
Merge branch 'huggingface:main' into main
e676b344
Update examples/server-async
0beab1cf
Fix server-async
840f0e4a
Merge branch 'huggingface:main' into main
bb41c2b6
Merge branch 'huggingface:main' into main
8a238c37
Optimizations in examples/server-async
ed617fe1
We keep the implementation simple in examples/server-async
b052d27f
Update examples/server-async/README.md
0f63f4d4
Update examples/server-async/README.md for changes to tokenizer locks…
a9666b11
The changes to the diffusers core have been undone and all logic is b…
06bb1364
Update examples/server-async/utils/*
a519915a
Fix BaseAsyncScheduler
7cfee776
Rollback in the core of the diffusers
e574f079
Merge branch 'huggingface:main' into main
05d7936e
Update examples/server-async/README.md
10496638
Complete rollback of diffusers core files
53166208
Simple implementation of an asynchronous server compatible with SD3-3…
0ecdfc3f
Update examples/server-async/README.md
ac5c9e6d
Fixed import errors in 'examples/server-async/serverasync.py'
72e02156
Flux Pipeline Discard
edd550ba
Update examples/server-async/README.md
6b693673
sayakpaul
approved these changes
on 2025-09-18
Merge branch 'main' into main
55985578
Apply style fixes
7c4f8834
Login to write a write a comment.
Login via GitHub