Add thread-safe wrappers for components in pipeline (examples/server-async/utils/requestscopedpipeline.py) #12515
Basic implementation of request scheduling
bbfc5f4a
Basic editing in SD and Flux Pipelines
a308e3ed
Small Fix
4799b8ea
Fix
eda58477
Update for more pipelines
6b5e6be1
Add examples/server-async
df2933f7
Add examples/server-async
5c7c7c60
Merge branch 'huggingface:main' into main
e3cd3685
Merge branch 'huggingface:main' into main
09bf7964
Updated RequestScopedPipeline to handle a single tokenizer lock to av…
bd3e48a2
Fix
534710c8
Fix _TokenizerLockWrapper
4d7c64fe
Fix _TokenizerLockWrapper
18db9e6f
Delete _TokenizerLockWrapper
8f0efb1a
Fix tokenizer
b4790391
Merge branch 'huggingface:main' into main
e676b344
Update examples/server-async
0beab1cf
Fix server-async
840f0e4a
Merge branch 'huggingface:main' into main
bb41c2b6
Merge branch 'huggingface:main' into main
8a238c37
Optimizations in examples/server-async
ed617fe1
We keep the implementation simple in examples/server-async
b052d27f
Update examples/server-async/README.md
0f63f4d4
Update examples/server-async/README.md for changes to tokenizer locks…
a9666b11
The changes to the diffusers core have been undone and all logic is b…
06bb1364
Update examples/server-async/utils/*
a519915a
Fix BaseAsyncScheduler
7cfee776
Rollback in the core of the diffusers
e574f079
Merge branch 'huggingface:main' into main
05d7936e
Update examples/server-async/README.md
10496638
Complete rollback of diffusers core files
53166208
Simple implementation of an asynchronous server compatible with SD3-3…
0ecdfc3f
Update examples/server-async/README.md
ac5c9e6d
Fixed import errors in 'examples/server-async/serverasync.py'
72e02156
Flux Pipeline Discard
edd550ba
Update examples/server-async/README.md
6b693673
Merge branch 'main' into main
55985578
Apply style fixes
7c4f8834
Merge branch 'huggingface:main' into main
c91e6f47
Add thread-safe wrappers for components in pipeline
f2e9f024
FredyRivera-dev
changed the title Add thread-safe wrappers for components in pipeline Add thread-safe wrappers for components in pipeline (examples/server-async/utils/requestscopedpipeline.py) 148 days ago
Add wrappers.py
489da5d5
Merge branch 'main' into main
8072fba1
Apply style fixes
581847fa
Merge branch 'main' into main
7f01e69b
Merge branch 'huggingface:main' into main
b55179f9
Merge branch 'main' into main
bd1758fa
Merge branch 'main' into main
89f3c29a
Merge branch 'main' into main
abd5d1a4
yiyixuxu
approved these changes
on 2026-01-09
yiyixuxu
merged
2dc9d2af
into main 68 days ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub