diffusers
[modular] improve auto offload
#14304
Open

[modular] improve auto offload #14304

yiyixuxu wants to merge 18 commits into main from auto-offload-v2
yiyixuxu
yiyixuxu [modular] auto offload: tunable memory reserve, OOM retry, non-disrup…
780e112c
github-actions github-actions added size/L
github-actions github-actions added documentation
github-actions github-actions added tests
github-actions github-actions added modular-pipelines
HuggingFaceDocBuilderDev
yiyixuxu [modular] drop stale "dynamic mode" wording from the offload test com…
d4b4edd1
yiyixuxu Record what the auto-offloader does
34036c1f
yiyixuxu yiyixuxu marked this pull request as draft 100 days ago
Group the offload record table by decision
24460ae6
yiyixuxu Split display helpers into components_manager_utils; drop activation …
b755e08d
yiyixuxu Trim the offload record to consumed fields; hook reads available memo…
d2eb134a
yiyixuxu Make offload record events pure moves
09d5ec7c
yiyixuxu Drop OffloadRecord.summary(): the table is the record
d3c1e9d7
yiyixuxu Address review: discover entry points via an apply_forward_hook marker
b3604203
github-actions github-actions added utils
yiyixuxu Inline the OOM-retry helper into wrap_forward, its only caller
b313f79e
yiyixuxu Shrink ComponentsManager to its used surface
0e512ddf
yiyixuxu link issue to TODO
77615c07
yiyixuxu Address review: record at call sites, one device rule, fewer moving p…
ba14c2a4
yiyixuxu Overhaul the ComponentsManager test suite around real behavior
3f561491
yiyixuxu Add slow modular-pipeline integration tests with declared offload beh…
29bd6e06
yiyixuxu Restore ModularPipelineOffloadTesterMixin to its original form
e20dc87f
yiyixuxu add set_offload_strategy, Peak column in offload record, and offloadi…
0750134d
yiyixuxu
yiyixuxu commented on 2026-07-31
yiyixuxu
yiyixuxu commented on 2026-07-31
yiyixuxu yiyixuxu marked this pull request as ready for review 98 days ago
yiyixuxu make style
9a1c508e
yiyixuxu yiyixuxu requested a review from sayakpaul sayakpaul 98 days ago
yiyixuxu yiyixuxu requested a review from stevhliu stevhliu 98 days ago
stevhliu
stevhliu approved these changes on 2026-07-31
yiyixuxu yiyixuxu requested a review from DN6 DN6 98 days ago
DN6 DN6 added this to the Release 0.41.0 milestone 60 days ago
yiyixuxu yiyixuxu removed this from to the Release 0.41.0 milestone 35 days ago
yiyixuxu yiyixuxu added this to the Release 0.42.0 milestone 35 days ago
DN6
DN6 commented on 2026-10-07
sayakpaul sayakpaul removed this from to the Release 0.42.0 milestone 12 days ago
sayakpaul sayakpaul added this to the Release 0.43.0 milestone 12 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone