diffusers
Add Helios-14B Video Generation Pipelines
#13208
Merged

Add Helios-14B Video Generation Pipelines #13208

sayakpaul merged 109 commits into main from helios
dg845
[1/N] add helios
fc4a76ea
fix test
58f4603a
make fix-copies
280e3d87
change script path
6e0f23b2
fix cus script
3a04f67a
update docs
d693c046
fix documented check
44b04ddf
update links for docs and examples
50ab6a54
change default config
75809c61
small refactor
608f22ce
add test
31fb0cfd
SHYuanBest Update src/diffusers/models/transformers/transformer_helios.py
f276d2ff
remove register_buffer for _scale_cache
061a4429
fix non-cuda devices error
ba05daf6
SHYuanBest remove "handle the case when timestep is 2D"
bc3c5282
SHYuanBest refactor HeliosMultiTermMemoryPatch and process_input_hidden_states
25080585
SHYuanBest Update src/diffusers/pipelines/helios/pipeline_helios.py
96747b7a
SHYuanBest Update src/diffusers/models/transformers/transformer_helios.py
37eb8f06
SHYuanBest Update src/diffusers/pipelines/helios/pipeline_helios.py
439b76db
SHYuanBest fix calculate_shift
bb2482a2
SHYuanBest Update src/diffusers/pipelines/helios/pipeline_helios.py
36809980
SHYuanBest rewritten `einops` in pure `torch`
9b4fbe78
SHYuanBest fix: pass patch_size to apply_schedule_shift instead of hardcoding
cee81f81
SHYuanBest remove the logics of 'vae_decode_type'
a7960fea
SHYuanBest move some validation into check_inputs()
2683ca03
SHYuanBest rename helios scheduler & merge all into one step()
2f72a8ca
SHYuanBest add some details to doc
9413826e
SHYuanBest move dmd step() logics from pipeline to scheduler
3bd8b865
SHYuanBest change to Python 3.9+ style type
f5fe040d
SHYuanBest fix NoneType error
1572cf06
SHYuanBest refactor DMD scheduler's set_timestep
3b78e9b4
SHYuanBest change rope related vars name
ba4d2033
SHYuanBest fix stage2 sample
4bdcc0a3
SHYuanBest fix dmd sample
2f7bfc56
SHYuanBest Update src/diffusers/models/transformers/transformer_helios.py
90c355d0
SHYuanBest Update src/diffusers/models/transformers/transformer_helios.py
8256941e
SHYuanBest remove redundant & refactor norm_out
389c8302
SHYuanBest Update src/diffusers/pipelines/helios/pipeline_helios.py
cbe52d5c
SHYuanBest change "is_keep_x0" to "keep_first_frame"
20eeed6b
SHYuanBest use a more intuitive name
38d50d21
SHYuanBest refactor dynamic_time_shifting
378d8a94
SHYuanBest remove use_dynamic_shifting args
eff865c4
SHYuanBest remove usage of UniPCMultistepScheduler
866c55ce
SHYuanBest separate stage2 sample to HeliosPyramidPipeline
54abd1c7
SHYuanBest Update src/diffusers/models/transformers/transformer_helios.py
5a87c0c3
SHYuanBest Update src/diffusers/models/transformers/transformer_helios.py
a573460a
SHYuanBest Update src/diffusers/models/transformers/transformer_helios.py
94988e8b
SHYuanBest Update src/diffusers/models/transformers/transformer_helios.py
0171b3f0
SHYuanBest fix transformer
e4efddf8
SHYuanBest use a more intuitive name
e1bb7442
SHYuanBest update example script
7a1785ec
fix requirements
f811ce26
remove redudant attention mask
926b0d6a
fix
244d994d
SHYuanBest optimize pipelines
c8f571da
SHYuanBest make style .
50b565af
SHYuanBest update TYPE_CHECKING
ca8cc7e9
SHYuanBest change to use torch.split
7174e44a
SHYuanBest derive memory patch sizes from patch_size multiples
dee65a54
SHYuanBest remove some hardcoding
d431f54d
SHYuanBest move some checks into check_inputs
c618877b
SHYuanBest refactor sample_block_noise
f25d9272
SHYuanBest optimize encoding chunks logits for v2v
42d30d00
SHYuanBest use num_history_latent_frames = sum(history_sizes)
04a0342a
SHYuanBest Update src/diffusers/pipelines/helios/pipeline_helios.py
971f08c3
SHYuanBest remove redudant optimized_scale
f0f99c1b
SHYuanBest Update src/diffusers/pipelines/helios/pipeline_helios_pyramid.py
4e418a42
SHYuanBest use more descriptive name
70dbf19e
SHYuanBest optimize history_latents
ae7817f1
SHYuanBest remove not used "num_inference_steps"
dba5aac2
SHYuanBest removed redudant "pyramid_num_stages"
6e4d0998
SHYuanBest add "is_cfg_zero_star" and "is_distilled" to HeliosPyramidPipeline
63983a79
SHYuanBest remove redudant
72b8811b
SHYuanBest change example scripts name
5a64c6d6
SHYuanBest change example scripts name
0b6a41e9
SHYuanBest correct docs
11e1a9ad
SHYuanBest update example
a88f60fe
SHYuanBest update docs
c4fc87b1
SHYuanBest Update tests/models/transformers/test_models_transformer_helios.py
7236203c
SHYuanBest Update tests/models/transformers/test_models_transformer_helios.py
f460a89a
separate HeliosDMDScheduler
6cccfa73
fix numerical stability issue:
3bec7cfe
SHYuanBest Update src/diffusers/schedulers/scheduling_helios_dmd.py
2800ac5f
SHYuanBest Update src/diffusers/schedulers/scheduling_helios_dmd.py
e2c5ed37
SHYuanBest Update src/diffusers/schedulers/scheduling_helios_dmd.py
0f2c8281
SHYuanBest Update src/diffusers/schedulers/scheduling_helios_dmd.py
9601ee11
SHYuanBest Update src/diffusers/schedulers/scheduling_helios_dmd.py
ae2a300b
remove redudant
d9515b94
small refactor
6c167c0c
remove use_interpolate_prompt logits
256544be
simplified model test
724d6b76
fallbackt to BaseModelTesterConfig
604247c1
remove _maybe_expand_t2v_lora_for_i2v
85738439
fix HeliosLoraLoaderMixin
7754a664
update docs
c3c7c975
use randn_tensor for test
5d9ed985
fix doc typo
8a63b0b7
optimize code
6098ebd3
mark torch.compile xfail
fa927e33
SHYuanBest change paper name
d2118ef7
dg845 Make get_dummy_inputs deterministic using self.generator
95a04089
dg845 Set less strict threshold for test_save_load_float16 test for Helios …
339afe57
dg845 make style and make quality
6ead7ad5
SHYuanBest Merge pull request #3 from huggingface/fix-helios-tests
9ae6306d
SHYuanBest Preparation for merging
e53374d8
SHYuanBest add torch.Generator
dcbb1823
sayakpaul
sayakpaul approved these changes on 2026-03-04
dg845 Fix HeliosPipelineOutput doc path
b9efc155
SHYuanBest
SHYuanBest Fix Helios related (optimize docs & remove redudant) (#13210)
ab8127d6
sayakpaul Merge branch 'main' into helios
b16635e9
sayakpaul
sayakpaul sayakpaul merged 33f785b4 into main 29 days ago
sayakpaul sayakpaul deleted the helios branch 29 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone