diffusers
Add Helios-14B Video Generation Pipelines
#13208
Merged
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
109
Changes
View On
GitHub
Add Helios-14B Video Generation Pipelines
#13208
sayakpaul
merged 109 commits into
main
from
helios
[1/N] add helios
fc4a76ea
fix test
58f4603a
make fix-copies
280e3d87
change script path
6e0f23b2
fix cus script
3a04f67a
update docs
d693c046
fix documented check
44b04ddf
update links for docs and examples
50ab6a54
change default config
75809c61
small refactor
608f22ce
add test
31fb0cfd
Update src/diffusers/models/transformers/transformer_helios.py
f276d2ff
remove register_buffer for _scale_cache
061a4429
fix non-cuda devices error
ba05daf6
remove "handle the case when timestep is 2D"
bc3c5282
refactor HeliosMultiTermMemoryPatch and process_input_hidden_states
25080585
Update src/diffusers/pipelines/helios/pipeline_helios.py
96747b7a
Update src/diffusers/models/transformers/transformer_helios.py
37eb8f06
Update src/diffusers/pipelines/helios/pipeline_helios.py
439b76db
fix calculate_shift
bb2482a2
Update src/diffusers/pipelines/helios/pipeline_helios.py
36809980
rewritten `einops` in pure `torch`
9b4fbe78
fix: pass patch_size to apply_schedule_shift instead of hardcoding
cee81f81
remove the logics of 'vae_decode_type'
a7960fea
move some validation into check_inputs()
2683ca03
rename helios scheduler & merge all into one step()
2f72a8ca
add some details to doc
9413826e
move dmd step() logics from pipeline to scheduler
3bd8b865
change to Python 3.9+ style type
f5fe040d
fix NoneType error
1572cf06
refactor DMD scheduler's set_timestep
3b78e9b4
change rope related vars name
ba4d2033
fix stage2 sample
4bdcc0a3
fix dmd sample
2f7bfc56
Update src/diffusers/models/transformers/transformer_helios.py
90c355d0
Update src/diffusers/models/transformers/transformer_helios.py
8256941e
remove redundant & refactor norm_out
389c8302
Update src/diffusers/pipelines/helios/pipeline_helios.py
cbe52d5c
change "is_keep_x0" to "keep_first_frame"
20eeed6b
use a more intuitive name
38d50d21
refactor dynamic_time_shifting
378d8a94
remove use_dynamic_shifting args
eff865c4
remove usage of UniPCMultistepScheduler
866c55ce
separate stage2 sample to HeliosPyramidPipeline
54abd1c7
Update src/diffusers/models/transformers/transformer_helios.py
5a87c0c3
Update src/diffusers/models/transformers/transformer_helios.py
a573460a
Update src/diffusers/models/transformers/transformer_helios.py
94988e8b
Update src/diffusers/models/transformers/transformer_helios.py
0171b3f0
fix transformer
e4efddf8
use a more intuitive name
e1bb7442
update example script
7a1785ec
fix requirements
f811ce26
remove redudant attention mask
926b0d6a
fix
244d994d
optimize pipelines
c8f571da
make style .
50b565af
update TYPE_CHECKING
ca8cc7e9
change to use torch.split
7174e44a
derive memory patch sizes from patch_size multiples
dee65a54
remove some hardcoding
d431f54d
move some checks into check_inputs
c618877b
refactor sample_block_noise
f25d9272
optimize encoding chunks logits for v2v
42d30d00
use num_history_latent_frames = sum(history_sizes)
04a0342a
Update src/diffusers/pipelines/helios/pipeline_helios.py
971f08c3
remove redudant optimized_scale
f0f99c1b
Update src/diffusers/pipelines/helios/pipeline_helios_pyramid.py
4e418a42
use more descriptive name
70dbf19e
optimize history_latents
ae7817f1
remove not used "num_inference_steps"
dba5aac2
removed redudant "pyramid_num_stages"
6e4d0998
add "is_cfg_zero_star" and "is_distilled" to HeliosPyramidPipeline
63983a79
remove redudant
72b8811b
change example scripts name
5a64c6d6
change example scripts name
0b6a41e9
correct docs
11e1a9ad
update example
a88f60fe
update docs
c4fc87b1
Update tests/models/transformers/test_models_transformer_helios.py
7236203c
Update tests/models/transformers/test_models_transformer_helios.py
f460a89a
separate HeliosDMDScheduler
6cccfa73
fix numerical stability issue:
3bec7cfe
Update src/diffusers/schedulers/scheduling_helios_dmd.py
2800ac5f
Update src/diffusers/schedulers/scheduling_helios_dmd.py
e2c5ed37
Update src/diffusers/schedulers/scheduling_helios_dmd.py
0f2c8281
Update src/diffusers/schedulers/scheduling_helios_dmd.py
9601ee11
Update src/diffusers/schedulers/scheduling_helios_dmd.py
ae2a300b
remove redudant
d9515b94
small refactor
6c167c0c
remove use_interpolate_prompt logits
256544be
simplified model test
724d6b76
fallbackt to BaseModelTesterConfig
604247c1
remove _maybe_expand_t2v_lora_for_i2v
85738439
fix HeliosLoraLoaderMixin
7754a664
update docs
c3c7c975
use randn_tensor for test
5d9ed985
fix doc typo
8a63b0b7
optimize code
6098ebd3
mark torch.compile xfail
fa927e33
change paper name
d2118ef7
Make get_dummy_inputs deterministic using self.generator
95a04089
Set less strict threshold for test_save_load_float16 test for Helios …
339afe57
make style and make quality
6ead7ad5
Merge pull request #3 from huggingface/fix-helios-tests
9ae6306d
Preparation for merging
e53374d8
add torch.Generator
dcbb1823
sayakpaul
approved these changes on 2026-03-04
Fix HeliosPipelineOutput doc path
b9efc155
Fix Helios related (optimize docs & remove redudant) (#13210)
ab8127d6
Merge branch 'main' into helios
b16635e9
sayakpaul
merged
33f785b4
into main
29 days ago
sayakpaul
deleted the helios branch
29 days ago
Login to write a write a comment.
Login via GitHub
Reviewers
sayakpaul
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub