diffusers
[Sana] Add Sana, including `SanaPipeline`, `SanaPAGPipeline`, `LinearAttentionProcessor`, `Flow-based DPM-sovler` and so on.
#9982
Merged
Overview
Commits
177
Changes
View On GitHub

[Sana] Add Sana, including `SanaPipeline`, `SanaPAGPipeline`, `LinearAttentionProcessor`, `Flow-based DPM-sovler` and so on. #9982

a-r-r-o-w merged 177 commits into huggingface:main from lawrence-cj:Sana
lawrence-cj
lawrence-cj first add a script for DC-AE;
6e616a9c
chenjy2003 Merge remote-tracking branch 'upstream/main' into DC-AE
d2e187a0
chenjy2003 DC-AE init
90e89393
chenjy2003 replace triton with custom implementation
825c975c
lawrence-cj 1. rename file and remove un-used codes;
3a44fa4c
chenjy2003 no longer rely on omegaconf and dataclass
55b2615d
chenjy2003 merge
6fb7fdb8
chenjy2003 Merge remote-tracking branch 'upstream/main' into DC-AE
c323e76b
chenjy2003 replace custom activation with diffuers activation
da7caa58
chenjy2003 remove dc_ae attention in attention_processor.py
fb6d92a4
chenjy2003 iinherit from ModelMixin
5e63a1ae
chenjy2003 inherit from ConfigMixin
72cce2b4
chenjy2003 dc-ae reduce to one file
8f9b4e43
chenjy2003 Merge remote-tracking branch 'upstream/main' into DC-AE
b7f68f9a
lawrence-cj Merge branch 'huggingface:main' into DC-AE
6d96b954
lawrence-cj Merge remote-tracking branch 'refs/remotes/origin/main' into DC-AE
3c3cc517
chenjy2003 update downsample and upsample
14486810
chenjy2003 merge
bf40fe85
chenjy2003 clean code
dd7718a2
chenjy2003 support DecoderOutput
19986a52
lawrence-cj Merge branch 'main' into DC-AE
3481e23c
lawrence-cj Merge branch 'main' into DC-AE
0e818df8
chenjy2003 remove get_same_padding and val2tuple
c6eb2336
chenjy2003 remove autocast and some assert
59de0a34
chenjy2003 update ResBlock
ea604a4d
chenjy2003 remove contents within super().__init__
80dce027
lawrence-cj Update src/diffusers/models/autoencoders/dc_ae.py
1752afdd
chenjy2003 remove opsequential
883bcf4f
chenjy2003 Merge branch 'DC-AE' of github.com:lawrence-cj/diffusers into DC-AE
25ae3890
chenjy2003 update other blocks to support the removal of build_norm
96e844b7
sayakpaul Merge branch 'main' into DC-AE
59b6e257
chenjy2003 remove build encoder/decoder project in/out
7ce9ff2f
chenjy2003 Merge branch 'DC-AE' of github.com:lawrence-cj/diffusers into DC-AE
30d6308d
chenjy2003 remove inheritance of RMSNorm2d from LayerNorm
cab56b16
chenjy2003 remove reset_parameters for RMSNorm2d
b42bb548
chenjy2003 remove device and dtype in RMSNorm2d __init__
2e04a996
lawrence-cj Update src/diffusers/models/autoencoders/dc_ae.py
b4f75f22
lawrence-cj Update src/diffusers/models/autoencoders/dc_ae.py
c82f828b
lawrence-cj Update src/diffusers/models/autoencoders/dc_ae.py
22ea5fd7
lawrence-cj
bghira
bghira
bghira commented on 2024-11-23
bghira
bghira commented on 2024-11-23
chenjy2003 remove op_list & build_block
4f5cbb43
chenjy2003 remove build_stage_main
2f6bbad8
stevhliu
stevhliu commented on 2024-11-26
lawrence-cj Merge branch 'main' into DC-AE
44957833
lawrence-cj
yiyixuxu
yiyixuxu commented on 2024-11-27
chenjy2003 change file name to autoencoder_dc
4d3c0266
chenjy2003 Merge branch 'DC-AE' of github.com:lawrence-cj/diffusers into DC-AE
e007057d
chenjy2003 move LiteMLA to attention.py
d3d9c840
lawrence-cj align with other vae decode output;
be9826c5
lawrence-cj add DC-AE into init files;
20da2012
a-r-r-o-w update
5ed50e98
lawrence-cj make quality && make style;
2d59056c
a-r-r-o-w quick push before dgx disappears again
c1c02a20
a-r-r-o-w update
1f8a3b3b
a-r-r-o-w make style
7b9d7e55
a-r-r-o-w update
bf6c211e
a-r-r-o-w update
a2ec5f81
a-r-r-o-w fix
f5876c5b
a-r-r-o-w refactor
44034a6f
a-r-r-o-w refactor
63792412
a-r-r-o-w refactor
77571a8f
a-r-r-o-w update
c4d0867c
lawrence-cj
a-r-r-o-w possibly change to nn.Linear
0bdb7eff
a-r-r-o-w refactor
54e933b3
a-r-r-o-w Merge branch 'main' into aryan-dcae
babc9f59
a-r-r-o-w make fix-copies
3d5faaff
a-r-r-o-w resolve conflicts & merge
65edfa5e
chenjy2003 replace vae with ae
ca3ac4de
chenjy2003 replace get_block_from_block_type to get_block
9ef7b597
chenjy2003 replace downsample_block_type from Conv to conv for consistency
074817cf
chenjy2003 add scaling factors
64de66a4
bghira
a-r-r-o-w incorporate changes for all checkpoints
0bda5c51
a-r-r-o-w make style
eb64d52c
a-r-r-o-w Merge branch 'main' into DC-AE
4a224ce9
a-r-r-o-w move mla to attention processor file; split qkv conv to linears
30c32383
a-r-r-o-w refactor
39a947ce
a-r-r-o-w Merge branch 'main' into DC-AE
68f817ac
a-r-r-o-w add tests
da834d51
bghira
hlky
lawrence-cj
hlky
lawrence-cj
lawrence-cj Merge branch 'main' into DC-AE
632ad3ba
bghira
a-r-r-o-w
bghira
lawrence-cj
bghira
bghira
lawrence-cj
bghira
lawrence-cj
lawrence-cj
bghira
lawrence-cj
hlky
hlky commented on 2024-12-04
bghira
lawrence-cj
bghira
bghira
a-r-r-o-w from original file loader
d6c748c7
a-r-r-o-w Merge branch 'main' into DC-AE
46eb5043
a-r-r-o-w add docs
31f9fc6c
bghira
a-r-r-o-w add standard autoencoder methods
6f29e2ab
sayakpaul
lawrence-cj
sayakpaul
lawrence-cj
yiyixuxu combine attention processor
b6e8fbac
a-r-r-o-w fix tests
f862bae8
a-r-r-o-w update
f9fce24a
a-r-r-o-w Merge branch 'main' into DC-AE
e5947451
chenjy2003 minor fix
3c0b1ca3
chenjy2003 minor fix
91057d40
lawrence-cj Merge branch 'main' into DC-AE
67aa715e
chenjy2003 minor fix & in/out shortcut rename
eda66e19
chenjy2003 minor fix
e3d33e6a
bghira
lawrence-cj
a-r-r-o-w Merge branch 'main' into DC-AE
cc97502c
a-r-r-o-w make style
2b370df4
chenjy2003 fix paper link
94355abe
a-r-r-o-w Merge branch 'main' into DC-AE
a191f070
a-r-r-o-w update docs
116c0495
a-r-r-o-w update single file loading
b6e0aba6
a-r-r-o-w Merge branch 'main' into DC-AE
ec4e84fd
a-r-r-o-w make style
dbae8f1d
stevhliu
stevhliu commented on 2024-12-06
a-r-r-o-w remove single file loading support; todo for DN6
042c2a0c
a-r-r-o-w Apply suggestions from code review
f2525b94
a-r-r-o-w Merge branch 'main' into DC-AE
d3d224c0
a-r-r-o-w add abstract
6122b84a
a-r-r-o-w
a-r-r-o-w
a-r-r-o-w commented on 2024-12-06
lawrence-cj lawrence-cj force pushed from 0b470549 to 593b6831 1 year ago
lawrence-cj 1. add DCAE into diffusers;
5f5a1709
lawrence-cj add DCAE_HF into diffusers;
b33da4de
lawrence-cj bug fixed;
0407d5ad
lawrence-cj add SanaPipeline, SanaTransformer2D into diffusers;
fdc95753
lawrence-cj add sanaLinearAttnProcessor2_0;
b90ec21f
lawrence-cj first update for SanaTransformer;
ebe8100e
lawrence-cj first update for SanaPipeline;
a34d173d
lawrence-cj first success run SanaPipeline;
d2a681cb
lawrence-cj model output finally match with original model with the same intput;
cb2e566b
lawrence-cj code update;
c238717d
lawrence-cj code update;
406abb4d
lawrence-cj add a flow dpm-solver scripts
cfc844e9
lawrence-cj 🎉[important update]
b4e8e637
lawrence-cj 🎉🔧[important update & fix huge bugs!!]
9b2b76a9
lawrence-cj remove prints;
48e45016
lawrence-cj add convert sana official checkpoint to diffusers format Safetensor.
5870055e
lawrence-cj Update src/diffusers/models/transformers/sana_transformer_2d.py
94edc7e7
lawrence-cj Update src/diffusers/models/transformers/sana_transformer_2d.py
64a64403
lawrence-cj Update src/diffusers/models/transformers/sana_transformer_2d.py
09cf898a
lawrence-cj Update src/diffusers/pipelines/pag/pipeline_pag_sana.py
219e0718
lawrence-cj Update src/diffusers/models/transformers/sana_transformer_2d.py
11f1c8de
lawrence-cj Update src/diffusers/models/transformers/sana_transformer_2d.py
12b5160b
lawrence-cj Update src/diffusers/pipelines/sana/pipeline_sana.py
7823c8f6
lawrence-cj Update src/diffusers/pipelines/sana/pipeline_sana.py
d3fd40a8
lawrence-cj update Sana for DC-AE's recent commit;
abee1eec
lawrence-cj make style && make quality
fe08f679
painebenjamin Add StableDiffusion3PAGImg2Img Pipeline + Fix SD3 Unconditional PAG (…
658e7e9a
lawrence-cj make the vae can be None in `__init__` of `SanaPipeline`
6ab2d8d0
lawrence-cj Update src/diffusers/models/transformers/sana_transformer_2d.py
7602dd55
lawrence-cj change the ae related code due to the latest update of DCAE branch;
5687ba19
lawrence-cj change the ae related code due to the latest update of DCAE branch;
b76493f9
lawrence-cj 1. change code based on AutoencoderDC;
297c0e78
lawrence-cj update for solving conversation.
e7c1a59e
lawrence-cj 1. fix bugs and run convert script success;
ad3935f9
lawrence-cj lawrence-cj force pushed from 7aa1aa98 to ad3935f9 1 year ago
lawrence-cj Merge remote-tracking branch 'refs/remotes/origin/main' into Sana
2bd4b9ca
lawrence-cj make style && make quality;
f0aa9b9d
lawrence-cj
lawrence-cj 1. remove un-unsed parameters in init;
7fa435fa
a-r-r-o-w Merge branch 'main' into Sana
bd13e369
bghira
a-r-r-o-w Merge branch 'main' into Sana
0f5d848c
a-r-r-o-w remove test file
0f9daecb
a-r-r-o-w refactor; add docs; add tests; update conversion script
f6985241
a-r-r-o-w make style
9d314263
a-r-r-o-w make fix-copies
0debade6
a-r-r-o-w a-r-r-o-w added close-to-merge
a-r-r-o-w
bghira
a-r-r-o-w refactor
2c828c22
a-r-r-o-w udpate pipelines
1ab6ab29
a-r-r-o-w pag tests and refactor
3ab6db76
a-r-r-o-w Merge branch 'main' into Sana
6a6b014b
lawrence-cj
a-r-r-o-w remove sana pag conversion script
2841ad28
a-r-r-o-w handle weight casting in conversion script
2a363a38
a-r-r-o-w
lawrence-cj
a-r-r-o-w
a-r-r-o-w a-r-r-o-w requested a review from yiyixuxu yiyixuxu 1 year ago
a-r-r-o-w a-r-r-o-w requested a review from hlky hlky 1 year ago
hlky
hlky approved these changes on 2024-12-12
lawrence-cj
lawrence-cj
lawrence-cj
a-r-r-o-w
a-r-r-o-w update conversion script
b0d5cf69
a-r-r-o-w Merge branch 'main' into Sana
d07d4959
lawrence-cj add a processor
34c5880e
lawrence-cj 1. add bf16 pth file path;
47cc0463
a-r-r-o-w fix fast \tests
de2c5f49
lawrence-cj change gemma-2-2b-it ckpt to a non-gated repo;
9f11659f
lawrence-cj fix the pth path bug in conversion script;
d3312cce
yiyixuxu
yiyixuxu commented on 2024-12-12
bghira
a-r-r-o-w change grad ckpt to original; make style
3c107e88
a-r-r-o-w
a-r-r-o-w Merge branch 'main' into Sana
f4134076
frutiemax92
a-r-r-o-w
frutiemax92
frutiemax92
lawrence-cj fix the complex_human_instruct bug and typo;
7c23fcc1
lawrence-cj
lawrence-cj Merge branch 'main' into Sana
9f10ce75
a-r-r-o-w remove dpmsolver flow scheduler
eee08ad5
a-r-r-o-w apply review suggestions
9e0ca0b7
a-r-r-o-w Merge branch 'main' into Sana
98b778ec
a-r-r-o-w
lawrence-cj
lawrence-cj change the `FlowMatchEulerDiscreteScheduler` to default `DPMSolverMul…
b3f72124
lawrence-cj fix the tokenizer.padding_side='right' bug;
b4af50d6
lawrence-cj
bghira
a-r-r-o-w
lawrence-cj
bghira
bghira
lawrence-cj
bghira
lawrence-cj
bghira
lawrence-cj
a-r-r-o-w Merge branch 'main' into Sana
c948a670
a-r-r-o-w update docs
b7837c05
a-r-r-o-w make fix-copies
5fb973c4
a-r-r-o-w
a-r-r-o-w fix imports
168a0af7
a-r-r-o-w fix docs
0d722cb0
HuggingFaceDocBuilderDev
hlky
hlky approved these changes on 2024-12-15
a-r-r-o-w add integration test
0d32ef58
a-r-r-o-w update docs
ea7878ca
a-r-r-o-w Merge branch 'main' into Sana
7b82bdc6
a-r-r-o-w update examples
884d29e8
a-r-r-o-w fix convert_model_output in schedulers
1bc15548
a-r-r-o-w
a-r-r-o-w approved these changes on 2024-12-15
a-r-r-o-w a-r-r-o-w added roadmap
a-r-r-o-w fix failing tests
cb212893
a-r-r-o-w a-r-r-o-w merged 5a196e3d into main 1 year ago
lawrence-cj
asahni-sc

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
close-to-merge roadmap
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum