PR #12456 Add Photon model and pipeline support

DavidBert commented on 2025-10-09

sayakpaul commented on 2025-10-09

DavidBert force pushed from fafd7747 to 33961430 64 days ago

sayakpaul commented on 2025-10-13

DavidBert force pushed from 52b585fe to 4aeccfea 59 days ago

DavidBert force pushed from 4aeccfea to ff28f65f 59 days ago

DavidBert requested a review from

sayakpaul 59 days ago

sayakpaul removed review request from

sayakpaul 59 days ago

sayakpaul requested a review from

dg845 59 days ago

sayakpaul requested a review from

stevhliu 59 days ago

DavidBert requested a review from

sayakpaul 59 days ago

stevhliu commented on 2025-10-15

dg845 commented on 2025-10-16

DavidBert requested a review from

stevhliu 58 days ago

DavidBert requested a review from

dg845 58 days ago

stevhliu approved these changes on 2025-10-16

dg845 commented on 2025-10-17

DavidBert force pushed from 141337cd to bef08450 57 days ago

dg845 commented on 2025-10-17

dg845 commented on 2025-10-20

DavidBert requested a review from

dg845 54 days ago

dg845 commented on 2025-10-20

dg845 approved these changes on 2025-10-21

dg845 commented on 2025-10-21

DavidBert force pushed from f105dff7 to 8de7b924 53 days ago

Add Photon model and pipeline support

c46a6491

just store the T5Gemma encoder

8e78a99c

enhance_vae_properties if vae is provided only

3aeada78

remove autocast for text encoder forwad

d5c32727

BF16 example

234c5e35

conditioned CFG

49528a4b

remove enhance vae and use vae.config directly when possible

0a4183cf

move PhotonAttnProcessor2_0 in transformer_photon

7f1199b0

remove einops dependency and now inherits from AttentionMixin

cabde58b

unify the structure of the forward block

bca1f7ce

update doc

cdfa6361

update doc

03a7df3a

fix T5Gemma loading from hub

c2488359

fix timestep shift

94f469a3

remove lora support from doc

ec2381e0

Rename EmbedND for PhotoEmbedND

b445016b

remove modulation dataclass

7ae1af97

put _attn_forward and _ffn_forward logic in PhotonBlock's forward

a8216f77

renam LastLayer for FinalLayer

73261c8e

remove lora related code

f8f45fdc

rename vae_spatial_compression_ratio for vae_scale_factor

e65de5fc

support prompt_embeds in call

b765031f

move xattention conditionning out computation out of the denoising loop

87cd6d26

add negative prompts

1b61bb26

Use _import_structure for lazy loading

9ca25fa3

make quality + style

98ed7477

update doc

cdfa6361

fix T5Gemma loading from hub

c2488359

remove lora support from doc

ec2381e0

Rename EmbedND for PhotoEmbedND

b445016b

put _attn_forward and _ffn_forward logic in PhotonBlock's forward

a8216f77

remove lora related code

f8f45fdc

rename vae_spatial_compression_ratio for vae_scale_factor

e65de5fc

support prompt_embeds in call

b765031f

Use _import_structure for lazy loading

9ca25fa3

built-in RMSNorm

cd780320

parameter names match the standard diffusers conventions

c92ee55b

Update docs/source/en/api/pipelines/photon.md

d219e8cf

Update docs/source/en/api/pipelines/photon.md

f7f516fa

Update docs/source/en/api/pipelines/photon.md

fb98a3ac

Update docs/source/en/api/pipelines/photon.md

f8913230

naming changes

23392b02

make fix copy

1f88313a

Update docs/source/en/api/pipelines/photon.md

167030cd

Add PhotonTransformer2DModel to TYPE_CHECKING imports

8b551d24

make fix-copies

7f6bb8a4

Use Tuple instead of tuple

42646066

restrict the version of transformers

756fe953

Update tests/pipelines/photon/test_pipeline_photon.py

4402b41c

Update tests/pipelines/photon/test_pipeline_photon.py

3b953ff0

change | for Optional

fda1f782

fix nits.

3e2d292e

DavidBert force pushed from 90e79de2 to 3e2d292e 53 days ago

use typing Dict

803d0d1e

sayakpaul merged cefc2cf8 into main 53 days ago

diffusers
Add Photon model and pipeline support
#12456

Merged

Add Photon model and pipeline support #12456

diffusers Add Photon model and pipeline support #12456 Merged

Add Photon model and pipeline support #12456

diffusers
Add Photon model and pipeline support
#12456

Merged