PR #12456 Add Photon model and pipeline support

Add Photon model and pipeline support #12456

DavidBert wants to merge 41 commits into huggingface:main from Photoroom:photon

Add Photon model and pipeline support

fa8faeda

DavidBert commented on 2025-10-09

sayakpaul commented on 2025-10-09

just store the T5Gemma encoder

64ddfe52

enhance_vae_properties if vae is provided only

2947da0d

remove autocast for text encoder forwad

2575997e

BF16 example

27421cb4

conditioned CFG

1321ab4c

remove enhance vae and use vae.config directly when possible

32807a16

move PhotonAttnProcessor2_0 in transformer_photon

117e835a

remove einops dependency and now inherits from AttentionMixin

c86aed24

unify the structure of the forward block

5f6359f4

update doc

33961430

DavidBert force pushed from fafd7747 to 33961430 7 days ago

update doc

c78f4449

fix T5Gemma loading from hub

3f703955

fix timestep shift

d09ff3c1

sayakpaul commented on 2025-10-13

remove lora support from doc

91486cfc

Rename EmbedND for PhotoEmbedND

23dd1817

remove modulation dataclass

7efad332

put _attn_forward and _ffn_forward logic in PhotonBlock's forward

ef9c48d5

renam LastLayer for FinalLayer

178cc6ef

remove lora related code

924643aa

rename vae_spatial_compression_ratio for vae_scale_factor

faa00b93

support prompt_embeds in call

804dafd0

move xattention conditionning out computation out of the denoising loop

6f90e418

add negative prompts

59f4bda1

Use _import_structure for lazy loading

9ad57202

make quality + style

027dbd52

DavidBert force pushed from 52b585fe to 4aeccfea 2 days ago

add pipeline test + corresponding fixes

ff28f65f

DavidBert force pushed from 4aeccfea to ff28f65f 2 days ago

DavidBert requested a review from

sayakpaul 2 days ago

sayakpaul removed review request from

sayakpaul 2 days ago

sayakpaul requested a review from

dg845 2 days ago

sayakpaul requested a review from

stevhliu 2 days ago

utility function that determines the default resolution given the VAE

28b9cf2d

DavidBert requested a review from

sayakpaul 2 days ago

stevhliu commented on 2025-10-15

dg845 commented on 2025-10-16

Refactor PhotonAttention to match Flux pattern

b596595a

built-in RMSNorm

c522119f

Revert accidental .gitignore change

3239f265

parameter names match the standard diffusers conventions

b7bbb04a

renaming and remove unecessary attributes setting

83e03965

Update docs/source/en/api/pipelines/photon.md

582b64ad

Update docs/source/en/api/pipelines/photon.md

33926e05

Update docs/source/en/api/pipelines/photon.md

c9e0a206

Update docs/source/en/api/pipelines/photon.md

2877b60c

quantization example

ed874752

added doc to toctree

8aa65bae

DavidBert requested a review from

stevhliu 1 day ago

DavidBert requested a review from

dg845 1 day ago

Merge branch 'photon' of https://github.com/Photoroom/diffusers into …

fba7b330

stevhliu approved these changes on 2025-10-16

dg845 commented on 2025-10-17

use dispatch_attention_fn for multiple attention backend support

bef08450

DavidBert force pushed from 141337cd to bef08450 11 hours ago

dg845 commented on 2025-10-17

Reviewers

stevhliu

dg845

sayakpaul

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

diffusers Add Photon model and pipeline support #12456 Open

Add Photon model and pipeline support #12456

diffusers
Add Photon model and pipeline support
#12456

Open