diffusers

[Modular diffusers] more refactors

#11484

Merged

remove lora step and ip-adapter step -> no longer needed

rename pipeline -> components, data -> block_state

seperate controlnet step into input + denoise

refactor controlnet union

reefactor pipeline/block states so that it can dynamically accept kwargs

remove controlnet union denoise step, refactor & reuse controlnet denoisee step to accept aditional contrlnet kwargs

allow input_fields as input & update message

update input formating, consider kwarggs_type inputs with no name, e/g *_controlnet_kwargs

refactor the denoiseestep using LoopSequential! also add a new file for denoise step

change warning to debug

fix get_execusion blocks with loopsequential

fix auto denoise so all tests pass

update imports on guiders

remove modular reelated change from pipelines folder

made a modular_pipelines folder!

update __init__

add notes

add block state will also make sure modifed intermediates_inputs will be updated

move block mappings to its own file

make inputs truly immutable, remove the output logic in sequential pipeline, and update so that intermediates_outputs are only new variables

decode block, if skip decoding do not need to update latent

fix imports

fix import

fix more

remove the output step

make generator intermediates (it is mutable)

after_denoise -> decoders

add a to-do for guider cconfig mixin

refactor component spec: replace create/create_from_pretrained/create_from_config to just create and load method

refactor modular loader: 1. load only load (pretrained components only if not specific names) 2. update acceept create spec 3. move the updte _componeent_spec logic outside register_components to each method that create/update the component: __init__/update/load

update components manager

up

remove the duplicated components_manager file I forgot to deletee

fix import in block mapping

add a to-do for modular loader

prepare_latents_img2img pipeline method -> function, maybe do the same for others?

update input for loop blocks, do not need to include intermediate