diffusers
Draft PR: [Flux ControlNet] Support Xlabs ControlNet in diffusers
#9385
Closed

Draft PR: [Flux ControlNet] Support Xlabs ControlNet in diffusers #9385

caoandong wants to merge 3 commits into huggingface:main from caoandong:main
caoandong
caoandong244 days ago

What does this PR do?

Fixes #9378

Before submitting

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.

Add xlab-compatible controlnet
09806997
Merge branch 'main' of https://github.com/huggingface/diffusers
cc174ef1
Add pipeline xlabs xflux controlnet
2ba45e26
Adenialzz
Adenialzz242 days ago

hi, is this finished ?

chuck-ma
chuck-ma233 days ago (edited 233 days ago)

It seems that it's a breaking change. How can we use the controlnet of diffusers normally while being compatible with the controlnet of xlab? @caoandong

chuck-ma
chuck-ma233 days ago (edited 233 days ago)👍 1😕 2

Can you share your full script including how to convert xlab controlnet and an example of how to run? I'm trying your branch, but I get an error in the following codes.

            if controlnet_block_samples is not None:
                #interval_control = len(self.transformer_blocks) / len(
                #    controlnet_block_samples
               # )
                #interval_control = int(np.ceil(interval_control))
                # print(interval_control, len(controlnet_block_samples))
                hidden_states = (
                    hidden_states
                    + controlnet_block_samples[index_block // interval_control]
                )

The length of controlnet_block_samples is 3. Index_block can be 17. But your branch just passes interval_control as default value 2. It will throw an error definitely. @sayakpaul @caoandong

github-actions
github-actions208 days ago

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

github-actions github-actions added stale
sayakpaul
sayakpaul208 days ago

Closing in favor of #9638. Thanks for your interest!

sayakpaul sayakpaul closed this 208 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone