Very cool. Haven't tested it yet. Does it automatically detect the type of control image is input (ex. OpenPose, canny or depth)?
@tin2tin No, you must manually select the correct type that matches your specific input image.
How/where do you set that? In the ex. It's depth, but it could have been ex. Canny as well?
It's very complex, took me 5 days. I just finished integrating, you can refer my repo for code tomorrow but it's custom pipeline based and you can replace with diffusers pipeline.
How/where do you set that? In the ex. It's depth, but it could have been ex. Canny as well?
You don't have to specify that, it automatically determines it.
control_image can have Line, Pose, Depth.
Oh, I misunderstood the question. sry
I have updated the code, you can refer.
https://github.com/newgenai79/sd-diffuser-webui/blob/main/modules/text2image/tab_flex2_preview.py
Hi @victolee0 and thanks for your contribution, I really like what @jaretburkett and Flex wants to do but the current model is an Early access preview release
which means that we should probably wait for the full release.
Also I see two more issues with this PR:
Thanks for the feedback! I reached out to the original model author about this PR, but haven't received a response for about two weeks. Given that the priority should go to the model author and considering the early access status you mentioned, I think it would be best to close this PR for now.
If the original author decides they don't want to handle the integration in the future, I'd be happy to revisit this with the proper approach.
Thanks again for taking the time to review this!
Login to write a write a comment.
What does this PR do?
Fixes #11394 (issue)
Before submitting
documentation guidelines, and
here are tips on formatting docstrings.
Who can review?
@yiyixuxu @asomoza
Example code
Result:
Official Example: