Skip to content

[Feature] Enhanced ControlNet Support #1365

@JohnLoveJoy

Description

@JohnLoveJoy

Feature Summary

ControlNet is a neural network structure to control diffusion models by adding extra conditions.

Detailed Description

Image Image

ControlNet adds greater flexibility and precision to image generation. I noticed there’s a controlnet.cpp file in that repository, but I assume it may not be compatible with more recent models. Would it be possible to add support for ControlNet in newer models like Z Image Turbo or Anima, for example?

There are also "all-in-one" versions of Z Image that integrate ControlNet, would it be feasible to support at least those?

Source: https://huggingface.co/alibaba-pai/Z-Image-Turbo-Fun-Controlnet-Union-2.1

Alternatives you considered

No response

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions