When do you need Multi ControlNet Stable Diffusion?
When you want to apply certain art styles or color themes you like to your images, you can use Multi ControlNet Stable Diffusion.
How to change art styles with Multi ControlNet using Stable Diffusion Webui?
1. If you don’t have Stable Diffusion webui installed, go to install stable diffusion webui on Windows.
2. If you don’t have ControlNet extension installed, go to install ContolNet extension and download models for Stable Diffusion webui.
3. Go to huggingface site. Download t2iadapter models, e.g. t2iadapter_color_sd14v1.pth and t2iadapter_style_sd14v1.pth. Copy them to “extensions\sd-webui-controlnet\models” directory.
4. Run “webui-user.bat” to open Stable Diffusion webui in a browser at http://127.0.0.1:7860/.
5. Click Settings tab and Select ControlNet at left panel. Change the slide of Multi ControlNet: Max models amount to 2 or 3. Refresh your Stable Diffusion webui.
6. In txt2img tab, expand ControlNet area. Load a photo in “ControlNet Unit 0” tab. Check “Enabled” underneath. Change Control Type to be “Depth”.
5. Click “ControlNet Unit 1” tab, load an image with an art style in. Check “Enable” underneath.
6. In Preprocessor, select “t2ia_style_clipvision” from the dropdown. In Model, select “t2iadapter_tyle_sd14v1” from the dropdown.
7. Change Batch count to 4. Click Generate button.