Style Reference
Style Reference lets you upload a reference image for ComfyUI txt2img, img2img or inpainting with a supported model family. Colors, textures, and composition are influenced without replacing the text prompt. The implementation selects the correct technique for the active model family automatically.
This is separate from Anima's RFInversion Style Transfer panel, Anima ReStyler in Image Edit mode, and NovelAI's model-specific Vibe Transfer/Precise Reference. See the wiki comparison.
#Supported model families
| Family | Technique | Required custom nodes |
|---|---|---|
| Flux.1 (flux1d, flux1s, flux1krea) | Flux Redux | None (core ComfyUI) |
| SD1.5 (sd15) | IP-Adapter Plus | ComfyUI_IPAdapter_plus |
| SDXL, Illustrious, Pony (sdxl, illustrious, pony) | IP-Adapter Plus | ComfyUI_IPAdapter_plus |
| Anima (anima) | Anima Reference Adapter v2 or SnapRef (character reference), or Art style (style only) | ComfyUI-Anima-Ref-Adapter or SnapRef; Art style is bundled with MooshieUI |
| All other families | Not supported | -- |
Unsupported families show an explanatory hint in the panel. Generation with style reference enabled on an unsupported family is blocked at the template validation stage with a clear error message.
#Required model files
#Flux.1 (Flux Redux)
Place files in the paths shown, relative to your ComfyUI root.
models/style_models/
flux1-redux-dev.safetensorsGated on Hugging Face. Accept the license at https://huggingface.co/black-forest-labs/FLUX.1-Redux-dev and download the file from that page. Cannot be downloaded directly without accepting the license.
models/clip_vision/
sigclip_vision_patch14_384.safetensorsDownload from Comfy-Org: https://huggingface.co/Comfy-Org/sigclip_vision_384/resolve/main/sigclip_vision_patch14_384.safetensors
#SD1.5 (IP-Adapter Plus)
models/ipadapter/
ip-adapter-plus_sd15.safetensorsDownload from h94/IP-Adapter: https://huggingface.co/h94/IP-Adapter/resolve/main/models/ip-adapter-plus_sd15.safetensors
models/clip_vision/
CLIP-ViT-H-14-laion2B-s32B-b79K.safetensorsDownload from Comfy-Org (already named the way the ComfyUI IP-Adapter loader expects): https://huggingface.co/Comfy-Org/CLIP-ViT-H-14-laion2B-s32B-b79K_repackaged/resolve/main/split_files/clip_vision/CLIP-ViT-H-14-laion2B-s32B-b79K.safetensors
#SDXL / Illustrious / Pony (IP-Adapter Plus)
models/ipadapter/
ip-adapter-plus_sdxl_vit-h.safetensorsDownload from h94/IP-Adapter (sdxl_models folder): https://huggingface.co/h94/IP-Adapter/resolve/main/sdxl_models/ip-adapter-plus_sdxl_vit-h.safetensors
models/clip_vision/
CLIP-ViT-H-14-laion2B-s32B-b79K.safetensors(same file as SD1.5 above)
#Anima (Anima Reference Adapter v2)
models/loras/
anima_ref_adapter_v2_r64.safetensors(183 MB) The panel has a download button (pinned Hugging Face revision, SHA-256 checked). If it is missing, the node downloads it from https://huggingface.co/ElectronGirl/anima-ref-adapter on the first run. The weights use the CircleStone Non-Commercial License, like Anima itself.
The node pack (https://github.com/ElectronGirl/ComfyUI-Anima-Ref-Adapter, Apache-2.0) is pinned to one commit and installed at ComfyUI launch with the other Anima packs.
Unlike the other families, this is a character reference: the reference keeps
who is drawn (hair, eyes, outfit and much of the art style) and the prompt
gives pose, place and framing. Write a scene-only prompt with no character
name or outfit tags. For two characters, add a second image (stitched to the
right of the first), say in the prompt who is on the left and who is on the
right, use 2girls or 1boy, 1girl instead of solo, and pick a landscape
size.
Settings: Reference guidance (ref_guidance, default 4.5; 1 skips the extra
model call per step), Colour correction (apg, rescale, none) and End
(ref_end, about 0.6 is faster with nearly the same image). Anima TeaCache is
switched off while it is on, and it cannot be combined with Anima Style
Transfer.
#Anima (SnapRef)
Select SnapRef in the Anima Style Reference panel. The panel can download
the pinned v1a or v2a adapter weights into ComfyUI's models/loras/ directory;
it also lists compatible installed weights. When no adapter has been selected,
v2 is preferred if installed. Managed ComfyUI installs the pinned SnapRef node
at launch. For a remote ComfyUI, install or update
SnapRef by placing its
comfyui_nodes/snapref directory in custom_nodes/snapref, then restart
ComfyUI. Its SnapRefSimple node must support eight reference inputs.
Add one to eight images of the same character. Each image has a strength from 0 to 2 (default 1). Choose Character & Style or Character mode, and adjust fidelity from 0 to 1 (default 1). SnapRef works with txt2img, img2img and inpainting. Like the Anima Reference Adapter, it cannot be combined with Anima Style Transfer, and Anima TeaCache is disabled while it is active.
#Anima (Art style)
Select Art style in the Anima Style Reference panel to take a picture's
palette, shading and texture without its subject or characters. It needs no
weights and no extra download: the MooshieAnimaArtStyle node ships in the
mooshie-nodes package. It is the training-free method from
BetaDoggo/SwarmUI-BrokeAnimaStyleReference
(Apache-2.0, vendored as comfyui-nodes/anima_art_style.py with its licence
next to it). At every step the style picture is noised to the current noise
level and run through the model with a neutral caption, and after every
transformer block each channel of the generated image moves part of the way
towards the picture's mean and standard deviation (AdaIN inside the DiT).
- Style match (0 to 1, default 0.6): how far the statistics move. Near 1 the image falls apart.
- Keep my composition (default on): the first quarter of the steps run without the picture, so the layout comes from the prompt. Off gives a stronger style with a layout that drifts towards the picture's.
- Picture size (0.5 to 4 megapixels, default 1): the picture is shrunk to this area first, never enlarged. About the generated image's own size works best.
Describe the whole image in the prompt as usual. It costs one extra model pass
per step on the positive prompt, works with txt2img, img2img and inpainting,
and like the other Anima methods it turns Anima TeaCache off and cannot be
combined with Anima Style Transfer. The method's author has mostly tested it
on Anima turbo. For a remote ComfyUI, install the MooshieUI nodes with
comfyui-nodes/install.sh.
#Using the panel
- Open the Style Reference section in the Generation page sidebar.
- Enable the toggle.
- Drop or browse to a style reference image.
- Adjust Strength (0.0 to 1.0; 0.6 is a good starting point).
- Choose a weight type:
- Flux Redux: multiply (default), attn_bias, average
- IP-Adapter: linear (balanced), style transfer (emphasizes style over composition), composition (emphasizes composition), strong style transfer
- For IP-Adapter only: adjust Start and End to control which fraction of sampling steps the style reference influences.
- Generate as normal.
If IP-Adapter Plus custom nodes are not installed, the panel shows an Install button that clones the pack from GitHub and installs its pip dependencies. The custom nodes are only needed for SD1.5 and SDXL; Flux.1 uses built-in ComfyUI nodes.
#Implementation notes
- Workflow templates:
src-tauri/src/templates/style_ref.rs - Generation params:
style_ref_enabled,style_ref_image,style_ref_strength,style_ref_weight_type,style_ref_start,style_ref_end; Anima addsstyle_ref_image_2,anima_ref_guidanceandanima_ref_correction; SnapRef usesanima_ref_method,snapref_adapter,snapref_mode,snapref_fidelity, andsnapref_references; Art style usesanima_ref_method=art_style,anima_art_style_match,anima_art_style_restyleandanima_art_style_megapixels. - IP-Adapter lazy install follows the optional-node installation pattern:
verified by checking for the
IPAdapterUnifiedLoaderclass in the ComfyUI object info endpoint. - Model categories
style_models,ipadapter, andclip_visionare registered incategory_subdirs()insrc-tauri/src/commands/api.rs.