RefControl Flux Kontext – Reference Canny LoRA

📝 Short description

A LoRA for Flux Kontext Dev that fuses a reference image (left) with a canny edge map (right).
It preserves identity and style from the reference while following the edges and outlines from the control.

Trigger word: refcontrolcanny

Workflow

Demo video
hugging face

📊 Examples

ReferenceResult

📖 Extended description

This LoRA was primarily trained on humans and characters, but it works with objects and scenes as well.
The main purpose is to preserve identity — facial features, clothing, style — from the reference image, while using the canny edge map to define contours, composition, and layout.

⚙️ How to use

1. Concatenate two images side by side:

   • Left: reference image (person, character, or object).

   • Right: canny edges (line structure).

2. Add the trigger word refcontrolcanny in your prompt.

3. Adjust LoRA weight (recommended 0.8–1.0) depending on how strictly you want to follow edges.

✅ Example prompt

refcontrolcanny, change canny edges to photo with reference from left

🎯 What it does

• Preserves style and identity of the reference.

• Uses canny edges to control structure, outline, and composition.

• Produces consistent results across different poses and layouts.

⚡ Tips

• Works best if the canny map captures clean edges with minimal noise.

📌 Use cases

• Character consistency in illustrations and comics.

• Stylized redraws of objects with sharp outlines.

• Scene composition based on silhouettes.

• Rapid prototyping of layouts and storyboards.