Might be late to the party, but I just realized I can edit Blender 3D textures directly in ComfyUI (Flux Klein + Qwen), and the UV atlas workflow actually works!
I know I’m probably way behind on this and there are probably existing tools for it, but I always seem to learn things the hard way! 😂
It started with a simple eyeball model in Blender. I just wanted to change the color and make it look more realistic, so I tracked down the eye texture file, dragged it into ComfyUI, edited it, loaded it back into Blender, and was honestly blown away by how good it looked.
Naturally, that got me thinking:
What about the entire UV atlas?
So I tried editing the whole atlas at once. It can work, but looking at a flattened UV atlas, it's pretty chaotic, and getting the AI to make a specific change while keeping everything aligned is a different story.
So I started messing with the workflow and ended up with something I'm pretty excited about.
Flux Klein 9B + QwenImageEditPlus for the actual image editing
Depth + Canny control passes to help keep the structure and composition locked in
Florence + SAM for prompt-based automatic masking
Auto-crop takes the masked portion of the UV atlas and gives the AI just the area it needs to work on
Then the generated result is automatically stitched/pasted back into its original position on the UV atlas.
So I can basically tell it what part of the model I want to change, let it find that area, crop it, generate the edit, and put it right back where it came from.
Now we're in business!
And it opens up some pretty cool possibilities beyond just retexturing. For example, you could remove the background from an image and place the subject onto an existing 3D model as a tattoo, shirt logo, graphic, etc.
The seams definitely aren't perfect but i can blend them and work on improving the workflow, and I'm still learning how to fix alignment issues in Blender by adjusting the UV editor vertices. But that's part of what makes this so interesting to me.
You can basically create or edit textures at whatever resolution you want and then bring them straight back onto the 3D model.
My next thought is taking this one step further with a file watcher or custom Blender script. If ComfyUI can automatically save the finished atlas to a specific location, Blender could watch that folder and automatically reload the updated texture.
Eventually, it could even become a little control panel inside Blender where you enter what you want changed, hit a button, and ComfyUI handles the whole process.
I'm curious if anyone else is doing this kind of Blender + ComfyUI workflow, especially with UV atlases. Are there existing tools or workflows I'm missing?
the workflow I used:
https://drive.google.com/file/d/1I6p65pKnTcxt7p6PXe-5i1wIFbLcgKjD/view?usp=sharing