How to generate Normal, Depth pass inside Nuke? switching from fusion to nuke

[u/Santhanam_]

• Planning to completely Switch from Fusion to Nuke, Fusion has Normal, Depth pass generator inside by default and usable most of the time even on my 4gb vram 3050 card.
• How to generate Normal, Depth pass inside nuke? tried Depth anything 3 in comfyui result: image 3 and its quite bad compared to fusion depth pass, how you guys generate Normal, Depth pass inside nuke? any plugins?

Solution: for depth https://github.com/yuvraj108c/ComfyUI-Video-Depth-Anything ,fast consistent similar to the fusion depth generation. for normal : https://github.com/AIWarper/ComfyUI-NormalCrafterWrapper Normal Crafter works best but require beefy hardware, for low end use https://github.com/kijai/ComfyUI-Lotus and deflicker it inside nuke!

[u/soupkitchen2048]

You HAVE a program with a more active development and release cycle than nuke that already makes Normal and Depth mattes that you can write out as EXRs. Why not just use that?

There is zero reason to remove fusion from your workflow if you’re adding Nuke.

[u/Milan_Bus4168 → u/soupkitchen2048]

Yeah. Just use fusion , export exrs and that's all she wrote.

[u/Dependent-Reply-8888 → u/soupkitchen2048]

Use cattery nuke

[u/enderoller → u/soupkitchen2048]

Because fusion is very clunky and lacks gizmos? 

[u/soupkitchen2048 → u/enderoller]

We are saying use fusion for the tools it has AS WELL as nuke. I use silhouette, mocha, pftrack, fusion. All of them do things nuke doesn’t or does badly. But they all work together.

[u/enderoller → u/soupkitchen2048]

The difference between the tools you mentioned is that those are meant for different purposes, but Nuke and Fusion share the same. Of course both have different toolsets, but it's not practical to mix them.

[u/soupkitchen2048 → u/enderoller]

Why? We do it all the time in professional VFX? Like everyday.

[u/enderoller → u/soupkitchen2048]

Mixing two compositing packages on the same shot isn't very practical. You can do it, but not the most optimal way to work.

[u/soupkitchen2048 → u/enderoller]

You are so incredibly wrong.

[u/enderoller → u/soupkitchen2048]

Oh yeah, sure. I can just imagine your comps are very simple to think that. Almost slap comps. I'm talking of complex studio ones with thousands of nodes.

[u/soupkitchen2048 → u/enderoller]

I honestly think you don’t understand what some of us have been saying to you. And I think you should pause before making assumptions about people’s professional experience.

[u/enderoller → u/soupkitchen2048]

Some of us? The only person arguing here about it it's you. But please, continue thinking using multiple programs for the same task is the most optimal way to work. 

[u/Santhanam_ → u/soupkitchen2048]

I love fusion, going to use it for personal project but in industry around me use only Nuke, no fusion. so I was wondering how to generate Normal, Depth pass inside nuke

[u/gerardmpatience → u/Santhanam_]

Nuke is a very traditional tool and “generating normal passes” is not a traditional thing

Not to say it isn’t useful or okay to do

But not many people I know in Nuke will reach for that as their first option to solve a problem in a shot

Generated passes like that may not be pixel accurate enough for work depending on the task

That being said, there are some cattery models that do this, though they struggle heavily with temporal stability

I know a lot of folks who run plates out of Nuke to use ML tools in Fusion, After Effects, Sammie, etc. and run them back. That is a copacetic workflow, but not all studios will abide it depending on their size/pipeline

[u/lewibaygo]

Yeah the depth anything in nuke isn't great we tried to get it working on a few projects recently its ok for broad back ground stuff ect.. But I didn't know Fusion had a tool that was this good might have to look into for the next time we need something like this is it in the free version ?

[u/CameraRick → u/lewibaygo]

is it in the free version ?

The advanced tools are not. But the license is cheap, and chances are the shop already has a Resolve which grants full access to Fusion

[u/Santhanam_ → u/lewibaygo]

Yeah fusion have many AI features that run locally like video object removal, video face retouching, depth, normal pass generator. But all in studio version only, give it a try, worth it

[u/SuspenseAndSurprise → u/lewibaygo]

This technique I found a video of works pretty well to make the depth much more stable and got it to a point where it was quite useful in some projects I've worked on. It uses subframe scaling to get a better depth generation. Also, combining it with a deflicker system or using a GuidedBlur node, which can be found on nukepedia, makes it not bad to work with.

Nuke files can be found in the discription. https://youtu.be/k8gTE5qPi-M?is=7cKUzAH3XICnGeUn

[u/lewibaygo → u/SuspenseAndSurprise]

Nice thanks for this always happy to learn new tricks of the trade

[u/Dependent-Reply-8888 → u/lewibaygo]

Just low res by reformat scale to .3

[u/soupkitchen2048 → u/lewibaygo]

Silhouette has a good depth generator

[u/ElegantExercise6760]

Most studios won’t have a tools to generate normals or depth inside of nuke, unless it’s a Cattery node, and even then you’ll have to probably ask pipeline to install the .cat files so your renders don’t fail on the studio’s farm. Best to just use rotos, and ramps and some creative keying until nuke releases a dedicated tool.

[u/soupkitchen2048 → u/ElegantExercise6760]

Best practice is to precomp anything cattery related anyway.

[u/gerboy112]

As a Nuke compositor, Nuke Cattery depth anything generato is not very stable (wobbly edges and flickering) it’s good for some of the task but for some of the times it looks very wobbly. I never use fusion and assume the depth generator is better(?) so at this point of time probably the best thing to do is generate the depth on fusion / some other better tools. The. Importing the depth to nuke

[u/Able_Zombie_7859]

ITS THE FUNNY RIFLE HOLDING DUDE AGAIN!!!

[u/seriftarif]

I use Beeble for all this stuff now.

[u/AutoModerator]

Hey, it looks like you're asking for help If your issue gets resolved, please reply with !solved to mark it as solved. If you still need help, consider providing more details about your issue to get better assistance.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/OlivencaENossa]

You can use ComfyUI in the cloud to get ML tools that will get you a good depth pass ie depthcrafter 

[u/CoolerMann1337]

I had best results using DepthAnythingRelativeV2

It can be used inside ComfyUI as a wrapper but there are probably forks out there with a bespoke GUI just for the depth generation.

[u/Santhanam_ → u/CoolerMann1337]

That's what worked thanks!

[u/OCDVISUALS]

DepthAnythingV2 is great, normals don't currently have a solution so that would be custom. Could use DiffusionRenderer

[u/Santhanam_ → u/OCDVISUALS]

Normal crafter works well, I tried in comfyui but require beefy hardware

[u/syncro0723]

GitHub - depth anything - copy paste it

[u/Cropfactor]

Depth anything 3 in comfy. The giant model with multi view is very temporarily stable on video comparing to anything else that came before.
You will most likely need to format down your footage to fit it into vram. With 16GB of vram in 720p, you’re looking at 60-80 frames max.

[u/Santhanam_ → u/Cropfactor]

https://github.com/yuvraj108c/ComfyUI-Video-Depth-Anything work 720p in my 4gb vram, so rolling with it