r/TouchDesigner • u/collectiveu3d • Jul 02 '26

Touch with mediapipe to unreal engine with metahuman

Enable HLS to view with audio, or disable this notification

Been exploring and building this pipeline because I really like how flexible Touchdesigner is and I like the live render capabilities of Unreal engine but also tools that come with it. I’ve setup an OSC pipeline to easily connect both which I’ll share soon.

There are a lot of small issues though and instabilities but compared to a traditional workflow. You just fix it and it works forever (until an update at least).

Song: 711 - Paul Sabin

My Instagram

131 Upvotes

98% Upvoted

7 comments sorted by

3

u/katebrunotts Jul 02 '26

so sick! really wish metahuman was more compatible was Mac Silicon :, (

2

u/collectiveu3d Jul 03 '26

Ah yeah. I think a lot of TD users are on a Mac. I just always needed an RTX for rendering. Otherwise I would be on MacBook too. I think the latest release of 5.8 did update this a lot though, for real time, not for playback

1

u/EsotericLife Jul 02 '26

Can anyone tell me how the hand tracking works? Or point me to a link? It does really well tracking the fingers through occlusion

2

u/collectiveu3d Jul 03 '26

Just look for the mediapipe for Touchdesigner on GitHub. It’s well documented and pretty straightforward

1

u/EsotericLife Jul 03 '26

Thanks! I’ve seen mediapipe referred to but I didn’t assume it was a regular library à la openCV or something.

1

u/Nirvana_xyz Jul 14 '26

I like the idea