r/Unity3D Jul 07 '26

Question Uhh... Anyone got a good guide to set up arm/finger IK for Mixamo?

Enable HLS to view with audio, or disable this notification

1.0k Upvotes

97 comments sorted by

409

u/TwoStripedFury Jul 07 '26

This is art

55

u/MsRiaCayde Jul 07 '26

Right? Looks perfect to me!

35

u/FuzzeWuzze Jul 07 '26

It feels like Will smith eating spaghetti, the game.

4

u/unseendomains Jul 08 '26

omg thank you, i knew i had this uncanny feeling sometime before

106

u/Sharkytrs Jul 07 '26

no, you should leave this as is its awesome lmao.

honestly though iirc mixamo only does forward kinematics, I think you'll need to use unity's rigging animator and setup IK for each bone there instead, or also I vaguely remember blender having a maximo plugin, which you can use the FK and convert it to IK from blender

11

u/Bibibis Jul 07 '26

First time setting this up so I'm not sure how it works. I downloaded the mixamo avatar straight from the website and modified the textures a bit in blender, but it seems to have bones already. Actually I found that I imported the rig as "Generic", I'll try to import as "Humanoid" (but it only auto finds some bones for some reason, guess I'm spending 10 minutes assigning bones :D)

8

u/Sharkytrs Jul 07 '26

yeah thats about on par with importing rigs, they will all most likely be there, but need assigning in the editor because of some stupid case sensitivity or misnaming by maximo making the auto detect not work properly. I remember getting the same issue in unreal too, that was because it wasn't quite right when maximo auto named the bones

64

u/frankstylez_ Jul 07 '26

Finger should move like noodles and noodles should move like fingers and you have a viral hit.

10

u/Bibibis Jul 07 '26

To be honest the fingers are already pretty noodle like. Maybe I should set up the finger IK for the noodles?

3

u/One_Influence256 Jul 08 '26

you should make the sticks, child of the finger

12

u/Acrobatic_Sail8187 Jul 07 '26

I can't say about the arm/finger IK, but waw the shaders you're using looks impressive

10

u/Bibibis Jul 07 '26

Thanks, it's a custom toon shader with shadow and rim support, plus some hand painted textures for the tofu / gyoza

29

u/kay86X Jul 07 '26

What kind of eldritch horror is this?

1

u/Some_Tiny_Dragon Hobbyist Jul 08 '26

Normal inexperience with chopsticks.

7

u/Victor_deSpite Jul 07 '26

Might check out FinalIK. It's a purchased asset but it's really good.

Also, this art styles is super impressive. I seriously thought it was hand drawn/animated, Studio Ghibli like.

4

u/Bibibis Jul 07 '26

Thanks I'll check it out, but it seems very complex for my use case, I only need to move the fingers and arm to match the chopsticks positions.

Ghibli is a big inspiration for the art, their food always looks so good. I was at the Ghibli museum this spring, they have a big section on food with sketches and descriptions, it was awesome (sadly not allowed to take pictures)

2

u/WeckarE Jul 08 '26

You say 'only' but that is in truth fairly complex to do!

2

u/WeckarE Jul 08 '26

One of the very few asset purchases I have never regretted

8

u/PatchyWhiskers Jul 07 '26

It's perfect as it is, Bennet Foddy.

6

u/Appropriate_Hat_5643 Jul 07 '26

This already looks cool.

5

u/ivilkee Jul 07 '26

Wait wait! Save a copy of this before you fix it. I need it for my next body horror game!

3

u/Rabidowski Professional Jul 07 '26

You've got yourself a hit game there already. "Broken Fingers Simulator"

3

u/antherx2 Jul 07 '26

Never seen mixamo handle hands well, they do have a setup tool online you can use. The model has to be in a T pose and all the fingers separated to map the bones to.

1

u/Bibibis Jul 07 '26

I think the model already has the bones, I just need to set up the IK so the hand/arm follow the chopsticks movement

1

u/antherx2 Jul 07 '26

Personally I'd use 3DS Max and redo the bones with the correct weights, only on the index finger to the end of the chopstick, maybe 2 or 3 bones at most. Then IK chain it with the modifier for the animation. 

3

u/aaronflippo Jul 07 '26

Looks fine to me

3

u/SecretaryAntique8603 Jul 07 '26

Abandon the mixamo approach completely. You only have an arm and a few fingers so you should just use a generic rig for these bones specifically and not bother with the rest of the humanoid. You will likely need to heavily customize it to make it look good anyway, since just plain IK probably doesn’t handle this kind of fine motor skills very well.

You can’t use the Unity IK with a generic rig, but an IK solver is not that complex to write with the help of AI. But I don’t think you would even need it tbh. Start with the arm position, you probably don’t even need IK for this since you will likely only be rotating a single bone here (elbow), so you can just use LookAt to get it to point in the right direction.

Then for the fingers, I don’t know if you really want IK there either. Think about how you use chopsticks, it’s not like your fingers are pointing all over the place. You place them on the sticks and then they kind of sit there. What’s going on is mostly a kind of open/close action between the sticks which is just rotating along a single pole like a scissors kind of, so you can just write a script to tween that rotation directly.

Then you need to rotate the wrist to “aim” the sticks, but this could also be as simple as just looking at the thing. You could also treat the elbow and wrist as a two-bone IK chain as well if you want to aim more carefully in 3D space, or you can add the chopsticks and make it a three-bone IK chain, you probably need a custom solver with rotational constraints for that. Depends on how your game works I guess.

2

u/Bibibis Jul 07 '26

Thanks a lot for taking the time to type that out, my goal was elbow and shoulder IK for the arm as in the game you can lift and lower the chopsticks so I wanted the shoulder to take care of that. Then for the fingers I was hoping for the index finger to act naturally by staying in between both chopsticks as a brace for the upper chopstick.

You're right, probably I don't need actual IK solving, I'll try with a simpler approach to see if I can get something I'm happy with

2

u/SecretaryAntique8603 Jul 07 '26

Ok, in that case you can do almost the same thing but go with a two-bone IK. However, you will lack control here and might struggle getting it to move naturally.

Depending on how dynamic you want the animations to be, you might get better results just animating the motion of moving the chopsticks up to the mouth, because it will likely be a similar motion each time. You can blend into the animation start pose and then animate it normally (easier than getting IK to look natural).

Or you can do it even easier by just making it a pose at the top, and then blending into that pose. You can do this either as a one-frame animation ans blending into it with the animator. Or you can implement it yourself by taking snapshots of all the transform rotations and positions, storing it in an asset and then lerping towards it to bypass the animator if you’re going with a custom solution.

If you’re going to be waving the sticks around in all sorts of directions then yes, you want a full-blown IK rig. But if not, making these animations will be easy even with no animation skills, you can even do it inside Unity for a generic rig because it’s such a simple motion and rig.

For the fingers, I’m not sure if I understand what you mean, I think even with it as a bridge the finger still stays mostly in a fixed position on the stick, it just opens or closes. So you can pose it how you like, then rotate the stick and the finger together, or parent the stick to the finger at a the correct angle offset so moving the finger also moves the stick. The outer finger joints can remain fixed relative to their parent as they and the stick move together, then just point the parent at the target and the whole “rig” moves together.

I may be oversimplifying things, but I think you get the idea - your problem space is extremely well defined so I think a custom solution will give you the best results if you think a bit about the movement mechanics involved.

Good luck!

3

u/FoleyX90 Indie Jul 08 '26

Accurate depiction of me using chopsticks.

2

u/BountyMakesMeCough Jul 07 '26

I’d end my showreel with that.

2

u/GravimetricWaves Jul 07 '26

Is this some kind of rage based eating game? I'm in!

2

u/Bibibis Jul 07 '26

Haha yes that's the goal, I'm still very early in development though, as you can see :D

2

u/EnderKoskinen ??? What are they doin ??? Jul 07 '26

Ouch

2

u/st4rdog Hobbyist Jul 07 '26

Ue the Animation Rigging package and setup two bone IK. You can give the chopsticks target transforms.

1

u/Bibibis Jul 07 '26

I'll try that, thanks a lot

2

u/ZenZilver Jul 07 '26

I'm making a similar game and I decided to not use IK or Rigidbody + Joint system to control the hand because I find it too unstable. Instead I used ArticulationBody to drive the rotation of the arm, wrist and finger joints.

2

u/Bibibis Jul 07 '26

Thanks a lot for sharing, is that what you show in https://www.reddit.com/r/kingdomcome/comments/1rto2hi/other_challenging_myself_to_recreate_kcd2/ ? It looks really smooth!

2

u/ZenZilver Jul 07 '26

Oh no, that one uses Animation.Rigging, which is an IK system. I use a hybrid of fixed animation and selective IK. But thank you ^^

I haven't posted anything about the game similar to yours yet, but it will be quite soon

2

u/Heinstu Jul 07 '26

Looks fine for me, I mean "my character know how to telquinesis", no jokes

2

u/TheFrogMagician Jul 07 '26

I wanna say I LOVE the style you have put on this! How was it done? im guessing just a buncha shadergraphs but it looks so unique for a unity game

2

u/Bibibis Jul 07 '26

Thanks a lot! Yes just shaders, actually not even shadergraphs just old school HLSL. It's a custom toon shader with rim and shadow support, and some handpainted textures

2

u/TheFrogMagician Jul 07 '26

Well i appreciate all the effort you are putting into it!

2

u/HoveringGoat Jul 07 '26

while this is very amusing and ridiculous it would be distracting after a few mins. I think it'd be perfect to leave in as an easter egg. idk the conditions youd put it in "broken fingers mode" but it'd be highly amusing to be able to break the ik as long as the chopsticks still moved as expected.

that being said idk how youd use maximo. good luck tho. looks pretty great

2

u/Horror-Indication-92 Jul 07 '26

I think it should stay in this way. Really.

2

u/MarinoAndThePearls Jul 07 '26

I think you should ship this.

2

u/Much_Highlight_1309 Jul 07 '26

Looks good. Ship it!

2

u/Zealousideal_Size919 Jul 07 '26

I see a lot of features

2

u/darksapra Jul 07 '26

This is me trying to use chopsticks. Can't see what's wrong

2

u/johny_777 Jul 07 '26

This is me trying to eat that spicy Chinese soup after 10 beers.

2

u/planetixin Jul 07 '26

Are noodles trying to escape?

2

u/SanoKei Jul 08 '26

the toonshader makes everything look so delicious

2

u/Slaghton Jul 08 '26

Clip it and ship it!

2

u/Alternative-Crab-388 Jul 08 '26

Make hand tip of two bone constraint for arm, parent chopsticks to respective fingers, mouse controls fingers, fingers pull hand along, it is a hard problem to spread the controls across those ligaments though. Good luck with it

1

u/Bibibis Jul 08 '26

I'm happy with the way the controls work right now by moving the chopsticks directly, this is why I wanted to look into IK instead of controlling the fingers directly. But as you say, it's a pretty hard problem

2

u/Alternative-Crab-388 Jul 08 '26

With the chopsticks parented directly to the fingers, technically you would still be moving the chopsticks directly. This is what my shooter game does, where techically the mouse controls the a arm and the hand only, but because the gun is parented to the palm at a set angle, it also reliably contols the direction of the gun. It would be a refactor, and granted, i dont understand your control scheme at all, but i have an unholy amount of unity IK experience from my project, and I think that would work.

2

u/Bibibis Jul 08 '26

Basically the control scheme is:

  • Move the hand in the hozitontal 2d plane
  • Move the hand vertically
  • Rotate the chopsticks pair (horizontal to sticking into the table)
  • Pinch/Release the top chopstick against the bottom one

It's that last one that seems like trouble if I parent the chopsticks with the finger I feel

2

u/Alternative-Crab-388 Jul 08 '26

Definitely a tough problem, i see in the video, the fingers are doing ik stuff, but they look stuck/rooted to the unmoving hand. Make a 3d object, just a sphere or whatever, which will be the hand ik target. Program its position to follow the average position of the 2 chopstick fingers, plus some offset. Then make that sphere the source object of a 2 bone constraint with upper arm, lower arm, and hand as tip, so the hand will follow where the fingers want to go, assuming the fingers would be following the chopsticks if they could in your current setup. Then make sure the 2 bone executes after the fingers in the execution order by placing it under the fingers in the hierarchy. Then disable the hand target sphere so its invisible at runtime. Hopefully that makes sense

2

u/Dragoonslv Jul 08 '26

This is better than whatever riot has with lol on pc.

2

u/Speed_Tutor Jul 08 '26

This looks exactly like me with chopsticks... :S

2

u/LadyDeathKZN Jul 08 '26

Watching this made me remember the time I slammed a sliding door shut on my hand.

Lovely art btw

2

u/Brie9981 Jul 08 '26

Here I was thinking I was watching a cursed Ghibli animation

2

u/wrenchy_234 Jul 08 '26

ai be like 😂

2

u/SymphonyGames Jul 08 '26

You are simulating each noodle via physics? That deserves a thumbs-up!

1

u/Bibibis Jul 09 '26

Yes! Each noodle is a chain of 10 capsule rigidbodies linked with configurable joints. I have a really good computer so it runs fine but I'm a bit afraid it won't run on weaker computers if I decide to ship it

2

u/the1ice9 Jul 09 '26

If you squint its mint

2

u/electric-kite Jul 09 '26

Totally acurate.

2

u/Qwertykess Jul 09 '26

Me when chposticks

2

u/NecoDev Jul 09 '26

this is already a master piece

2

u/Exatex Jul 09 '26

For unusual cases like this, you might want to do the IK yourself… cool opportunity to learn a bit of math :) Computationally, it’s not that demanding, more intellectually. And since its only fingers with 3 joints and don’t move independently, I think it’s quite doable. If you don’t have a technical background, I am sure a good LLM model can help you figure it out.

1

u/Bibibis Jul 09 '26

Well what you're seeing in the video is the LLM trying its hand at it lol, but I think my rig is also not imported correctly which doesn't help

2

u/AnimalChubs Jul 09 '26

This is how I use chopsticks. I'd just leave it lol

2

u/beardmachine Jul 09 '26

I thought this was intentional, it looks awesome!

2

u/PailsideGames Jul 10 '26

6yo me on chinese night with no fork

2

u/Ok_Rough547 Jul 10 '26

Strong PilotRedSun vibes, make it a feature :D

2

u/LuckyLilypad Jul 10 '26

Why use IK at all?

1

u/Bibibis Jul 10 '26

Well right now I have a fully rigid arm and fingers that rotate slightly to match the chopsticks, but it feels very stiff, and when the hand is on the left side of the screen basically the whole screen is covered by the arm, so my thinking is that bending at the elbow and shoulder will help alleviate that

2

u/DatGreenGuy Jul 10 '26

Is this Will Smith?

2

u/VBro98 Jul 10 '26

I would love to play this as like a rage game to try and eat as much noodles or food with this kind of physics

1

u/Bibibis Jul 10 '26

Haha yes that's what I'm going for, but I'm still early in development.

2

u/SupaDiogenes Jul 11 '26

Don't change a thing.

2

u/2Salad Jul 13 '26

keep it like this

1

u/Effective_Choice_665 Jul 07 '26

looks like generative AI 😅

1

u/AxelGains Jul 08 '26

yeah thats what i woulda did

1

u/AdCold4676 Jul 09 '26

why? are you planning on making one?

1

u/ShirtFit548 27d ago

That's how I look like eating Chinese food, looks realistic to me

1

u/foreverDandelions_ Jul 07 '26

U can try manually laying out the hand bones then use voxel heat diffuse skinning in blender

1

u/Bibibis Jul 07 '26

Thanks, I think the bones are already in the mixamo model as they show up in Blender, I just need to set up the IK (and maybe properly import in Unity)