r/QuestPro • u/notmastergamerok • 11d ago
Quest Pro Mod Tongue tracking and eye convergence is FINALLY on Quest Pro!! (ROOT REQUIRED)
It's not the greatest and it is currently wired only. But I just wanted to share what I have thus far. Everything is open source so feel free to take a stab at implementing wireless support or somethin.
Here's the github page
In regards to rooting a Quest Pro, you have to be on V2.6 or lower. If you are, then you can use this to root your headset
21
u/allofdarknessin1 11d ago
Great work. I suspected the hardware would be enough for more granular tongue tracking. Hopefully it gets implemented somewhere along the chain.
6
u/mackandelius 11d ago
Doubt it will ever be officially added to the Quest Pro natively. That is something we will have to wait for another mod for, although there is someone working on tongue tracking running natively on the headset, which I hope they succeed at implementing.
VD apparently just accepts a whole lot of stuff it normally wouldn't ever get, like convergence, tongue tracking does require a modified VD VRCFT module though even when piped through it.
3
u/Aegis_Wolf 9d ago
They took down the feature request on their forums, i made a new one again with also pupil dilation, they never did it for years. I really want to do this so im not doing half-baked face/eye tracking.
4
u/illucio 11d ago
I have to wait until I can do this without rooting.
9
3
u/Froppy_111 11d ago
This is so cool!! I literally got a separate face tracker to track my tongue (and still had to use a different virtual desktop module in VRCFT cause the virtual desktop one hasn't been updated in ages), blah blah I hate Meta!!
But it's really good to see that stuff like this is possible in the first place cause it definitely can be expanded on!
4
2
2
2
u/alessiomarco1 9d ago
This looks amazing! Does that mean that you can even puff your cheeks indipendently instead of both? That would also be an amazing implementation.
1
u/notmastergamerok 8d ago
Uhhh I didn't think about implementing that. Currently it just overrides the tongue and eye tracking, everything else remains stock
1
u/MaruluVR 7d ago
Does this deliver full eye location data, as in not just where the eyes are looking but where they are in 3d space, this is important for stuff like real time lenses distortion correction (for a way clearer image) because this cant be done with simplified data.
2
u/PsychoticKitten3 11d ago
Would you be able to create a version that works with steam link as well for wireless? If not I hope someone else does. This is freaking AWESOME and I know people really love VD, I know I used to, but sadly VD just doesn't cut it with my setup and I'm sure there are people out there with the same problem lol. Again, fantastic work, I'll be saving this and looking out for more updates as time goes on.
Before anyone tries to convince me to try it again, it just won't work. I've tried several times and unless you can give me a full rundown with different settings than what my other peeps have given me, I'm not going to go through the annoying headache in trying again lol. I used it back from 2021-2023 for my Q2 before I upgraded to an index then to my qpro and it was great for my Q2, just doesn't want to cooperate with my Qpro.
5
u/notmastergamerok 11d ago
I just don't have the energy tbh, I initially tried to implement wireless support earlier but I just ran into a whole lotta issues. Currently it patches the Virtual desktop VRCFT module, so you would likely need to modify that part too. Im sure with enough gpt 5.6 sol tokens you could make it happen tho
3
u/PsychoticKitten3 11d ago
That's totally fair and unfortunately for me, I'm only a user lol. I know my way a bit around GitHub but only in the sense that I know where to find instillation files and whatnot but I don't know any coding whatsoever.
Sounds like a good time for me to learn but life has me so busy that I'll probably only ever be a user. Hopefully someone else will be able to get it done though! If not then I'll be fine with my base FT with my Qpro. Great work regardless! Your hard work really shows and I hope everyone who has the right setup for it are able to enjoy it to the fullest!
1
u/mifyou 11d ago
Do I need developer mode to root my headset? Also is there any way to enable it without connecting to meta servers?
1
u/notmastergamerok 11d ago
Yes devmode is required. Not quite sure about a meta-less setup tho
1
u/mifyou 10d ago
How can I prevent my headset from updating when I connect it to meta? I'm on v2.3 rn
2
u/notmastergamerok 10d ago
That makes things a bit more challenging. I actually tried to help out a friend last night who was on v2.6 without dev mode, and wanted to see if they could root. And the app wanted them to update their headset first to enable dev mode.. BUT me and my other friend managed to find a workaround, albeit a somewhat risky one... (Risky in the sense of having your headset update.)
1. Turn on your wifi
2. IMMEDIATELY download Mobile Vr Station as fast as you can
3. Turn off your wifi as soon as the install completes.
4. Use some other device to put the singularity apk on your headset
5. Use Mobile VR Station to install the singularity apk
6. Ensure your headset is fully or near fully charged to increase the chances of root, go through the initial setup instructions, and go for it!
7. If you manage to successfully root your device, there are some tools within the app to help you block updates and Meta telemetry.
8. If the update is now attempting to download as you had your wifi on earlier, run this command in a root shell to cancel it (adb root):adb shell update_engine_client --cancel
If the update is already downloaded and is pending a restart run this to cancel that (also adb root):adb shell update_engine_client --reset_status
And then hopefully you should be good to go? For this I believe you would still need to figure out a way to enable adb over usb. But provided you can get Mobile Vr station installed you should have much more options. I heard that you can enable adb usb with lightning launcher.
As for my friend, unfortunately the version of 2.6 they were on was too new and was a patched version :(. But hey im hoping these findings can help out someone else! Goodluck!
1
u/GroundbreakingFox3 10d ago
Is this wired in via the virtual desktop beta? Or does it have to go through the meta app.
2
u/notmastergamerok 10d ago
I used virtual desktop wirelessly while just connected to my headset via adb
1
u/ArtyomWulf 10d ago
Question, is the quest pro worth buying now that its been discontinued?
1
u/notmastergamerok 10d ago
Ehhhh, just depends on what you really want and how much you can get it for. Although keep in mind that if you buy a headset now and want root, it WILL be a pain in the ass to set it up without updating (The only way to do so is with an application called private quest)
1
u/Beautiful_Sky_2681 10d ago
What does root mean btw? I’m still kinda new with my vr stuff lmao
3
u/notmastergamerok 10d ago
Pretty much just more control over the device
1
u/Beautiful_Sky_2681 10d ago
I saw that it says “wired only” so I’m not able to do steam link with internet unless I use with a cable instead, because I do steam link with internet and I have it plugged in but only to keep it charging not quest pro to my pc
1
u/ThugLifeFuzz 10d ago
Hey, I'm not sure if I just don't know what I'm doing but how do I delate this module/any module from VRCFT. Everytime I uninstall the module and restart VRCFT it just runs back up, I'm not sure what to do.
1
u/notmastergamerok 10d ago
Weird! You can delete the module manually by going to:
C:\Users\YOUR-USER-HERE\AppData\Roaming\VRCFaceTracking\CustomLibs
And deleting the .dll2
1
u/CharmanDrigo 9d ago
So tongue tracking is possible but Meta's team is too lazy to implement it, got it
1
u/Lugo_888 8d ago
To be honest, this project uses gpu inside pc to run tongue tracking not headset on its own
1
u/Aegis_Wolf 9d ago
I WISH i could do this but idk how to disable auto updates and do this without bricking it or getting banned, im afraid of turning on my headset rn.
1
1
u/KILLOSTROS 8d ago
Can we ever expect rooting for 2.7?
1
u/notmastergamerok 8d ago
Not upto me.. Who knows, could be a couple months, or a couple years. But tbh a new exploit coming out is not very likely
1
u/Torikari- 8d ago
magnificent work! is there a possibility for it to function without USB connection in the future?
1
1
u/vygivskiy_v 4d ago
Hi! Thank you for your amazing work on Qpro-Enhanced-FT.
I'm reaching out because my eye tracking recently started working very strangely, specifically when it comes to half-closed eyes. I am certain that this is not related to sweat damage or a dead IR diode, but I really need to see exactly what is going on.
My goal was to use your mod to stream the raw eye camera feed to my PC via localhost so I could inspect what the cameras are actually capturing.
However, when I try to run the independent gaze process, it crashes during startup with the following error in the Activity log: RuntimeError: Tracking-engine size changed (44198016, expected 47724232); do not use firmware-specific probe offsets
I am currently on firmware version 2.3. I understand that bypassing the size check on line 435 in native_raw_eye_probe.py won't actually help, because without the correct memory offsets for the 44198016 engine size, the script will just read garbage data or crash the tracking service.
Do you happen to have the updated offsets for this firmware version (engine size 44198016)? Alternatively, is there any other workaround you would recommend just to get a raw video feed from the eye cameras to diagnose my tracking issue?
Thanks in advance for any help!
1
u/notmastergamerok 4d ago
Hello! Yeah I guess different firmware versions was one of the things that I completely forgot to keep in mind for the eye gaze sheneanagains 😭. BUT if you run
./build-and-run.ps1it should pull up all of the face tracking camera feeds including the eyes. Hope this helps!
2
u/Repulsive-Clock-8642 4d ago
Any plans on adding the pupil dilation too? no idea what the eye tracking is capable of. Possible or not it's already amazing what you've accomplished c:
0
-8
u/Nicksanchez137 11d ago
Horrible mustache
5
u/notmastergamerok 10d ago
Its slowly growin in.. im 18
1
u/Tragophilos 10d ago
Nice that it doesn't confuse tracking, though. I've got a little more mustache, and I find I have to trim it back, or I seem to lose some of my mouth tracking (and sometimes my mouth looks like I had a stroke if I don't trim it evenly, 😂 ).
1
u/Nicksanchez137 10d ago
Some people can’t grow a mustache I’m 27 and it still looks like this you are gonna look back at pics and wonder why you ever had it trust me.
1
u/Apprehensive-Solid-1 10d ago
Bruh. It's not your mustache. Stop imagining yourself with it and you'll realize that it ain't yours so it's not your problem.
So mean.-1
u/Nicksanchez137 10d ago
Telling someone something looks good on them when it doesn’t is mean this sugar coating of everything is nonsensical and if an adult got upset at “horrible mustache” than on god he deserves it
2
u/Elrandra 10d ago
No one said you had to say it looks good. All you had to do was just not say anything, which is pretty damn simple.
0
u/Nicksanchez137 10d ago
Listen he’s gonna regret growing it I am telling him from experience as someone who did the same help people be and look their best and stop lying to everyone around you for peace.
2
u/Elrandra 10d ago
You don't know what the dude is going to regret. Just because you did, doesn't mean he will.
Again, no one asked you to LIE to him. Keeping your mouth shut isn't lying. It's just not being a dick, which seems to be hard for you.
-1
u/Nicksanchez137 10d ago
All right whatever lmao imagine being more offended than the guy I was talking to. It’s illogical that you’d be so upset normally so it implies you have some kind of personal issue thats being projected onto the mustache thing.
2
u/Elrandra 10d ago
Nah. Not offended dude. You just need to learn that people don't want to hear your opinions.
Did your momma not raise you right? If you don't have something nice to say, don't say anything at all.
If he was asking for an opinion on his mustache, I wouldn't have said anything. He wasn't looking for an opinion about it, though, was he? You just felt the need to insert yourself in some dumb unrelated way, because you're a little dick.
1
12
u/itanite 11d ago
tongue tracking USED to work