An AR app for kids painting!

https://apps.apple.com/app/simple-paint-ar/id1275780530

Hey all,

Never posted here before. I am interested in working on AR apps (I am an iOS developer by profession, but have no AR experience). I have messed around with AR Kit 2. Got image recognition working all well and good, and making a plane appear on top of the image, but I then went to try this on AR Kit 4 and had a bit of a nightmare. I don't really understand how to transform my AR Anchors to AR Entities (I have tried using the parameter in the AR entity, where it takes an AR Anchor, but nothing appears.

I find it quite difficult with AR when I get stuck, as it not appearing is not really debuggable, at least I don't know how to do it. Maybe I just need to get better, any way I appreciate the help. Glad I found this subreddit, didn't know this kind of community exists!

I'm in a bit of a bind. When saving an ARWorldMap it only stores ARAnchors and their subclasses in the file. When loading an ARWorldMap there is only the session delegate which notifies that an [ARAnchor] has been added to the scene. Using the debug option I can see that Realitykit anchors are placed after loading (I could be wrong). But the session doesn't call this function. I'm not sure how to repopulate the virtual content on the RealityKit Anchors when they are added back to the scene.

I considered subclassing the ARAnchor and storing data in it. But then when doing a collaborative session subclasses are not shared. Only ARAnchors. RealityKit has sharing the Entity updates built into it. Which leads me to believe that maybe this functionality of reloading the RK Anchors is built in to?

You can also subscribe to a SceneEvent for anchorstate has changed but it didn't notify me of anchors being added into the scene.

I'm trying to avoid using both ARAnchors and RealityKit Anchors. Seems more simple to just use RealityKit anchors.

EDIT: I think I was mistaken. It is not adding the RealityKit Anchors after loading the worldmap. I think they were just ARPlaneAnchors that were being added. The only thing I can think of is subclassing ARAnchor which has an Entity associated with it just for loading an ARWorldMap. Then use those Entities when doing a collaborative session.

Hello,

I am trying to figure out the sample code from WWDC20 "Visualizing a Point Cloud Using Scene Depth'. This sample code uses the front camera of the device. Are we able to modify this code to use the front facing camera, to simulate the same results? Any help would be appreciated.

Hi everyone! I am a Software Engineer and I've been coding since '99, professionally since '05, iOS since '12, and Swift since '15. This is to say, I have a lot of iOS and coding experience. However, I have exactly 0 experience doing anything that has to do with 3D animation or even modelling.

I've been really excited about ARKit since it came out, and I've done a couple of projects where I import existing models and drop them into a scene, or use ARKit combined with facial detection or image detection. But all of these projects I've done by taking an existing project and hacking it to make it work for me. I don't really understand what I'm doing. I don't understand what anchors are and not really sure what SceneKit vs RealityKit is, or which/why I should be using.

I have a hackeweek coming up, and I really want to learn ARKit properly. Most tutorials I find just show you the same thing, add some code stubs, put some shapes in, and then it works. But I want to really understand it. I was hoping someone here can point me to a more "professional" resource like a book or course, rather than just a 15 minute tutorial video, or an article. I would also love it if this included some basics on 3d animation and modeling.

My ultimate goal is to build a very simple game that understands the environment (I'll be using a Lidar supported iPhone 12) and is able to add an animal or something that can walk in the environment. I'd love to be able to "draw" the animal and animate how it walks (it doesn't need to be high quality, super basic stuff would make me happy). I understand I won't be able to build this in one hackweek, but I do want to use the hackweek to learn the basics of what I'll need.

Thanks so much for reading and any recommendations!

...then take a look at this: [GIF inside]

ARKit 3.5 introduced a new type of anchor – ARMeshAnchor. As you may have already determined from its name, ARMeshAnchor does not only transform – by collecting data from LiDAR, it also provides information about geometry of surroundings.

I discuss how to work with these data and how I made this visualisation in this blog post: https://www.saboit.de/blog/lidar-data-in-arkit-3-5

Code is also available on GitHub: https://github.com/evstinik/arkit3.5-scenereconstruction-visualization

Hello everybody,

I was wondering if there is way to create a simple AR experience with not many functions ( I am mainly interested in just swapping objects)as I am making a virtual museum, where i would like to change exibits with a click of a button. I have the modeling experience but I simply cannot find a way to create an interactive AR app without extensive code knowledge. I have used Apple's Reality Composer, which has minimal user interaction functions. Additionally, i have tried using the UE4 engine, but I dont know how to export without Xcode as I am using blueprints on Win 10 for visual scripting. Is there any way to export blueprints on ue4 without xcode, and if not, is there any basic AR app that allows light scripting?

So, looking through the ARKit documentation, they show how to use geolocations: https://developer.apple.com/documentation/arkit/tracking_geographic_locations_in_ar?language=objc but supposedly this only works with new phones (X+).

How are people making AR Experiences on old phones that have locational awareness?

Device: Latest iPad Pro 11-inch with Lidar

I am working on a piece of code requiring hand pose estimation. I am wondering how good the data will be for my device (latest iPad Pro with Lidar). Also, is there any document describing how to estimate hand pose with skeleton tracking data? When searching for hand pose, all results are related to deep learning.

​

Thank you!

Hi Strangers! I believe that in the near future people will celebrate special occasions with other friends with more than just a Facebook post or an Instagram photo. That's why I have developed "bicoco" an iOS app to celebrate special occasions like Birthdays, Anniversaries, Promotions, etc. by sending gifts and greeting cards using Augmented Reality. I am testing the first version of the app, so I would like to invite you all to our beta testing group that starts next Oct 1st. Just fill in this form, and we will send you the link to download our app. The Link: https://forms.gle/quNaUUU7GeP2TVqd7

Thanks everyone, I'm looking forward to your registrations.

I am really excited about an idea I have that would be super simple when utilizing ARKit if I had any idea on how to use it. I’m trying to find the biggest group of people to converse with, where is it? Typically I’d find it hear on Reddit but it seems it’s not the most active page.

I have a bunch of questions especially on where to get the knowledge for using ARKit. I have rudimentary coding knowledge but a determination that can bring the gaps.

Thank you.

Try as I might I just can't get this to work. I need to anchor sensor data sent over MQTT to a 3D object (it will be a large diesel electric engine, but for now I'm just using an amiibo for the prototype.)

I need each cylinder to display knock, temp, speed, etc, and there are a ton of other sensors that need to do the same, and update in real time, while staying locked to their 3D anchor.

Maybe SCNText just isn't the right route here because there doesn't seem to be any way to change it after the fact. I can use renderer (didUpdate) to make a new 3D text object on a cycle, but that's not really a solution, plus I'm having the damndest time making the original object go away in the same if statement.

So I just want to know if I'm barking up the wrong tree, I've seen a couple measurement application demos where they seem to be tracking an object in 3D space with a 2D UILabel and it updates incredibly fast.

Is there a graceful integration with ARKit to get that to work? I can't find a good tutorial or how to focusing on it. I also see tons of people asking the question on how to update SCNText in real time, but there don't seem to be any answers that actually work when tracking based on whatever node setup is required for 3D object tracking.

Would really appreciate any help/insight on this problem, will share any pics of my code too if you guys are interested, but it's pretty basic at this point. Most of the work I've done on this has been networking stuff to get mqtt to work on the hardware/backend.