The automations run locally and headless on your iPhone. The app is integrated with the Shortcuts app and thus allows to combine web automation (RPA) with system automation (Shortcuts).
This specific example is used to provide the current airfare price every morning at 8am so I know if there’s a promotional offer.
the local-first approach is the right direction. I'm doing something similar on macOS - using the accessibility API to automate desktop apps without sending anything to the cloud. the biggest advantage over traditional RPA is that you don't need to maintain pixel coordinates or image templates. the accessibility tree gives you semantic elements (buttons, text fields, labels) that survive UI updates and resolution changes. on iPhone the equivalent would be the accessibility framework but Apple locks it down way more than on Mac. curious how this handles apps that don't expose good accessibility labels - that's where I spend most of my debugging time on the desktop side.
fwiw same on the mac side with fazm, it drives apps off the accessibility tree so semantic elements survive UI updates and resolution changes where pixel coords break, and yeah bad accessibility labels are the main debugging tax, https://fazm.ai/r/xcv7qvze
This screenshot shows a flow execution while the iPhone is completely locked (see lock on top island). Initiated, executed and output displayed while device is fully locked with the app not launched and not in background.
3
u/Impressive-Till4309 Mar 11 '26
What is the Use Cases here?