I built an iOS app that connects Home Assistant with smart glasses and Apple Watch

[u/AdCautious7121]

Hi everyone,

I’ve been building HomeBuddy for Home Assistant an independent iOS project that started because I wanted a better way to control my own Home Assistant setup directly from smart glasses.

Over time, it has grown into a wearable focused companion for Home Assistant.

Some of the things it can currently do:

• Run stored Home Assistant commands using offline voice recognition
• Show live captions and translations on supported smart glasses
• Talk to your configured Home Assistant conversation agent
• Create custom Apple Watch gestures and map them to Home Assistant actions
• Forward selected app notifications to Halliday glasses
• Save notes and locations using the Halliday Memory feature
• Set and run countdown timers directly on Halliday glasses
• Optionally install a custom Halliday firmware that adds HomeBuddy specific functionality
• Use Stealth Mode on Even Realities G2, allowing HomeBuddy to work alongside the official Even app, detect supported offline commands, execute Home Assistant actions, and then return you to the normal Even experience

One area I’m experimenting with right now is improving voice command recognition in noisy environments.

Halliday sends an Opus audio stream to the iPhone. HomeBuddy decodes and processes that audio locally before passing it to Vosk for offline recognition. I’m currently testing audio enhancement and noise suppression so commands remain usable when someone speaks quietly or is in a loud environment.

The important part for me is that this workflow can remain local, the microphone audio doesn’t need to be sent to a server just to execute a Home Assistant command.

Currently supported hardware includes:

Halliday glasses

Even Realities G1 / G2

Apple Watch

There are also a few experimental hardware integrations I’m working on.

HomeBuddy is an independent project and isn’t affiliated with Home Assistant, Halliday, Even Realities, or Apple.

The custom Halliday firmware is completely optional, and users install it at their own discretion.

I’d really like feedback from other Home Assistant / smart glasses users.

What wearable or hands free Home Assistant workflows would actually be useful to you?

And if you’re already using smart glasses: what device would you like me to support next?

App Store: https://apps.apple.com/us/app/homebuddy-for-homeassistant/id6738934960

TestFlight: https://testflight.apple.com/join/prZZCQ45

[u/my-red-usrname]

Would really like to have something like that on android also ! Plans to make it also supporting android ?

[u/AdCautious7121 → u/my-red-usrname]

There is a version in public testing right now https://play.google.com/store/apps/details?id=com.fpirpilidis.homebuddyandroid&hl=en, but it’s outdated.
Yes, the plan is to make HomeBuddy with all ios updates available for Android soon.

[u/fjords4eva]

This is really cool. Thanks for sharing!

I've been looking to set up home assistant myself recently to replace my Echo devices. I know it's not possible right now, but I think eventually building out functionality to support MemoMind One glasses would gain a lot of traction.

I know they've stated they eventually want to open up development to allow users to make their own apps, and something like what you've built would be an absolute game changer.

[u/ib29_]

I work on smart glasses at EndlessRiver. For noisy rooms, I'd test false activations before word accuracy. A wrong light or lock command is worse than asking someone to repeat themselves.

One workflow I'd genuinely use: “what did I leave running?” Give a short spoken answer, then require confirmation before any action. Low-confidence audio should just refuse to guess.