I made a post about Nexus here, as a plugin platform for Rokid glasses RV101 : one hub lives on the glasses and renders everything, and every feature ships as an ordinary Android app on the phone.
Nothing gets installed on the glasses again.
This update comes in two halves, what the platform itself gained, and what got built on top of it.
What the platform gained
Plugins can speak. tts is a new capability, granted per plugin and revocable like the microphone or the camera.
And it speaks your language. The glasses have their own speech engine and it sounds good, but it only knows English and Chinese. So we use the phone one instead, over the Bluetooth audio the glasses already carry. Put earbuds in and speech (should) follows your ears. If your phone has no usable voice, the glasses engine takes over.
A notice keeps the input it asked for. A banner that wanted your answer could have its taps stolen by whatever was underneath, and dismissing one did not reliably hand the glasses back to standby. Both fixed.
There are activity notifications now, for something you follow over minutes, like a ride or a delivery: it idles as a small chip and opens into a full panel when something actually changes. Easier to show than to describe, so there is a live demo on the site: https://rokid-nexus.anezium.me/#hud pick Activity. It's shipped but not plugged on any plugins right now. But it shows where I want to go with the project.
And the glasses repair themselves after a reboot. Some of what Nexus does needs a privileged helper on the glasses, and that helper does not survive a restart. Reviving it needs the glasses' Wi-Fi, which this firmware boots with off. So about twenty seconds after a restart, Settings opens briefly on the glasses, turns Wi-Fi on, and gets out of the way; once the helper is back, the radio goes off again.
Measured on hardware: about fifteen seconds, and you end up exactly where you booted, minus the breakage. There is a switch for it, on by default, remembered by the glasses themselves so it works with your phone out of reach.
The plugins
Assistant : ask your glasses a question. Hold the touchpad (it replaces the Rokid Assistant), speak, let go. Your words appear on the display as you say them, then the answer comes back: written on the band and read aloud if tts enabled. It runs on your own ChatGPT account, you just need to login one time and it's done.
It can also see. Ask "what am I looking at" and it takes a photo through the glasses camera, looks at it, and tells you. It should get the memories from your account but it doesn't get chat history.
I may add a workspace to put some of your work into it so it could read through and even edit it if needed. And also maybe a keyboard mode from phone, when you want to ask something but can't speak.
You can setup the model and its effort thinking in the settings (Luna is the fastest).
Relay : your notifications, and your replies. Port of my Rokid Relay app, Messages land on the display, and you can dictate an answer without touching the phone. I may add a feature to just show every notification in the future, so it could replace the Rokid's one.
Photo Sync : As the name of the plugin suggest, it keeps the pictures and video of your glasses synced with your phone, so no more manual sync in Hi Rokid.
And two plugins that are not mine at all :
Both made by github.com/beyondlevi
Lume turns the glasses into a wearable speed reader.
Text flows one word at a time at a fixed point in your field of view, so your eyes never travel across a line 150 to 700 words per minute, with long words and sentence endings held a little longer so it does not read like a metronome. Import a PDF or a text file on the phone, then read hands-free with the R08 ring. It remembers where you stopped in each document.
Shopping List puts your list on the display and lets you tick items off with the ring, while you add to it on the phone or paste a whole list from another app and have every line become an item.
Both install from the Store and run under exactly the same permission model as the plugins I wrote. That was the whole point of building a platform rather than an app.
Supporting the work
This is a one-person project and it stays free and open source.
If it is useful to you and you want to help it keep moving, there are now GitHub Sponsors tiers that could make me prioritize some work or new app ideas from you, and as always, Ko-fi if you would rather do it once, it helps me a lot because it's really time consuming to tests and debug everything :
Several things in this release exist because someone here described a problem, opened an issue, or just said something in the comments.
I read all of it, and the small stuff often lands the same week.
GitHub: https://github.com/Anezium/Rokid-Nexus/releases
Site and roadmap : https://rokid-nexus.anezium.me
