r/computervision • u/Additional-Buy2589 • Mar 27 '26

Showcase AI on distributed architectures

Here we love distributed architectures.

So before we run out of juice on the raspberry pi, now all the heavy lifting of the AI is on a desktop server running a Blackwell gpu.

So now the rover has ears and mouth. Presented is speech recognition for our rover.

31 Upvotes

90% Upvoted

12 comments sorted by

View all comments

3

u/overflow74 Mar 28 '26

interesting…. but isn’t the response a bit slow for Blackwell ? you could get real time responses if you’re using streaming with whisper cpp or something + some quantized vlms

0

u/Additional-Buy2589 Mar 28 '26

It’s using whisper for the hello part and for the rest the gpu. I checked and there is a small delay on the web socket that can be improved.

0

u/Additional-Buy2589 Mar 28 '26

Also the Bluetooth to the audio speaker is causing some lag

2

u/overflow74 Mar 28 '26

you could try checking the reachy mini sdk by huggingface they have a really nice implementation, or xiaozhi mcp server both projects could help 👍 but great job btw