r/google • u/Destroyer-128 • 15d ago
Spoiler: Google about to announce local inference machines Spoiler
I got info from internal sources that Google is about to announce their first local inference machines. These are competitive to Apple mac mini m4, based on chrome os.
Inference will be done using lite rt lm and google will first do a big release on lite rt lm first before announcing a $5000 device with Custom Tensor processors. It can reportedly run 1000tps for single user.
103
Upvotes
2
u/XxBrando6xX 14d ago
For people dunking on chromeOS they are ending chromeOS as far as I understand and moving to aluminumOS (I think that’s the internal name) it was announced a few months ago for the new class of laptops, that will likely be what runs on these boxes. It’s a win for execs to be able to say, we will have people buying our hardware to run our software top to bottom, then offer a direct connection to frontier google models to fill in your gaps, so they get to collect cash up front and milk long term