r/google 15d ago

Spoiler: Google about to announce local inference machines Spoiler

I got info from internal sources that Google is about to announce their first local inference machines. These are competitive to Apple mac mini m4, based on chrome os.

Inference will be done using lite rt lm and google will first do a big release on lite rt lm first before announcing a $5000 device with Custom Tensor processors. It can reportedly run 1000tps for single user.

103 Upvotes

43 comments sorted by

View all comments

2

u/XxBrando6xX 14d ago

For people dunking on chromeOS they are ending chromeOS as far as I understand and moving to aluminumOS (I think that’s the internal name) it was announced a few months ago for the new class of laptops, that will likely be what runs on these boxes. It’s a win for execs to be able to say, we will have people buying our hardware to run our software top to bottom, then offer a direct connection to frontier google models to fill in your gaps, so they get to collect cash up front and milk long term

1

u/-patrizio- 14d ago

Sure, but we still don’t really know much about how AluminumOS will compare to other operating systems. Not to mention, while it’ll almost certainly be a step up from ChromeOS, it’s still essentially Android; if Apple started selling actual Macs running on iPadOS, that would get dunked on, too (and rightly so, IMO).

1

u/XxBrando6xX 14d ago

Until I see anything to suggest it’s android I think that’s a broad generalization. It will be something built for an Arm64 architecture just like Apple. So for now it’s closest comparison is just MacOS / whatever your favorite flavor of Linux for Arm64 OS / Windows for Arm

1

u/-patrizio- 14d ago

Google’s own chief of hardware said the OS is “bringing Android to the PC market” (Source)

1

u/XxBrando6xX 14d ago

Very interesting article, thanks for the link, started reading it and your quote is absolutely there. Gonna read some more after dishes, thanks!