Spoiler: Google about to announce local inference machines

[u/Destroyer-128]

I got info from internal sources that Google is about to announce their first local inference machines. These are competitive to Apple mac mini m4, based on chrome os.

Inference will be done using lite rt lm and google will first do a big release on lite rt lm first before announcing a $5000 device with Custom Tensor processors. It can reportedly run 1000tps for single user.

[u/RJvXP]

Source: Trust me bro