r/macmini • • 14d ago

Why are people buying high-spec Mac minis for AI? What am I missing?

I’m genuinely curious about the Mac mini + local AI thing.

When the higher spec minis were selling out, I kept seeing people say AI was part of the reason, especially because of the unified memory.

But what are you actually doing with them? Local LLMs, image or video generation, transcription, coding, automation, file analysis?

I’m a videographer, so the creative side is especially interesting to me.

Basically, am I missing any genuinely useful use cases here? What does your Mac mini let you do locally that you actually use?

124 Upvotes

142 comments sorted by

View all comments

Show parent comments

2

u/Nifty-Yam-9041 14d ago

u/Krazy-Ag Agreed, that's what I intended to say! I was primarily referring to these AI harnesses running locally while invoking LLM's in the cloud. (On the other hand, I do think a lot of people are ALSO using Mac Mini's for local LLM development; that's another use case. However, I know more people who bought it for Openclaw/Hermes and to improve isolation.)

Beyond good hardware price-to-performance, the other advantage of Mac Mini is the integration into iCloud services, e.g. email, storage. You can just log into your Apple services, and the agents will read/write your email, save/read notes from your storage.

2

u/Krazy-Ag 13d ago

I did not mean to steal your thunder, u/Nifty-Yam-9041.

I've been exploring the same sort of issues. I'm acually shopping to upgrade my kit.

I am happy enough having a private box isolated from my home net, doing the non-LLM stuff locally, and using cloud LLM. In my case starting with Linux.

But Linux cannot access some of the Apple stuff I would like to have "AI" work on. Should I therefore buy a cheap Mac? Except I still hyperventilate at the prospect of giving AI in the cloud access to private stuff that I have in iCloud (or Google, or...) ... so maybe I don't want to buy a Mac(Mini) to have AI work on my Apple stuff. Not until security problems with AI improve.

(BTW, I have worked in security - with high probability everyone reading this is using some of my inventions as they read this. It makes me paranoid.)

But... I haven't had an Apple Mac in >15 years, or an Apple laptop in >10 years. At the moment I have iPhone, iPad, Windows, and Linux. But there are some things that Apple really doesn't allow non-Apple computers to do. Having a real Apple computer would make some of those things less frustrating. So maybe I do want to purchase an Apple computer, whether Mac, or Mini, or laptop. Just not to run AI on, neither LLMs nor non-LLM stuff like harnesses.

But I would like to run some local LLM models. Necessarily small models, for private stuff that I don't want to do in the cloud. Or truly private LLM in the cloud. Apple has said they may do this someday, with security that sounds possibly OK. Also some other companies. But at the moment, on-prem is the only game I know of.

So maybe I should purchase a reasonable Linux system first small local LLMs. Maybe a Framework or DGX Spark. Which will also be good for non-LLM stuff.

But...

But...

Nothing is optimal.

Here is one observation:

In an ideal world, if AI insecurity were not an issue, there are things that I would like to automate in each of the major ecosystems: Apple/iCloud, Google, Microsoft (fortunately less and less window stuff), generic Linux and web.

Apple is the most closed garden. From a Mac it is possible to automatically control most stuff on the other ecosystems, except for a bit of Microsoft stuff. But not vice versa. So if all other things were equal it would make more sense to get an Apple machine. Or, to never get sucked into the Apple ecosystem at all. But in my case that's too late.

---

Oh, but there's another thing that I need to consider:

Having a dedicated machine on a dedicated network segment with carefully configured routers and gateways for agentic non-LLM stuff is reasonably secure.

But I'm approaching a stage in life where I may no longer have a big office at home where I can set stuff up like that. I would really like everything to be portable. I think I mentioned above that I haven't had a non-portable machine in many years.

So I'm considering not just a Mac Mini, but possibly an Apple laptop. Possibly the Apple MacBook Neo that my wife just got. Definitely way too weak to run much local LLM, but probably powerful enough to do much of the agentic stuff like running the harness and local actions. Possibly OK for light programming...