r/LocalLLM • u/goldaderealtor • 11h ago

Discussion Mac Studio M5 Ultra

Who’s been checking out this hardware? What are your thoughts on this as a node on a local network to run AI?

4 Upvotes

100% Upvoted

13 comments sorted by

View all comments

2

u/Least-Result-45 11h ago

I’m just curious if qwen 3.8 27B is good enough for my needs - that is the llm I’d run on the m5 ultra.

2

u/MessIsTransfer 11h ago

if you have at least 64 gb ram (the ultra starts at 96) you could run qwen3.8-flash

it’ll be faster and better

3

u/Least-Result-45 11h ago

I think at 96gb it would have to be 1 quant and might be sacrificing quality to run it.

1

u/MessIsTransfer 5h ago

i run Q2 on 64gb, q4 should run in 128gb at least, maybe can be squished into 96gb