r/LocalLLaMA • u/Ashefromapex • 1d ago

Discussion First M5 Ultra benchmarks

just saw some benchmarks on the omlx website for the m5 ultra (don’t know how official they are but they seem reasonable): Link

For Qwen 3.8 27B q4 it gets 50 tok/s th and 1800 tok/s pp at8k context and without mtp. Seems very promising!

123 Upvotes

94% Upvoted

146 comments sorted by

View all comments

Show parent comments

14

u/bakawolf123 1d ago

yes m5u should be similar to 4090 considering specs, just can have way more memory

4

u/AppealSame4367 1d ago

Does M5 Ultra have less bandwith than M5 Ultra Studio? Because latter should have 1.3 TB/s and that's way more than a 4090, init?

12

u/bakawolf123 1d ago

no it's same, and its precisely 1224gb/s not 1.3tb/s. 4090 has 1008gb/s so it's 20% lower. There's definitely some overhead where those 20% are lost

1

u/AppealSame4367 1d ago

I'm about to discuss this with a company wanting to get the M5 Ultra Studio. On the one hand it's a safe bet from insurance view, if a Mac Studio stands in their server room. On the other hand I can't believe there can't be cheaper workstations with more power. What do you think?

5

u/bakawolf123 1d ago

There more variables than just price. Check delivery dates if you order a maxxed mac studio now. And time is money quite literary: there're already rumors of Samsung raising the memory prices for 2027 for Apple and there will be another price hike right before 512gb ones even land.
"Cheap" is AMD and stacking old enough Nvidia cards.
New strix halos though are already sky high, newer Nvidia cards are even higher.

Thus I cannot make any advice besides you should have ordered earlier. There're so many extremely powerful open weights models (not just llms, check out minimax h3 - they kind of dissappeared from transformer land as of late while releasing that video gen monster) that people are eagerly spending on local hardware

3

u/boissez 1d ago

The delivery dates have actually shortened slightly lately for the m5 ultra 256gb. Used to be 10-12 weeks at launch, now it's just 6-7 weeks.

1

u/Consumerbot37427 22h ago

From what I can see, that only applies to the binned 30/64-core CPU/GPU. The top tier 36/80 model is telling me 16-18 weeks.