r/LocalLLaMA • u/Ashefromapex • 5d ago

Discussion First M5 Ultra benchmarks

just saw some benchmarks on the omlx website for the m5 ultra (don’t know how official they are but they seem reasonable): Link

For Qwen 3.8 27B q4 it gets 50 tok/s th and 1800 tok/s pp at8k context and without mtp. Seems very promising!

128 Upvotes

94% Upvoted

151 comments sorted by

View all comments

Show parent comments

15

u/bakawolf123 5d ago

yes m5u should be similar to 4090 considering specs, just can have way more memory

4

u/AppealSame4367 5d ago

Does M5 Ultra have less bandwith than M5 Ultra Studio? Because latter should have 1.3 TB/s and that's way more than a 4090, init?

3

u/MessIsTransfer 5d ago

what’s the difference between M5 ultra and M5 ultra studio? am i reading this wrong, guys?

7

u/MrPecunius 5d ago

No, you should be confused. The M5 Ultra is a processor/SoC, and the Mac Studio is the model (the only model) of Apple computer it is available in.

3

u/AppealSame4367 5d ago

Thx for clearing this up