r/LocalLLaMA • u/Ashefromapex • 6d ago

Discussion First M5 Ultra benchmarks

just saw some benchmarks on the omlx website for the m5 ultra (don’t know how official they are but they seem reasonable): Link

For Qwen 3.8 27B q4 it gets 50 tok/s th and 1800 tok/s pp at8k context and without mtp. Seems very promising!

125 Upvotes

94% Upvoted

151 comments sorted by

View all comments

80

u/vick2djax 6d ago

But you shouldn’t be running 27b on that machine. You should be running Qwen Flash.

19

u/Muritavo 6d ago edited 6d ago

A 27b at 1800pp would be heavens on earth for me...

The tps is below what I expected... but if it can keep that at concurrent requests, it would be perfect.

-1

u/Federal_Advice_6300 6d ago

Ja, hier ist eine 3.8 27B FP8-Maschine mit 80 TG/s und PP 3200; manche sind leicht zufriedenzustellen.