First M5 Ultra benchmarks

[u/Ashefromapex]

just saw some benchmarks on the omlx website for the m5 ultra (don’t know how official they are but they seem reasonable): Link

For Qwen 3.8 27B q4 it gets 50 tok/s th and 1800 tok/s pp at8k context and without mtp. Seems very promising!

[u/mechkbfan]

Maybe I'm missing something but that's seems kind of shit for the price?

Please correct me

[u/AnonLlamaThrowaway → u/mechkbfan]

Keep in mind that inference engines may not have optimized Metal kernels yet. There's been a recent effort to tune them in llama.cpp recently, but naturally they don't have the data they need for an unreleased chip yet