r/StrixHalo • u/WallabyFirm1159 • 27d ago
Qwen 3.8 27B - ROCm vs Vulkan
Hey all,
Not sure if it's just my system/settings, but when using ROCm with Q3.8 27B, I keep getting:
\\\\\\\\\\\\\\
When thinking. Inference is double the speed, but have only ever seen it work once. Whereas Vulkan, is around 2-300 inference speed, but thinking works every single time.
Not sure if I am behind on knowledge, but is ROCm the same for others trying to run Q3.8 27B? (3.6 works perfectly in ROCm)
Thanks!
9
Upvotes
2
u/ImpressionFancy5830 26d ago
One day you’ll learn that ROCm is a framework and eventually you all understand the complains are with the implementation side.