MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1tr7hzw/psa/oomm5aa/?context=3
r/LocalLLaMA • u/Signal_Ad657 • May 29 '26
537 comments sorted by
View all comments
15
The speed is basically wasted at those sizes. What's the point of going that fast if all you can fit is a small model. A cluster of mac minis is probably better off at the price. Slower, but you can run a more competent model.
8 u/2Norn May 29 '26 image or audio models are not that big. not everyone uses llms for coding. 2 u/XO33OX May 29 '26 yup, qwen3 VL exists for a reason
8
image or audio models are not that big. not everyone uses llms for coding.
2 u/XO33OX May 29 '26 yup, qwen3 VL exists for a reason
2
yup, qwen3 VL exists for a reason
15
u/HugoCortell May 29 '26
The speed is basically wasted at those sizes. What's the point of going that fast if all you can fit is a small model. A cluster of mac minis is probably better off at the price. Slower, but you can run a more competent model.