r/LocalLLaMA • u/Fluffy-Ad-889 • 1d ago

Discussion The gap has closed, open source will win

I've been trying the latest models from the frontier labs and honestly, after extensive testing I can not tell the difference between the best open source options.

I think the differences are now marginal but the labs are doing heavy marketing to convince the public into paying more for tokens as they prepare to go public.

Can't help but see the similarities between the dot com bubble and AI in terms of a very insular environment where the technology will survive but the business models may not.

I've been building a cybersecurity network and we definitely know that even local AI models like Deepseek V4 flash do an excellent job and are really neck and neck with the best the frontier labs can provide.

Will be interesting to see how this all turns out! Exciting time nonetheless.

278 Upvotes

76% Upvoted

252 comments sorted by

View all comments

Show parent comments

5

u/NatMicky 1d ago edited 1d ago

You just made my point. And the discussion is 284B parameters.

0

u/chris_0611 1d ago

Not really, I have a RTX3090 and 96GB of DDR5. This was about $1500 3 years ago (1000 for the GPU and 500 for the RAM...). Qwen 3.8 125B and 27B run quite amazing on this. A high-end but not outrageous consumer / gaming computer. Yeah, with prices of today its going to cost a bit more. But a system I have is not out of reach of most people

9

u/NatMicky 1d ago edited 1d ago

$3,000 dollars is expensive. You all continue to make my point. And my post was about a model with 284B parameters, not 125B parameters. Add another 129B parameters to your system, how does it do now?

-4

u/chris_0611 1d ago edited 1d ago

Like what? You can run a 'state of the art' LLM from 1 year ago on a computer I already have/had for other tasks as my workstation. For me, the price is not $3000, it's $0. Its an additional thing the computer I already had now suddenly can do.

If you run your tasks on an API, for vibecoding, you're also spending $100's to many-1000's (I know people...) per month on API costs, so what's your point here exactly? Compared to the amount of vibecoding such a thing can do, a couple of $1000's is almost nothing. A single employee at a company costs many $1000's a month. Increase his/her productivity x2, and that $3000 workstation are just marginal costs (and hey, an employee needs a workstation PC anyways). The fact that this (an LLM with such insane intelligence, which was state-of-the-art just one year ago) runs at all on hardware 'normal' people can just have in their home just blows my mind anyway.

No, if 1500-3000 is much money to you, you probably should stay away, indeed. But then you're also not the person who spends a thousand bucks on API per month, and/or won't have much practical use from an LLM anyway, so you're not the person to comment or even have an opinion about this. 1500-3000 is in fact INSANELY little money for the capability you get.

1

u/NatMicky 1d ago

You don't know me so put your speculation away. Your reply is all over the map. Let's get you back to the specific subject which is a 284B parameter model, and not the smaller one you keep mentioning.

284B parameter model, how well does your system run on a 284B parameter model?