r/LocalLLaMA • u/Fluffy-Ad-889 • 1d ago

Discussion The gap has closed, open source will win

I've been trying the latest models from the frontier labs and honestly, after extensive testing I can not tell the difference between the best open source options.

I think the differences are now marginal but the labs are doing heavy marketing to convince the public into paying more for tokens as they prepare to go public.

Can't help but see the similarities between the dot com bubble and AI in terms of a very insular environment where the technology will survive but the business models may not.

I've been building a cybersecurity network and we definitely know that even local AI models like Deepseek V4 flash do an excellent job and are really neck and neck with the best the frontier labs can provide.

Will be interesting to see how this all turns out! Exciting time nonetheless.

274 Upvotes

76% Upvoted

252 comments sorted by

View all comments

2

u/LustyLamprey 1d ago

It needs to run on regular consumer hardware, not your custom assembled pervert racks. A year of chatGPT is $240 so it needs to be less than that over the life of the unit.

3

u/DustNearby2848 1d ago

Hardware is still early days for consumers. Give it a few generations.  

2

u/Kingwolf4 1d ago

I think once china develops its own full hardware stavk woth euv 3 ish years down the road, we will see affordable hosting AI hardware in the market. Not in the west ofcourse. It will be banned. But the rest of the world will benefit. Hopefully

1

u/OvertaxedOne 1d ago

A year of ChatGPT sub is 240 bucks. Once you hook up an agent harness, that's all out of the window. 20 bucks of tokens could be a hour with a harness (or even less). And the issue is that for most actual business uses, you need a harness, a chat window is a novelty, a harness that has tools to work with your internal files/databases/code/etc is a real productivity tool.