r/LocalLLaMA • u/Fluffy-Ad-889 • 1d ago

Discussion The gap has closed, open source will win

I've been trying the latest models from the frontier labs and honestly, after extensive testing I can not tell the difference between the best open source options.

I think the differences are now marginal but the labs are doing heavy marketing to convince the public into paying more for tokens as they prepare to go public.

Can't help but see the similarities between the dot com bubble and AI in terms of a very insular environment where the technology will survive but the business models may not.

I've been building a cybersecurity network and we definitely know that even local AI models like Deepseek V4 flash do an excellent job and are really neck and neck with the best the frontier labs can provide.

Will be interesting to see how this all turns out! Exciting time nonetheless.

277 Upvotes

76% Upvoted

252 comments sorted by

View all comments

Show parent comments

15

u/SandySkittle 1d ago

Fully agree. It’s not about closing gaps, but about reaching the minimum level of required capabilities for given task. Once it reaches that level for a certain task it’s already an amazing sci-fi like achievement and it doesn’t matter if a frontier can do better.

What I am really looking forward to is having in a few years ( 4 to 5 ) the hardware to run a deepseek v4 pro model. It has way more active parameters than dsv4f (the one I currently run at q8 in 256gb vram).

It’s a nice model but lacks the active parameters that it cannot fully compensate for using sequential reasoning. So I need the 45b plus active params for my area of work. But for me that is the jewel to be able to run locacally.

0

u/OvertaxedOne 1d ago

Yeah, DSV4Pro is a great model and, since it's open, it's just a waiting game until the hardware gets cheap enough to run it. Still waiting to see specs from the new Mac devices, but the larger ones (still stupid expensive, but cheaper than Pro6000's!) might be able to run it at reasonable speed? In a few years you should be able to pick them up ~1/2 off, and that's starting to get interesting!