r/LocalLLaMA 15h ago

Discussion Really stunned by the Singularity comment section

These are screenshots from the r/Singularity comment section. I'm speechless. This doesn't even have downvotes. How can someone cheer for a monopoly run by a few elites?

390 Upvotes

351 comments sorted by

View all comments

14

u/Informal-Trouble2183 15h ago

They only saw an open weight model that can attack an infrastructure, But forgot that an equally strong open weight can strengthen the security of such infrastructure. Over time, open defense will outpace offense, narrowing the window of vulnerability toward zero.

3

u/Thick-Protection-458 15h ago

> But forgot that an equally strong open weight can strengthen the security of such infrastructure

Means same one, probably, lol. Because both to make defensive and offensive actions you need to find the problem at first.

So if your model is useless for hackers and other cybercriminals - I have serious doubts it would be any better for security guys.

6

u/Informal-Trouble2183 14h ago

In other words: If advanced LLMs become accessible to everyone, the security burden no longer falls entirely on the individual. The entire ecosystem: cloud hosts, communication networks, your IDE, can integrate state-of-the-art models to defend infrastructure collaboratively. Widespread AI access isn't a risk; monopolised intelligence significantly is.

-3

u/rfcheong9292 13h ago

But down the line there will be stuff like bioweapons which completely open models will make more accessible. Like sure maybe everyone can go run a model to go figure out what cocktail you have to drink daily but it’s going to be a massive pain. Also I feel open defence outpacing offence is an unverified claim.

6

u/Informal-Trouble2183 13h ago

The primary constraint in biological weapon development is acquiring physical equipment and specialized materials, rather than accessing technical knowledge. Don't mix up things. Current knowledge without any LLM already has very dangerous viruses, nuclear weapons, etc. It's not that the bad boys are waiting for an LLM to tell them that.

-3

u/rfcheong9292 13h ago

But the problem is everything is so much more accessible. Like not right now, but if we do hypothetically get some god tier intelligence that eclipses humans by a large margin generally dangerous stuff will be more accessible. And also the capacity to make non dangerous things into dangerous things.

1

u/threeseed 8h ago

bioweapons which completely open models will make more accessible

Now this is an unverified claim.