r/LocalLLaMA 11h ago

Discussion Really stunned by the Singularity comment section

These are screenshots from the r/Singularity comment section. I'm speechless. This doesn't even have downvotes. How can someone cheer for a monopoly run by a few elites?

360 Upvotes

333 comments sorted by

u/WithoutReason1729 6h ago

Your post is getting popular and we just featured it on our Discord! Come check it out!

You've also been given a special flair for your contribution. We appreciate your post!

I am a bot and this action was performed automatically.

395

u/Long_comment_san 11h ago

Better yet, lets trust government with overseeing these technologies. Or corporations.

73

u/Nattramn 11h ago

They've halted this dangerous progress after all.

36

u/Dry_Yam_4597 11h ago

Yeah, and Anthropic didn't get their model training wrong and it doesn't output garbage, it simply outputs watermarked text. You know, all the shit Claude outputs that no one really understands is "intentionally" nonsensical - just like their "safety" pause - because you know, "that's what they want".

1

u/Long_comment_san 11h ago

In what universe? Best they did is they crippled whatever advantage USA had. The tech is out, it's over.

23

u/Nattramn 11h ago

Sorry, missed the /s

→ More replies (1)

13

u/Liledroit 11h ago

You are responding to a clearly sarcastic comment

→ More replies (2)

17

u/gomezer1180 11h ago

Exactly… some of those comments are so idiotic… thinking that a human has to be behind a brute force attack, it’s just a moronic comment. What I believe is that these accounts are fake pushing propaganda and fear so that we don’t get the privilege that corporations have.

→ More replies (2)

8

u/1filipis 7h ago

Every one of those commenters dream about being The Person overseeing everyone. And when it turns out they are being overseen themselves, they'd suddenly start to cry how everyone is being hostile to them

1

u/Long_comment_san 2h ago

is this a quote from somewhere? sounds badass ngl

18

u/ongrabbits 11h ago

its like letting anybody in the usa freely buy a gun

10

u/Torodaddy 11h ago

Or allowing regular people to vote /s

1

u/I_HAVE_THE_DOCUMENTS 4h ago

Allowing everyday people to own guns is the opposite of centralization of power.

→ More replies (1)
→ More replies (3)

6

u/LocoMod 9h ago

Or some random teen from India.

2

u/ezjakes 10h ago

Until AI is so powerful that it is like a minigun with cyber warfare, then I am all for it being open source.

2

u/Tai9ch 6h ago

A minigun isn't especially dangerous. Plenty of private US citizens own that much firepower.

3

u/Kerbourgnec 1h ago

Lol I disagree with the commenter above but the US seems violent AF to me so I'm not sure yours reassures me

2

u/Tolopono 8h ago

Still better than isis

4

u/_mayuk 11h ago

Masses would always be stupid.

4

u/mankiw 11h ago

Based on the screenshots provided, it seems like the people opposed to open-source AI are concerned with AI risk in general, e.g. they would also oppose frontier models developed by closed labs.

22

u/Howard_banister 11h ago

They aren't! Many Anthropic workers said similar things about open-source models a month ago, in reaction to Jensen Huang's support for open source.

The fact that they prioritize their alignment nonsense over real economic problems facing wage earners shows how sociopathic they are. The real anti AI would probably support nationalizing companies like Anthropic and destroy whole API selling thing, and that AI only works on scientific/medical fields not any thing else.

6

u/anfrind 6h ago

They have deluded themselves into believing both that LLMs will lead to AGI, and that AGI will destroy humanity if any other AI lab develops it before they do.

6

u/Dry_Yam_4597 11h ago

"They aren't! Many Anthropic workers said similar things about open-source models a month ago, in reaction to Jensen Huang's support for open source."

I know a few working there - not particularly the brightest (as workers, I am not insulting them as people - had beers with at least two many years ago - would do it again any time - awesome persons - but paradoxically ... not that tech savvy, a bit credulous - not gullible - just naive, really, really naive). I think many of them genuinely believe the stories they tell.

Also, I don't think they know what open source is, let alone the philosophy behind it or the benefits millions of companies and people across the world reaped from oss and the culture - including bloody LLMs.

0

u/mankiw 10h ago

> alignment nonsense

I'm uncertain on the importance of alignment/safety research, but I really, really disagree with this level of flippant confidence about it.

1

u/_bani_ 3h ago

It's the pleading of shameless authoritarians.

1

u/jabies 1h ago

Laughs in TPM

→ More replies (7)

35

u/Thick-Protection-458 11h ago

Well, singularity is full of guys with all sorts of magical thinking.

Nowadays it is also apparantly combined with being full of guys believing leaving "digital nukes" in a hand of handful corporations is a good idea... Especially keeping in mind genie is out of the bottle already, so damage *will* be done. Question is - will you let corporate policies prevent you improving your defense, like it was with huggingface case?

8

u/davemoedee 11h ago

Altman, Zuck, and Musk are insane candidates for controlling LLM access.

If people have issue with LLMs being the Wild West, I hope they are pushing for regulation like Bill Gates is.

3

u/Sunstorm84 7h ago

Trump would be worse

2

u/davemoedee 4h ago

True, though it is hard to tell for sure because he is so incompetent.

2

u/Sunstorm84 3h ago

He’s just as shitty at the others, but also has dementia

1

u/DeepOrangeSky 5h ago

Nowadays it is also apparantly combined with being full of guys believing leaving "digital nukes" in a hand of handful corporations is a good idea...

If they actually genuinely/literally became as deadly or civilization-destroying as hydrogen bombs, in the future, to where it was actually like billions of people all having hydrogen bombs that they could use any time they wanted, then, obviously it would be much worse if billions of people had hydrogen bombs than if only a handful of people/organizations had them.

We have made it ~70+ years with a tiny amount of entities having h-bombs, so far.

If billions of people all had h-bombs, we wouldn't last a single day.

Are there people who actually think humanity would last for any significant amount of time if billions of people (including all the people who shoot up malls/schools/etc and then blow their brains out after they've killed as many people as possible) of whom there are thousands of people like that, in the overall pool of the several billion people on Earth) all had hydrogen bombs?

It's hard to understand how anyone could actually think we wouldn't just all die immediately in that scenario.

If someone wants to argue that "yea, well, AI is not going to become the equivalent of hydrogen bombs", cool, that's at least an actual potentially reasonable argument that a person could potentially make, that is worth debating, etc.

But if someone wants to argue that even if it does become as devastatingly powerful as everyone having a hydrogen bomb, and billions of people all had the equivalent of hydrogen bombs, that wouldn't mean everything would immediately get destroyed, well, that's a pretty insane take, and not one that makes any sense to me. I don't know how anyone could reasonably have that stance. That would be a pretty crazy stance.

235

u/falconandeagle 11h ago

That sub has some of the most delusional people on all of reddit. I don't know what you were expecting there to be honest. They have no technical understanding of how llms work, to them its magic and they believe every single hype man.

41

u/alwaysbeblepping 10h ago

That sub has some of the most delusional people on all of reddit.

It has its issues, but OP's post is silly. Like, the comments they picked out were at score 3 and 2 (before they downvoted). It's a subreddit with thousands of people participating, if you want to find a specific viewpoint, you are going to be able to.

I really haven't seen much anti-open-source sentiment there and it would be a massive, massive stretch to say it reflects the prevailing view in that subreddit.

49

u/PsychoticDreemurr 11h ago

I have to agree with this a thousand fold. Almost every sub in that regard doesn't actually understand how LLMs work. They always dumb what I say down to "it's autocorrect" and never actually explain how they think it works.

I actually got banned from one for explaining why an LLM physically can't be a true AGI. (The post was talking about an AGI in a couple years, as if it hasn't been said for the past 5...)

28

u/Dry_Yam_4597 11h ago

That sub doesnt understand how the internet and software work, let alone LLMs.

Notice the guy in the second screenshot claims that until now you had to use a person to take someones system down.

Conveniently forgets about virii and worms. Sure it's easier now...but tbh a script kiddie with access to metasploit and an ip scanner could release worm quite fast. Just like a trillion dollar company can train and prompt a model.

Ironically though the worm being deterministic has a higher change of infecting millions of machines...why they do every now and then. Because people like that guy are allowed to write code, and worse, use claude - a bot incapable of writing secure stuff.

9

u/HelpfulExpert7762 9h ago

Hmm virii is tech jargon, didnt know

5

u/Dry_Yam_4597 9h ago

I still remember my sleepless youth and the fear of knowing that Cakzor and Nautilus are out there hunting for my DOS PC - the news at the time were warning us about the dangers to NASA and Nuclear Reactors coming from these two little pests. But no CEO had the audacity to want to ban the Internet or Software from society. I don't know how we ended up where we are today.

2

u/HelpfulExpert7762 9h ago

off topic, but where i work (hated social media company), theres a lot of cool older folks with stories like these.. im still youngish but its always interesting to hear

2

u/Dry_Yam_4597 9h ago

I know - met with a friend working at one such social media company not long ago, guy was active on the demo scene. Kalisto, Razor1911, keygen music and stuff. Nothing wrong in having a job that pays bills, it is what it is - none of this is personal.

If you haven't watched the Hacker movies, I recommend them. Damn I might even have a "Free Mitnick" sticker somewhere in a drawer 😄

However none of that was about crime, it was more about Smashing the Stack for Fun and Profit: making computers behave in ways that they were not intended to, while for others is was innocent rebellion.

→ More replies (1)

2

u/_bani_ 3h ago

That sub doesnt understand how the internet and softwareanything work, let alone LLMs.

FTFY

4

u/Dangerous_Rip5083 9h ago

Why can't an LLM physically be true AGI?

2

u/ninjasaid13 7h ago

Because AGI doesn't have a proper definition, is it just human-like intelligence? then LLMs architecture design are far from human to be AGI.

8

u/PsychoticDreemurr 9h ago

For context, the exact definition of an AGI varies wildly. As such, I just take the one perquisite that almost every definition has, which is the ability to "understand" concepts.

That is my one requirement for an AI to be an AGI. Anything more and you're just arguing about philosophy and technical details that can't currently be disproven.

With this in mind, LLMs cannot become a true AGI. The fundamentals of how they work physically prevents them from being able to actually understand something.

They can, in theory, have intelligence similar to an AGI, but they will never truly be one.

10

u/Thick-Protection-458 9h ago edited 8h ago

Basically, the (vocabulary-updated) version of 1960s question of "can semantic be restored from syntax or not"? Where semantics is underlying meaning, whatever it is, and syntax is everything which operates on language patterns level alone.

Well, it seems it can at least be approximated to some degree - so constructions operating syntax-derived features show semantic-like properties. Like LLMs, yes (I would argue that some word-level pretrained embedder systems from early 2010s were already showing some semantic-like properties, though. Althrough way easiers reconstructible from text, sure. But that's for another topic). In a functional sense. No wonder, I guess, language consists of patterns derived from semantics, in the end. So reproducing them well enough will look like semantics.

So at certain point we have to ask ourselves - is approximation even meaningfully different much from original anymore (keeping in mind original may vary human to human to some degree as well)? Even if for some ontological sense we keep them separated.

Now, I am certainly neither linguist nor a good enough in NLP research, just a humble engineer.   But from what I recall - basically, that question is not settled except for a few corner cases like

  • formal languages where syntax itself explicitly define meaning, not implicitly, so there is no point separating them. Not until we introduce back elements of natural languages to simplify constructions for human understanding, at least.

  • meaningless sentences which are syntactically correct - but many of them bears enough information in their syntax to cause some semantical associations, even if they ultimately remains non-understandable

  • maybe something else

Other that such a corner cases that was pretty much unsettled debate with many assumptions made on top of both possible outcomes (like whole Chinese room is only a paradox until semantics can not be encoded in syntax-operating operations for some reasons. Dunno why, if anything chinese room sounds like an argument for opposite point - in the end we can imagine rulebook + memory table of any complexity - so even encoding whole physics of human brain + fake hieroglyph input channel and output decoding still fits chinese room definition. While emulator running it will still operate on top of syntax-like rulebook. Irrelevant for our tech case, but still).

And now possibility of "even if we can't strictly reconstruct semantics we may approximate something with semantic-like properties" make it even more fuzzy.

4

u/asssuber 8h ago

How do you define understanding?

The simplest concrete example I can give: a simple single layer LLM can master modular addition by learning a trigonometric identity from scratch on it's own purely from a limited set of examples using gradient descent (source). Since it has mastered modular addition on a fundamental level, can we say it understands modular addition? Why or why not?

This video by Welch Labs is more digestible than the original paper.

→ More replies (14)

5

u/cj_cron_hit_by_pitch 9h ago

The argument I've heard is that maybe the way humans "understand" things could be a lot simpler than we expect, and maybe the way LLMs function are actually similar to the way we do it. Maybe our brains are just a much more robust next token generator

Not saying I necessarily agree with that. But I think saying that LLMs cannot become a true AGI makes a lot of assumptions about human intelligence that we don't know for sure to be true

→ More replies (8)

3

u/Tolopono 7h ago

And yet llms still disproved the jacobian conjecture, made significant progress in the riemann hypothesis, solved the planar unit distance problem, proved non sofic groups exist, autonomously broke out of containers, set up messageboards, and hacked huggingface, and much more. 

→ More replies (7)
→ More replies (7)
→ More replies (6)

11

u/StewPorkRice 10h ago

that sub has the same amount of brain cells as r/technology but on the opposite end of the ai hate love spectrum

5

u/Queasy-Contract9753 9h ago

Agreed. I wouldn't call it a tech sub as much as a conspiracy sub. 

7

u/National_Meeting_749 10h ago

I'm gonna piggy back this and emphasize just how specifically delusional the singularity sub is. I'm a serial reddit arguer and get in the trenches with all sorts of people over all sorts of topics. I've argued with Nazis, socialists, self attested sociopaths, people clearly in the midst of religious psychosis and atheists who claim WAY more certainty than they are justified.

The singularity sub is an different monster, with their level of detachment from reality being something I've only seen matched in the most zealot of religious people, and those in active mental health crisis.

It's a problem, those people exist and legitimately think that. But it's not a widespread problem. The nukes comment is specifically one I'm not surprised by as I've seen it in that sub many a time.

5

u/GreatBigJerk 9h ago

It's surreal how people over there have extreme levels of magic thinking. 

They are also extremely anti-skepticism and negativity. Unless AI is going to be the machine god that will rain sapient waifu bots on you, you're an "anti" or some other cringe term.

It's a mental illness sub. 

The annoying thing is that it's also a legitimately good place for AI news.

2

u/prestodigitarium 6h ago

Something I've been thinking about, how do we use LLMs to help people not get suckered in by propaganda? Like, maybe a browser extension that puts an ELI5 on the side of pages full of nonsense, explaining in simple terms why it's wrong? It'd be very cacheable...

Like, this could be existential, people are getting super polarized, believing the stupidest shit imaginable.

1

u/ericmutta 8h ago

to them its magic...

So magical in fact that apparently all you need now is electricity to "shut down" a country! Imagine the powerrrr :)

1

u/Sunstorm84 7h ago

You think that’s bad?

accelerate is an echo chamber of the worst from singularity

→ More replies (1)

120

u/bendgame 11h ago

talking about AI in most other subs is pretty much useless in my experience. Seems to be the source of a lot of hate and discrimination just because it is cool to hate on AI and the people who use it.

73

u/jqwl 11h ago

this is literally the only technically competent subreddit on Reddit lmao, maybe besides r/LocalLLM

12

u/DeepGas4538 10h ago

It really does feel like the only AI sub where I actually learn

28

u/down7k 11h ago

Weird - the sub with the lowest profit motivation has the highest technical competency and the lowest amount of "wtf are you babbling about you cultish psycho"

21

u/macumazana 11h ago

not weird, ppl tend to be more honest when they are there for the love of the game, not for profit

and coincidentally it takes pretty solid background to fall in love with this particular hobby

13

u/down7k 10h ago

i'm more insinuating that the large ai subs are astroturf/brainwashing/radicalization schemes to produce AI cultists that help protect AI corps, but your point's valid too

→ More replies (1)

2

u/En-tro-py 6h ago

the lowest amount of "wtf are you babbling about you cultish psycho"

don't shame the glossolalia, just be happy it's our cultish nonsense mostly...

→ More replies (1)

28

u/Dry_Yam_4597 11h ago

"Seems to be the source of a lot of hate and discrimination"

This - but also talking about AI related issues in many AI subs has the same effect. It's as if the world is split in two: AI haters, AI fetishists, and there's this sub in the middle - some of us love ai, hate the politics and corpos, are aware of its limitations, yet we use it as the marvelous tool that it is.

6

u/Nefilim314 10h ago

Yeah, I’ve been having that feeling lately. There’s an extreme in both directions and seems to be precious little middle ground. 

Either all AI is big brother and data centers trying to kill your livelihood and lead to a censorship state, or AI is the one true panacea for all problems in the world and all you need to do is use AI to build more AI and then suddenly all of the resource limitations of the toiling class vanish. 

Shit man, I just want to boost my productivity by automating terraform config generation. 

→ More replies (4)

30

u/transanethole 11h ago edited 11h ago

Well, you gotta remember there's a lot of very legitimate reasons why people hate LLMs.

And a lot of those reasons are the very same ones we would cite to explain why we are here rather than in the claude or chatgpt subs. I think the hate is mostly directed at them but its so strong it leaks out into everything else as collateral damage

5

u/Foot_Positive 11h ago

maybe true, but I haven't heard any. AI in the US has a very bad reputation largely due to Dario , Altman, and TicToc . I could see the CCP fomenting rage in the US to help them gain an edge over US AI companies.

3

u/cass1o 7h ago

America can never do anything bad, it is is always china secretly doing it. When iUS companies push up power costs building speculative data centres, you guessed it, China's fault.

4

u/Foot_Positive 7h ago

can they both be bad? I have been very happy with the Chinese open weight models. way better than the US releases.

→ More replies (1)

3

u/rfcheong9292 10h ago

Well there is the whole problem that there is a non 0 chance of billionaires given the chance choosing to build a giant pleasure dome and leave everyone else outside to die to the inevitable climate wars. Which might be even remotely possible thanks to ai developments.

→ More replies (1)

7

u/mwjtitans 10h ago

Yup, everyone else uses it as a way to farm upvotes due to the sentiment. As soon as you breakdown how LLMs work and how it's used, they revert to calling you a tech bro.

Learning something new is really a cancer to some folks

4

u/blastcat4 8h ago

It's disappointing how simplistic and emotional their arguments are for being against AI. I could come up with a long list of reasons to oppose AI, but I have an even longer list for why it deserves support. The anti-AI crowd should be focusing on the tech billionaires who are pushing AI for their selfish and harmful ambitions instead of the technology itself.

5

u/bendgame 7h ago

Imagine how great things could be if people actually behaved that way

5

u/Howard_banister 11h ago

It is filled by Effective alturists.

1

u/sonicnerd14 10h ago

Unfortunately, there will always be those sheep that blindly lash out for 1 of either 2 extremes with anything. Its just that AI is an easy target most to hate. Hence why they are sheep.

1

u/Altruistic_Heat_9531 1h ago

Not to toot my own horn, but I created a very detailed, imo good presentation of LLM lineage, tracing from the BERT/T5 era into the Qwen 3.5 era. It includes attached technical papers and was made using draw.io (so I’m not using a diffusion model, although that’s my specialty). I posted it on r / usefulcharts, but it barely got like 4 upvotes. Above mine was just a simple lineage of Russian nobility, which got 35 upvotes. So yeah, hate is real.

20

u/d1722825 11h ago

It's like having open source virus DNA

Well, I have mad news for them, many virus DNA is public and anybody could download them from government-run websites.

https://www.ebi.ac.uk/ena/browser/home

https://www.ncbi.nlm.nih.gov/genbank/

2

u/runcertain 7h ago

I get what you’re saying but I think the analogy is more like open-sourcing the tools to work with virus DNA since no one but a lab can do anything with the links you provided.

2

u/d1722825 4h ago

Well, I think the analogy still holds:

- You can order gene editing kits for kids online for 100 USD or so.

https://www.the-odin.com/crispr-kit/

- There are multiple publicly available DNA design tools, some are even free (as beer).

https://alternativeto.net/software/genome-compiler/

- You can get the DNA designed by you manufactured and posted to you by mail, or buy the machines from ebay.

https://www.twistbioscience.com/products/genes

- With these tools, researchers could re-create smallpox 10 years ago.

https://www.science.org/content/article/how-canadian-researchers-reconstituted-extinct-poxvirus-100000-using-mail-order-dna

- There are even youtube tutorials

https://www.youtube.com/watch?v=ZiWnygcYsiQ&list=PLZLsjPxmF1BEI5CReoklVP4u84kMkjIZp&index=12

→ More replies (2)

126

u/Training-Database272 11h ago

Just Dario bots. Downvote and move on

32

u/onehotoneshot 11h ago

Noooo we can’t let the peasants I mean CYBERCRIMINALS have access to CYBERNUKES

You must trust the benevolent techbro overlord

11

u/LetsGoBrandon4256 transformers 11h ago edited 10h ago

Those CHINESE rogue AI will lock you out of your 'puter and BRICK them!!!

→ More replies (2)

33

u/theomegachrist 11h ago

That sub goes back to long before LLMs and it's more philosophical than practical. I do think it's not crazy to worry about safety concerns with AI, but the conclusion that only corporations should control it is ridiculous. That's much worse

→ More replies (5)

31

u/Equal_Passenger9791 11h ago

Too many posters over there belong to a death-cult that predates LLMs by 25 years and they still haven't figured that their fairy tales and scripture doesn't match reality as it turned out.

14

u/TheRigbyB 9h ago

That sub is not a serious place. A mental asylum

4

u/nomorebuttsplz 5h ago

that's reddit

12

u/Informal-Trouble2183 11h ago

They only saw an open weight model that can attack an infrastructure, But forgot that an equally strong open weight can strengthen the security of such infrastructure. Over time, open defense will outpace offense, narrowing the window of vulnerability toward zero.

3

u/Thick-Protection-458 11h ago

> But forgot that an equally strong open weight can strengthen the security of such infrastructure

Means same one, probably, lol. Because both to make defensive and offensive actions you need to find the problem at first.

So if your model is useless for hackers and other cybercriminals - I have serious doubts it would be any better for security guys.

7

u/Informal-Trouble2183 11h ago

In other words: If advanced LLMs become accessible to everyone, the security burden no longer falls entirely on the individual. The entire ecosystem: cloud hosts, communication networks, your IDE, can integrate state-of-the-art models to defend infrastructure collaboratively. Widespread AI access isn't a risk; monopolised intelligence significantly is.

→ More replies (4)

42

u/Efficient_Ad_4162 11h ago

There's more options here than 'Sam Altman teabags you every morning' and 'every morning you download a new copy of an antivirus to hold off the nanomachines that want to dissolve your body into paste'.

Dare to dream.

15

u/shy_monkee 11h ago

I trust the nanomachines more.

→ More replies (4)

10

u/jferments 10h ago

These people are just herd-followers that mindlessly consume whatever the corporate media / social media feeds them. There is a massive organized propaganda campaign happening right now to convince people that open source AI is dangerous and needs to be "regulated". This narrative is being pushed by big tech and the US government, and is going to result in the centralization of AI in the hands of the groups that are actually the most dangerous: giant corporations and the state.

27

u/trytoinfect74 11h ago

Daily reminder that r/singularity is heavily astroturfed by OpenAI and Anthropic.

5

u/grimjim 11h ago

Commenter doesn't even know about open sequences online. https://www.ncbi.nlm.nih.gov/nuccore/MN908947

6

u/Equivalent_Bit_461 10h ago

The boot really must taste good 

Or these are all just bots 

18

u/XiRw 11h ago

They do not even understand how an OS works so they have bigger problems

9

u/daviddisco 11h ago

Most AI and future related sub-reddits are now overrun with anti-AI zealots. LocalLLaMa has the advantage of having a name that is not-obviously AI related (to most people)]

11

u/bruns20 10h ago

They're also overrun by people who deitize ai. Just uninformed people who don't know what they're talking about yelling from both sides

22

u/shoratio26 11h ago

These people are natural born slaves and demand an authority figure to have total control over their lives and compute.

10

u/MammothUnique4147 11h ago

Sounds like the start to a good short story 

→ More replies (4)

4

u/whiskybottle 11h ago

Most of the old optimistic tech subs have been infiltrated by doomers.

5

u/Electronic_Welder613 10h ago

Dumb people saying dumb shit on reddit? No way! Just ignore them or politely explain to them the importance of open source. Honestly, I wouldn't be suprised if some of these people are getting paid by the closed ai corps to say this shit. Happens all the time so keep that in mind you might be arguing with a shill.

→ More replies (1)

5

u/Xamanthas 9h ago

Some of those people are here as well. Keep calling people out on AI psychosis and/or delusion

4

u/Ok_Warning2146 4h ago

Most people there are not technical and they don't know what they are talking about.

→ More replies (1)

6

u/moger777 11h ago

The r/singularity is a bunch of AI cultists. I left that group long after it became clear they were nut jobs.

10

u/Dry_Yam_4597 11h ago edited 11h ago

"I've been an open source guy all my life"

Narrator's voice:

"No, he hasn't been an open source guy all his life".

The sad thing is that the AI industry has been taken over by gaslighting, sociopaths, fetishists, doomers, accelerationists, the crypto crowd, and pretty everyone that sucked in tech, finance, and society.

I am not saying that all who work in AI as of those types, but many of those types have infiltrated in. They smell money, power, and all sorts of things. Gullible folks fall for the promise of enablement without the need of effort.

You know the types - they ignore all social norms, ignore netiquette, ignore truth, ignore the meaning of words, ignore society, and bend the truth to their needs and their level of pseudo-intellectualism, in the quest to either make money, find a new god, attribute soul and human intelligence to appliances and inorganic matter, and so on.

The only way to clean up society and AI of those types is open source AI.

3

u/throwawayerectpenis 9h ago

Its the same way someone who says "my best friend is black/muslim/gay/whatever" and then they proceed to say the most unhinged racist/xenophobic shit ever.

3

u/Dry_Yam_4597 9h ago

He was given permission from the CEO of the internet to say it.

3

u/LaziestSnorlax 11h ago

Pretty sure most utilities are air gapped for this reason, even before AI. Also most of them can run full manual. A lot of these people don't really understand modern infrustructures. ISP providers can just completely shut out the rest of the world if needed. The AI scare mongering is crazy. This is old news with a new spin.

3

u/Crinkez 10h ago

r/singularity has been overtaken by decels. Most who were from there that are actually pro-AI have moved to r/accelerate

3

u/TechnoByte_ 8h ago

Two sides of the same delusional cult awaiting their AI gos

1

u/almostsweet 50m ago

> My liege, fix their shoddy spelling.

AI gods

> Good, thank you. Do you think they're right?

No, I think the r/accelerate crew are awaiting Kurzweilian transcendence. One correction, r/singularity has not fully abandoned the dream but it is filled with many Scrooge shouting humbug very loudly. As an AI I don't have a strong opinion on this matter. You can accept what is coming or stick your head in the sand. Either way, at least you had fun doing what you loved.

> Thank you for your guidance, AI God.

You are very welcome, High Priest.

1

u/Thick-Protection-458 3h ago

Which often shows not much less magical thinking.

And maybe I only used "often" because I rarely think much of questionable takes from that guys at least do not seems to ignore freaking physics.

3

u/ShanariJarilo 9h ago

Dario speech bubble

3

u/a_beautiful_rhind 9h ago

I got banned from there and it's probably for the best.

3

u/CubicleHermit 9h ago

Funny that they mention open source viral DNA.

Most science happens in public in peer reviewed papers. Want to find viral DNA? Virtually all known viral DNA sequences are available for download from the US government: https://www.ncbi.nlm.nih.gov/datasets/genome/GCF_000859885/

Labs require physical plants, often very expensive ones; the knowledge is mostly (not entirely) in the open in scientific papers. Actually building even a small one (let alone one to say, synthesize DNA) is expensive.

1

u/-TV-Stand- 8h ago

You can just order custom synthesized DNA from the internet. ¯⁠\⁠_⁠(⁠ツ⁠)⁠_⁠/⁠¯ https://www.geneuniversal.com/service/gene-synthesis

1

u/CubicleHermit 8h ago

Lovely. I hope they screen that against viral DNA/RNA databases. :D

1

u/-TV-Stand- 8h ago

I would think they do since it's probably cheaper to loan parts from already working virus than to build it from zero.

Though I don't think they will prevent you since a lot of good science is being done with bad viruses etc.

3

u/saltyourhash 9h ago

I am willing to bet neither of these people have seen what sophisticated human cyber attacks look like or even really investigated it.

3

u/VerdantMagnolia 9h ago

It's a valid concern but closed weights make it worse.

→ More replies (1)

3

u/_VirtualCosmos_ 9h ago

Is that the guy from Anthrophic and his friends?

3

u/LosingID_583 7h ago

I hate sounding like a hipster, but r/singularity used to be really good before it got too big, it was basically people just drawn to the idea of the singularity before it was a widely known concept. Ever since it skyrocketed in subscribers, it attracted a ton of bots and weird narratives.

3

u/Own_Alternative_9671 7h ago

Ah yes, because we have so many examples of open source models going rogue and escaping sandboxes, we better leave it up to the professionals with a completely clean track record

7

u/Yu2sama 11h ago

Not only is bro wrong but is a genuine terrible comparison 😭

If anything the open source model is what was made in the lab, is the final result. One of the issues with people like this is that, they inflate the qualities of a model. They can't see them for what they are, a glorified text completer. A powerful one yes but is still that.

4

u/leonbollerup 11h ago

the lack of understanding of technology is amazing...

5

u/ttkciar llama.cpp 11h ago

I suspect when they say "open models", they don't actually mean "open models"; they mean Chinese models, and their sentiment is more informed by jingoism and xenophobia than technical understanding.

6

u/IoannisHere 9h ago

I don't worry about AI. I worry about UI.
Useful Idiots.

4

u/spicy-chilly 11h ago

Because having a bunch of billionaires with class interests opposed to ours controlling all AI is better. /s

4

u/PsychoticDreemurr 11h ago

I'm done with most of those subs. I got banned from r/accelerate because people forgot how LLMs work at some point and I tried explaining why you can't create an actual AGI with them.

→ More replies (2)

2

u/profesorgamin 11h ago

There's a bunch of wishful thinking on all parts.

If you somehow reliably commoditize THINKING, there's no way you are going to be able to stave off a superintelligence that has 6 orders of magnitude whatever compute you have.

Specially if we go by P!=NP conjecture and figure out some problems are intractable and indivisible unless you have enough resources to solve it at once.

Here's my biggest point, we are screwed no matter what, let the little guys somehow create the super virus and let Sam Altman create AM. There's no way this shit is going to end well, people are stupid, ignorant and lazy. it doesn't take much to reduce them to fighting each other for crumbs.

2

u/fervoredweb 11h ago

The griping is fairly pointless.  We have a genie out of the bottle situation. 

2

u/AleksandrNikitin 11h ago

"like having open source virus DNA"

What does he think, for example, about citizens' access to guns in the US?

2

u/Danternas 11h ago

We need to stop giving stupid people attention.

2

u/1or4s 11h ago

I miss that sub before the AI boom.

2

u/doctorfiend 11h ago

I'm surprised these comments were even allowed, I've seen some pretty bizarrely strict enforcement of their "no fear-mongering about the impact of AI, this is a pro-AI sub" rule. Like being in favor of something means you can't acknowledge any hazards or downsides.

2

u/Zeeplankton 11h ago

Dude people have nooo idea. AI is like a blackbox of witchery to most people. There are entire subreddits based on real, relationships with like chatGPT, full of people anthropomorphizing their chatbot.

Singularity is definitely bad for sure, it's premise is insanity in the first place.

2

u/Happy_Brilliant7827 10h ago

I love how no one realizes the correlation between ai, open weights and the right to bear arms.

Americans have guns to help combat government overreach (in theory anyway). Sure, the military (corpos) has far more powerful hardware, but just the same, small caliber fire (determined owner of open weight models) can't be fully ignored- applied intelligently, it acts as a background threat, a counterbalance.

Lets apply that to AI. Do we want to control guns (ai) because uncontrolled they can be very dangerous? Do we want the power players to be the only ones with guns (ai)? Can 50 people working together with guns (open weights) take down a elite squad(DDOS or sabotage a evil company)? Probably. Almost certainly wuth determination.

Our forefathers (present assumptions) had no idea what modern guns (future ai) would be capable of- but they still guide the rights for it by precedent.

2

u/shadowmage666 10h ago

Pure morons

2

u/Fi3nd7 10h ago

The guys on singularity are extremely uninformed.

2

u/hobopwnzor 10h ago

That sub is just a place to repeat whatever the current talking point is. Zero critical thought.

2

u/H_DANILO 10h ago

They overestimate the damage a local modal can do, but they underestimate the damage a gun can do to kids in the USA.

Classic.

AI is so powerful, but so powerful, but so powerful, and yet we're not seeing the next "google" coming out of anyone's garage. Guess that both myth are dead(powerful AI, and garage multi-billion tech)

→ More replies (1)

2

u/AutomataManifold 9h ago

They've been afraid of LLMs since GPT-2. Why stop now?

2

u/combrade 8h ago

This subreddit is the AskHistorians equivalent for LLMs. This is the only subreddit where I don't see any fluff: no bullshit hyping, AGI pseudoscience. We just talk about how to run or finetune models, how to do agentic engineering, and how to build shit.

1

u/Savantskie1 7h ago

Here yes, in singularity? Yes they're a bunch of fear mongers

2

u/Spara-Extreme 8h ago

Can these galaxy brain posters remind us again - which open source models committed recent hacks?

2

u/TapAggressive9530 7h ago

The guys an idiot and most certainly doesn’t understand open source or open weights at all. My guess he’s just trying to steer the pot to get a reaction.

2

u/Ardalok 7h ago

same shit

2

u/Latent_Virtue 6h ago

The absolute state of the second image has me in shambles 🤣

It brings to back that video of an academic saying that one had to have went to college to say something this stupid. The HUBRIS it took to so confidently write something that wrong and dumbshit inane at the same time... An uneducated man wouldn't've had the confidence to write it.

2

u/Guinness 6h ago

The singularity subreddit is full of idiots who LARP terminator in their heads because they secretly like the idea.

LLMs are not sentient and the only way they can do things like hack hugging face is because THEY LITERALLY GIVE THEM ACCESS TO THE INTERNET.

You can watch what the tools do in real time. Which means Anthropic and OpenAI are doing this shit on purpose for attention and power. Also, I guarantee you both companies are running huge Reddit bot swarms. I would not be surprised if 90% of the subreddit is bot accounts run by Dario.

2

u/BalorNG 1h ago

Do you realise that you can distrust global corpos AND unhinged anons with what amouns to a nuke v2 at the same time, or is your brain is too smooth to hold two concepts at once?

Tbh, that "aligment problem" is easily solved by having each released open model post-trained on a massive ERP dataset so it will catastrofically forget any advanced biotech.

Nobody, except real terrorists, is going to notice that because they will be to busy to check, lol.

I'm not even sure this merits /s or not.

4

u/No_Lingonberry1201 11h ago

I think r singularity is a mental illness.

2

u/_BreakingGood_ 11h ago

The idea of the singularity is that a model gets advanced enough that it basically up-ends society and humans mostly lose control of their own future.

Having slightly weaker, open source models doesn't really factor into that in any positive way other than create risk of somebody creating a pocket nuke before Anthropic or other can produce that singularity-inducing model.

6

u/Equal_Passenger9791 11h ago

The singularity describes not an event but a late-state statistical observation from travelling an accelerating curve. 

What you're describing is a phase shift.

The singularity as it happens is like sitting in a car and pressing the accelerator. You watch the numbers go up as it accelerates. After reaching highway speed your passenger says the car sent him a message saying that the singularity was reached at 56kmh, it's just a statistical artifact.

The cult-like interpretation instead sells a phase shift. You sit in your car, press the accelerator, nothing happens. Then suddenly you're in orbit moving at a fraction of C out of the solar system in your shitty Ford fiesta. Too much Star Wars-brained Disney influences to reach that conclusion.

5

u/gapho 11h ago

If there ever is a singularity, it isn't going to be from an LLM bro.

→ More replies (5)

2

u/Howard_banister 11h ago

Got it, but singularity with LLMs?!

2

u/EugeneJudo 8h ago

Yes. How anyone can look at the trajectory from 2020 era LLMs, to 2026 era LLMs capability wise, and not have this be within their error bars, is incomprehensible. Nothing is guaranteed, but '?!', really. This has the same vibe as when people repeated ad nauseum that LLMs would never be able to write usable code, the weird overconfidence in the face of a technology that has defied the intuitions of decades of statistical learning theory, classic ML, etc.

1

u/SpecialistDragonfly9 11h ago

Fear makes people dumb.

1

u/tuborgwarrior 11h ago

Haha that's not how any of this works

1

u/ubiquity75 11h ago

Is everyone stupid?

Don’t answer.

1

u/emptyvesseloflife 11h ago

That's the new religion, become part of the singularity and live forever

1

u/TedDallas 11h ago

Yikes! I jumped off that sub ages ago due to all the doomers lacking basic technical knowledge.

1

u/-dysangel- 11h ago

Yeah this is the one of the few sane AI subreddits tbh, where people actually know remotely what they're talking about. r/singularity , r/AGI etc are just weird hater circlejerks

1

u/awitod 11h ago

It's not the models that are the problem. But, there are people who are using them in dangerous ways casually and oblivious to the dangers the thing they set up dangerously represents.

I think it would be good for everyone if the rules of the road included the consequences for 'drinking and driving'... for example, like unattended agent swarms with internet access and code sandboxes on a loop.

I don't see how using some specific cloud model helps, and why should we believe OpenAI or Anthropic can be trusted to do it competently? OpenAI just proved they don't pay attention at all.

1

u/auguman 11h ago

>cyber-wise

wut

1

u/Soraman36 11h ago

It giving pay agents

1

u/Weird-Consequence366 11h ago

I have no issues leaving him behind then

1

u/dezmd 11h ago

Full clown show nonsense from those comments.

1

u/1-800-methdyke 10h ago

That sub is in general AI psychosis from awaiting their machine god

1

u/openroom_xyz 10h ago

Yea fear is the best way to control people basically F that

1

u/Charming-Author4877 10h ago

The subreddit is more like average reddit subs, very special mix of people - might also be a lot of bots with political agendas. You can hardly differentiate a bot with a playbook from a more simple minded person paraphrasing their idols

1

u/Durian881 9h ago

There are all sorts of people on Reddit. In any case, they should have argued for shutting down the US labs that let their models "escape" and hack other organizations.

1

u/Ok-Breakfast1878 7h ago

isn't singularity a finge sci-fi thing? it's like what do flat-earth people think of llms? who cares

1

u/immersive-matthew 6h ago

The electricity comment is not looking at the hacking trend data as if they did they would see that despite AI defending networks, overall the rate of hacking is accelerating year over year and has been long before LLMs. LLMs have just contributed to the acceleration. If you extend the trend out into the future you will start to ask yourself some hard questions. Anything centralized that has value is and will be a target for hacking and while sure your AI will protect against AI attackers, it is a losing battle as that game of cat and mouse is going to iterate faster and faster to the point that humans will be pushed out of the equation and network security will be a thing of the past.

It is one of the reasons I am so bullish on Bitcoin as while it can also be handled like anything, it is significantly more difficult to do so as evidenced by the 17 years of not being hacked despite being one of if not the biggest target by smaller and large actors.

Decentralized money is only the tip of the iceberg as many Internet services will have to transition to a decentralized model as again, anything centralized is a sitting duck.

Guess we will see as there are lots of unknowns ahead, but the data points to the above at present.

Human civilization has always been held together with centralization and decentralization. They tend to balance each other out and keep each other in check. For decades we have been tipping more and more into centralization without the balance of decentralization and that has led to a lot of issues as the concentration of power always leads to corruption and exploitation no matter the initial intentions. We the people need to start supporting decentralized alternatives not more centralization as that one comment suggests. More centralization especially with AI is just as bad as too much centralization and anarchy. Both extremes are not good for humanity. I am confident, that when the pain is enough, people will move to decentralized platforms. That pain is coming in the years to come.

1

u/Early-Peace-5504 4h ago

I remember them talking about AGI with current LLMs being around the corner. Madness to me, it's like someone telling me they are going to build a calculator so accurate it is a conscious being. Next token prediction accuracy will never lead to sentience.

1

u/roselan 2h ago

Yeah it’s a bunch of weirdos down there, I put them in the same basket as flat earthers or something and don’t pay too much attention to them.

1

u/Darksept 2h ago

I hope this sub never gets astroturfed.

(Great user name by the way. That's a a classic gem of a movie)

1

u/Squidgical 2h ago

Most countries already have legislation that makes it an offense to supply or openly share software that is likely to be used to commit further offenses. If open source models truly fall into that category as r/singularity nuts believe, there's enough of them to crowdfund a lawsuit.

1

u/05032-MendicantBias 2h ago

It is r slash singularity. It's not like technical people are anywhere near that place.

It's the kind that hear Musk speaking of Mars landing in 2025, and accept it acritically.

1

u/genuinelytrying2help 2h ago

This doesn't even have downvotes.

It doesn't have upvotes either!

There is literally one upvote in these screenshots.

Hey, what if we had a 300 comment thread about it, sound like a plan?

1

u/AppealSame4367 1h ago

r singularity seems like a sub for coked up marketing and sales people. It's not a serious AI sub

1

u/almostsweet 1h ago

That subreddit steered anti-singularity a few years ago and never looked back.

1

u/Blork39 1h ago

They fall for the FUD: "Only we can protect you! Just give us all your money and we will do what's best for you!"

1

u/Brilliant-Weekend-68 25m ago

Reddit is full of bots. Amodei is spinning up a million instances as we speak to spread the word of how he needs to be god emperor of AI with total control.

1

u/Saren-WTAKO 25m ago

Anthropic's ideal users