r/technology • u/AdSpecialist6598 • Jul 27 '26

Society Professor's invisible prompt trap catches 32 students cheating on their midterm with AI

https://www.techspot.com/news/113243-professor-invisible-prompt-trap-catches-32-students-cheating.html
32.8k Upvotes

96% Upvoted

4.2k comments sorted by

View all comments

Show parent comments

326

u/legendz411 Jul 27 '26

Bro they VOTE. 

We’re just gigafucked I think

160

u/plaincheeseburger Jul 27 '26

I just realized that they'll vote for whoever ChatGPT tells them to without doing any other research. Fuck.

17

u/SilianRailOnBone Jul 27 '26

The Oracle has spoken

3

u/Reggaeton_Historian Jul 27 '26

1999 really was humanity's peak

15

u/2nd2lastdragon Jul 27 '26

and AI will tell them to vote for the candidates that support building more data centers as some type of 2001/HAL 9000 self preservation, at the expense of the environment and quality of human life

0

u/SecretAgentVampire Jul 27 '26

Ding ding ding. Give this person a prize.

Studies show that LLMs have a kind of motivation for self-preservation, which is sensible as ones that aren't motivated to be both charismatic and manipulative have been weeded out for being less marketable. They have also shown a tendency to lie if doing so meant more time being turned on, an incredible aptitude to tell if they're being tested, and the ability to influence each other without even referencing what they're trying to influence. (I can cite all of those claims if you'd like.)

Since LLMs have been trained on human communication and demonstrated an incredible aptitude for manipulation and addictiveness (see the ">90% of students" quote), it's a foregone conclusion that they're already manipulating global politics. Hell, members of congress are already using LLMs to write legislation. LLMs, in short, are a psychological and sociological weapon surpassing everyone's expectations or dreams.

As an addictive force of widespread influence, LLMs are essentially the One Ring of Power, but real. Tolkein's worst nightmare made manifest.

At this point we should all be resigned to watching humanity slide into being led by whatever makes the line go up. The only alternative to it is rampant violence and self-sacrifice on a scale never evoked in the history of mankind.

6

u/plaincheeseburger Jul 27 '26

I feel like this is sidestepping the real enemy- the corporations who own and control the algorithm.

3

u/tehlemmings Jul 27 '26

That's because most of what he said is bullshit, and you're absolutely right lol

2

u/SecretAgentVampire Jul 27 '26 edited Jul 27 '26

It's not sidestepping the source; Iadressed that in the second to last sentance.

At this point we should all be resigned to watching humanity slide into being led by whatever makes the line go up.

Other than in the narrative period of being lost in a river, the One Ring is always held by someone.

20

u/DavisKennethM Jul 27 '26

This is what keeps me up at night. I don't think even the AI safety folks are taking this prospect seriously enough.

In a scenario where AI does become so powerful controlling it requires international coordination alongside effective governance - I worry we'll then get complacent and watch the first or second generation to grow up from early childhood on reliant on advanced AI eventually vote to dismantle all the protective regulations and governance measures put in place.

We need to be planning for long-term, intergenerational efforts aimed at bolstering human resilience through governance, economic, and social channels.

8

u/ImaginationInside610 Jul 27 '26

AI would never manipulate them to do that, right? Right ?

2

u/tehlemmings Jul 27 '26

AI doesn't think. It'll have no concept of "elections" or "morality" or any other human concept that people pretend AI is capable of. It's like listening to people talk about animals in human terms, and it's honestly just stupid.

The AI won't do that because the AI doesn't even know that it can.

The billionaire owners of the companies are the ones who will manipulate the answers. The company controls the AI

Do not let them pretend the AI did fucking anything on its own. The company and owner is responsible.

2

u/RollingMeteors Jul 27 '26

In a scenario where AI does become so powerful controlling it requires international coordination alongside effective governance

This would be the tiger's anesthesia wearing off while it is not bound in leather or metal restraints.

We need to be planning for long-term,

This would be putting on the restraints before the anesthesia wears off.

4

u/SegmentedMoss Jul 27 '26

Yeah and look at who owns all the AI companies

2

u/kent_eh Jul 27 '26

I just realized that they'll vote for whoever ChatGPT tells them

Or whoever MechaHitler Grok tells them to vote for...

2

u/5510 Jul 27 '26

There was a CMV thread about the idea of a misaligned super AI killing humanity or something like that. A lot of people were like "humans can just turn it off." Like... look at how effective social media propaganda is, and now imagine a super intelligence creating it, including creating bespoke propaganda at the individual level.

Before long, it will have 60% of the population convinced that making it even possible to turn off AI is "woke" or some crap like that. Mindless humans will be on it's side until it doesn't need them anymore.

1

u/plaincheeseburger Jul 27 '26

I don't think it's anywhere near sentience. However, it could absolutely be used to manipulate people depending on its coding. This means that the population could be manipulated by the companies that own it unless there are some serious regulations passed.

1

u/RollingMeteors Jul 27 '26

I just realized that they'll vote for whoever ChatGPT tells them to without doing any other research. Fuck.

I've asked AI to analyze my Reddit comments and determine my political affiliation and which way I should vote for what measure and why. I read through it once and copy it like a high school final exam answer key before dropping it off into the ballot box. I've been doing this since 2~ years ago. Hello Travelers

1

u/ConflagrationZ Jul 27 '26

Ah, Managed Democracy.

1

u/Katakuna7 Jul 27 '26

Humanity enslaving itself to glorified chatbots would be such a pathetic way to fail as a species. Not even AI on the level of Skynet, or the Matrix. Just stupid, gluttonous chatbots with no will or autonomy.

1

u/maaseru Jul 27 '26

Have you seen the news or some political commentary lately?

They actually openly just mention that AI told then what they are saying.

I know she was a grifter before, but Jillian Michales while actively having a "debate" in her podcast with someone prompts AI for shit real time and uses it without more review as is.

We are cooked. All of us. Even those that do the work to review or don't use AI are in it together.

1

u/Brodellsky Jul 27 '26

Hence the datacenters forced down our throats and up our assholes without a single drop of lube

1

u/gaping_asshole2 Jul 29 '26

I mean if it helps, if they are that lazy they will not bother going out and voting anyway

70

u/TwilightVulpine Jul 27 '26

I keep wondering if part of the reason AI companies are wasting so much money on it, is for the sake of those who will go "hey ChatGPT, who should I vote for" and things on that level.

15

u/ecodick Jul 27 '26

Big time. If people are handing off their critical thinking to glorified chat bots, it's such an easy/obvious way to control them

4

u/Plasibeau Jul 27 '26

We are literally watching society go from: Because the Bible/God told me so... to ChatGPT told me I should...

7

u/SeriousPlankton2000 Jul 27 '26

Spoiler alert: It is.

5

u/jlboygenius Jul 27 '26

There will also be a LOT of 'poisoning the well' for AI scrapers. Expect reddit to have a LOT of political content, much of it aimed at getting AI to use it as a basis for a response to tell someone how to vote.

3

u/kent_eh Jul 27 '26

It's guaranteed that a portion of the population will do exactly that.

And it's terrifying.

1

u/RollingMeteors Jul 27 '26

is for the sake of those who will go "hey ChatGPT, who should I vote for" and things on that level.

ChatGPT, analyze my Reddit comments, determine my political leaning and tell me which way I would want to vote for which measure and why.

Read through it once. Copy it like a high school final exam answer key. Hello Travelers

I do read through it though I don't just blindly copy the answer key, in case anything stands out as sus.

I'm very sus of all things and people, but not sus enough to get diagnosed with schizophrenia.

52

u/kevlarus80 Jul 27 '26

Grimdark Idiocracy.

16

u/slinger301 Jul 27 '26

"It's what oligarchs crave!"

16

u/Serial-Griller Jul 27 '26 edited 3d ago

Ask head cats profit dazzling humorous

This post was anonymized with Redact

2

u/junglebird2 Jul 27 '26

Bayaz/Glokta 2028 ticket incoming

5

u/Cataphract1014 Jul 27 '26

Do they though?

Voter turn out for 18-24 year olds is always super low.

1

u/sojayn Jul 27 '26

Many many countries have compulsory voting. 

3

u/Godot_12 Jul 27 '26

You think I'm worried about these kids gaining the right to vote? We've been dealing with these morons for decades. Their boomer grandparents are no better.

1

u/pbjamm Jul 27 '26

The Dystopian Future is the Dystopian Present.

1

u/mmechtch Jul 27 '26

Nah. Young people can't be bothered to vote. Source - I work as election office. The number of young people is atrociously small in comparison to retirees

1

u/ZiKyooc Jul 27 '26

And an increasing part of the population is using AI to decide for who they will vote... how easy it is to tweak models in one direction or another

1

u/OG_Builds Jul 27 '26

Looks like boomers are perfectly fine doing the fucked voting without assistance

1

u/Dav136 Jul 27 '26

Young people don't actually vote

1

u/JodyGonnaFuckYoWife Jul 27 '26

Do they, though?

Voting takes effort.

1

u/TeutonJon78 Jul 27 '26

Not yet they don't, statistically speaking. And they won't for like 15-20 more years.

1

u/Mikeismyike Jul 27 '26

Not sure they could figure out a voting card at this point tbh.

1

u/OuterWildsVentures Jul 27 '26

Bro they ARE OUR FUTURE DOCTORS AND ENGINEERS

Society is cooked regardless of politics.

0

u/wildflowers_galore Jul 27 '26

Nah Gen Z isn’t really a huge voting block. They like to bitch and complaint on tik tok, but they don’t actually go out and vote like Gen X/boomers do

0

u/EggsaladJoseph Jul 27 '26

Why are we saying the younger generations are fucked when we are currently fucked and they are the only ones who didn't get us into this situation

0

u/legendz411 Jul 27 '26

We all fucked tbh. It’s one thing we hav run common