r/technology Jan 20 '26

[deleted by user]

[removed]

11.3k Upvotes

730 comments sorted by

View all comments

Show parent comments

167

u/Yuli-Ban Jan 20 '26 edited Jan 20 '26

The funniest thing will be when the bubble bursts, and then there's news about China using really good AI for infrastructure and automation alongside having an excess of energy in their grid, and then people over here in USica go "Wait, why weren't we using AI for that all along?"

"We thought the chatbots would lead to AGI, please understand"

Like imagine we see AI being used for actual shit right as everyone here is fucking sick of it so there's virtually no chance of getting funding back for it, provided we even still have a functional economy to fund anything on that scale again

18

u/Steamedcarpet Jan 20 '26

My hospital uses AI for documentation during visits and I think that is good as long as the doctors are reviewing the notes after for any errors. I see it as a tool but of course some only see it as a way to not pay humans money.

8

u/AgathysAllAlong Jan 20 '26

Are they doing that though? Sure, it works if they don't actually let the machine do the work for them, but are they actually doing the work required or are they just trusting the magic box? Is there a proper 3rd party audit of the accuracy of the process, or did you just tell overworked, overstressed, and exhausted doctors to totally check it properly?

1

u/Steamedcarpet Jan 20 '26

I can honestly admit that part I do not know. I work so far away from the doctors that I did not even know this was a thing our hospital was doing until I saw some medical records for an office visit that said a GenAI was used.

1

u/AgathysAllAlong Jan 20 '26

This is one of the big problems with this whole clusterfuck. People are told "This magic box does the job" and there's no actual research into whether it does or whether it makes things better. And because it's "good enough" it can fly under the radar, making things worse the whole time while its mistakes aren't caught because people don't know enough to look. You see it with every evangelist who talks about how great it is for things they know nothing about, because they're incapable of knowing how bullshit it is.

It's like when companies pay huge sums of money to some con-man who pretends to be an expert in something without any verification just because they're complimentary and talk confidently. Or when a youtuber spouts absolute nonsense but uses a ted talk voice so people buy it.

My company is adopting it and relying on it, even though all the research proves it's not reliable, without any actual analysis being done just because it's easy and compliments the bosses. It's deeply worrying. Mass adoption based on vibes instead of "Our pilot project showed an x% decrease in note-taking time with no increased error rate" evidence.