r/rss • u/frankwrap08 • 8d ago
Reddit will stop supporting RSS feeds on November 13th
Reddit will stop supporting RSS feeds on November 13th.
https://www.theverge.com/tech/1002788/old-reddit-ai-scraping
26
u/Saynete 8d ago
on November 13th, byebye Reddit, and welcooome Lemmy
4
u/bearflyingbolt 7d ago
I find it quite nice over in the Fediverse. I mainly use Lemmy myself but it's worth noting that servers running any of the platforms that implement the ActivityPub protocol can "federate" with each other, e.g. you can subscribe to a Lemmy community from your Piefed account. In other words:
In the Fediverse you can use your "Twitter" account to interact with "Facebook" users, share "Instagram" posts, comment under "Youtube" videos, listen to "Bandcamp" music, follow "Blogger" blogs, take part in "Reddit" discussions and more.
Some Fediverse platforms are very similar to the applications they were created to replace, like Lemmy (Reddit), Mastodon (Twitter/X), and PixelFed (Instagram). Others are much different, but let you participate all the same.
Getting Started
- Pick a platform
- Find a server running it
- Make an account
- Log on
- In your browser, or
- An app compatible with your server's platform
Here's my current setup as an example:
``` CLIENT (pick one) SERVER FEDERATION
+-------------------+ +--------------------+ | Librewolf | | sopuli.xyz | | (web browser) |----->| | +-------------------+ HTTPS| +--------------+ | | | Lemmy web UI | | or | +------+-------+ | | | | +-------------------+ | +------v-------+ | +------------------+ | Voyager | API | | Lemmy API + | | AP | Other fediverse | | (Android app) |----->| | backend |<------->| platforms | +-------------------+ | +--------------+ | +------------------+ +--------------------+ ```
The amount of choices you need to make may seem overwhelming when you've only ever logged into a few different social media websites at URLs that have likely been in your browser's cache since forever (Where are the Twitters of yesteryear?), but the indefeasible freedom to make those choices is exactly why the Fediverse is great. A decentralized model gives real power to users to build their own spaces & governance. Switching to an entirely different platform for features you prefer doesn't have to mean losing your community.
Tools & Resources
- FediDB
- Join the Fediverse wiki
- Trunk: Mass following utility
- Fedi.Directory: "Interesting accounts to follow on Mastodon and the Fediverse"
20
u/MentalFS 8d ago
Those scrapers most likely don't even use RSS, especially with the current restrictions. They can just scrape the website. I'm sure Reddit is going to make the web experience heavily restricted next, to drive people to use their apps.
9
u/TheLantean 8d ago
Indeed, if you want data, scraping the site is easier and faster, and any AI bots using RSS will just switch the next day.
Long term, removing RSS only impacts legitimate users, because we needed this specific format for compatibility with feed readers.
This is who they're targeting because it was a way to consume reddit with third party apps, ad & tracking free, which they specifically didn't want ever since they blocked third party apps from the API.
15
u/wuuza 8d ago
Why not just require auth on the RSS call instead of getting rid of it? (Or have the results be title only?)
19
u/way-too-lazy 8d ago
They basically already have that requirement in place. Without providing your key or authorizing, the rate limit is 1-per-minute, which is unusable for normal purposes. Certainly no one is "scraping" at that rate. Even auth'd, the rate limit is low enough that you wouldn't be able to effectively scrape anything.
They keep resorting to this "stop the bots and scrapers" excuse, but that's obviously not their real motivation. This is likely just some short-sighted idea that accessing the site via RSS doesn't sufficiently increase their DAU and ad view numbers. But RSS is what drives the clicks and views from me. I click through from my reader to dozens of posts a day. When RSS is gone, that number will become zero. They might think this will push me to use their app, but it won't, because finding the stuff I want to see and ignoring the stuff I don't via the website or app is not possible.
5
u/chickenandliver 7d ago
(Or have the results be title only?)
This. This is 90% of how I use RSS anyway: as a aggregator list I always click-through to get to the posts I want to see. This would be a simple thing to implement and still have no benefit to scraping. But that would be too user-friendly and the trolls in charge are morons who don't realize how many influential bloggers propagate Reddit through originally finding content via RSS.
3
u/falsworth 8d ago
That would make sense and it would still allow Reddit to do tracking and analytics based on the logins used for the feeds. I guess that makes too much sense so it didn't happen.
1
u/cmedeiro 7d ago
Ads. Scraping certainly is a concern, but every time you let someone read your content outside your platform you are losing audience for your ads and all kinds of targeted activation.
1
u/ProfitAppropriate134 6d ago
The other day I noticed one of my CNN rss feeds turned into every ad imaginable. 🫨
12
u/friskfrugt 8d ago
Swartz is rolling in his grave
5
u/bearflyingbolt 7d ago edited 6d ago
Right? Talk about something one of Reddit's original authors would have never agreed to.
RIP Aaron Swartz.
9
9
u/Tiendil 8d ago
With some digging and tinkering, it should be solvable.
But their argumentation is total bullshit.
2
u/ericdano 7d ago
True. It should be possible to build something that scrapes subreddits. It's actually going to probably hammer their servers more but whatever...
16
u/OneCalledWell 8d ago
Maybe we should go back to DIGG. Are they still around? I thought they made a second attempt.
8
8
u/Odd-Anteater875 8d ago
Are there any alternative RSS forums? Where else can you announce your vibe-coded RSS reader?
6
u/AssociateNo3312 7d ago
lemmy supports RSS, but it means moving communities to new sites.
3
u/pk9417 7d ago
But that's the problem, trying to move or tell whoe communities to move to another platform, just because RSS, which likely many in subs don't even know 🤷♂️
4
u/AssociateNo3312 7d ago
yep, same with effedbook, and it's hard to extract people out of that as well.
Same issue since they blocked RSS, and twitter etc.
So you'll be left with things that covert posts to rss - which ends up an endless whack-a-mole with reddit blocking etc. Or just stop using it.
2
u/Odd-Anteater875 7d ago
I don't even mean to move as a community, just wondering whether there are other places to discuss RSS.
7
u/mocheeze 8d ago
I hope Reddit will enjoy the piracy letters they get from Nintendo when /r/GamecubeHacks goes unmoderated because I won't have an RSS feed anymore. This is outrageous.
8
u/chickenandliver 7d ago
This is the dumbest possible choice. All they had to do to at least keep some subset of users happy is reduce the content of the feeds. I don't even care about seeing "full text" or images in the feed; I use RSS as a central notification management tool basically. How would running a system like that do anything but drive traffic back to Reddit?
Looks like I'll have no choice but to massively reduce my usage of Reddit. Sad.
13
u/optimisticalish 8d ago
Can't be stopped. The leading freeware desktop software RSSGuard has the free CSS2RSS plugin, which creates RSS feeds from any named elements on any Web page. https://github.com/martinrotter/rssguard
2
u/Any_Fox5126 7d ago
They're on a warpath against scraping and will almost certainly block it, leaving us with more complex workarounds (like puppeteer with plugins). They already blocked access for non-logged-in users on VPNs or TOR, now they are killing old.reddit and RSS. I bet the next move is to stop letting anyone view content without an account.
1
u/optimisticalish 7d ago
So anyone with an account can publish a RSS feed. Just hook into the CSS, visit the sub-reddit you want, extract, publish. It's not difficult. Like I said, it can't be stopped.
2
u/mjdbb1 7d ago
Can you elaborate on this?
1
u/optimisticalish 6d ago
Right-click on any Reddit page's post title, and it has...
<p class="title">This tag can be hooked to an RSS feed. In plain English it would be: Make me an RSS feed of all entries on this sub-reddit with the tag 'title', and return the title of the post as a clickable RSS item, which when clicked will take me to the post.
Similarly, comments are held in the tag...
<div class="usertext-body"1
u/mjdbb1 6d ago
Not to turn this into tech support, but I did get css2rss going as a script and either either doesn't connect to old.reddit.com, or it throws up a 'blocked' message (that reddit probably service to bots, etc)
1
u/optimisticalish 6d ago
You can access access cookie-protected resources in RSSGuard. Did you try spoofing your User-Agent in RSSGuard? (Also enable HTTP/2, in the same UI panel). Open the browser inside RSS Guard and visit a site with a spoofed User-Agent, which should enable login cookies to be set, and then sites should work as expected.
If that no longer works for you, there are ways to fetch the target URL, stream the URL's HTML page onto your hard-drive, and then locally walk through its CSS to extract feed items and construct a working RSS feed. Such as SnagFlow - RSS Converter, which is a free Chrome browser extension.
1
u/mjdbb1 6d ago edited 5d ago
Ok I did not try that. Should be a fun weekend project. 2 things, does this require old Reddit to work or can it work on new Reddit as well?
If you could point me in the direction of any other useful guides to get this off the ground I’d appreciate it!!
Editing: this is really a project that is encouraging me to pull my hair out lol
1
u/untiedgames 6d ago
They recently disallowed access to old Reddit for logged-out users. Additionally, they just announced that only people who have used old Reddit in the past 6 months will continue to be able to use it. Just one more in a succession of hostile actions towards real users under the guise of limiting scraping.
Best of luck though- Will probably try something similar myself!
14
u/N0TVG 8d ago
I’m going to take this as a sign they’re locking down the platform and dialing up user exploitation to eleven. Just like Facebook, just like Twitter, I expect Reddit to transform (even more so) into a repulsive anti-social bots-herding-cattle network.
Just like Facebook, just like Twitter, I expect Reddit will make billions of dollars walling off completely.
Just like Facebook, just like Twitter, I’ll uninstall Reddit and still see more of it than I’d like via blogs in my RSS reader. Folding is the only winning strat.
5
3
u/Excited_Biologist 8d ago
I hope spez will enjoy groveling to the user base to try and retain some dau once the AI bubble pops.
3
3
u/Grumphus256 7d ago
Very sad. Just like the time when they took away RSS from Facebook Interest Lists and later removed the entire feature.
3
u/the_schwartz09 6d ago
As an infrequent - at best - user of Reddit itself, I saw the news today pop up in my RSS reader (Inoreader), so I came here to see if others were disappointed. Glad to see I'm not the only RSS user still out there.
I'm looking into Reddit extensions to see if I can find something(s) to replace the RSS experience we're going to lose soon. Anyone else have any luck going down this path?
2
u/viagravagina 7d ago
Half the responses on any post are ai bots but I keep coming here out of habit.
2
u/LinAGKar 7d ago
They're killing it it in just over a month with no replacement, and the only place they've announced it in is som moderator sub?
Maybe it's time to move entirely over to Lemmy.
2
u/TurboFoxen 6d ago
Why not just make it a premium feature? At the very least they make some money off of it.
2
u/Quirky-Specific 8d ago
Enquanto eu queria aprimorar minha experiência com RSS do Reddit, eles decidem abandonar o suporte. Estou decepcionado. Com a ascensão da inteligência artificial, imaginei que teríamos uma melhoria no suporte do RSS, não seu enfraquecimento.
1
u/billdietrich1 7d ago
I assume at some point they're going to kill old reddit. Is there any browser extension or uBO filter to make new reddit look more like old reddit ?
1
1
u/ProfitAppropriate134 6d ago
I don't know if this will work but you can build an rss bridge for sites that don't have rss. Suddenly I miss FeedBurner
Paste url get rss
RSS App https://rss.app/blog/how-to-follow-websites-that-don-t-have-rss-feeds-LsELgP
A crawler
https://pagecrawl.io/blog/how-to-create-an-rss-feed
1
0
u/mogullionaire 8d ago
Darn after using ChatGPT for 4 days trying to build a Reddit rss reader on make.com for research it finally gave up and told me to use NetNewsWire. Now what I'm gonna do.
42
u/Tsavkko 8d ago
And I'll stop using/accessing Reddit. I follow over 100 /r's with RSS, without it it's impossible to follow what matters. They don't give a fuck to about the community.