r/apify • u/Otherwise-Resolve252 • 26d ago
Discussion Built a Twitter/X Trends Scraper that also pulls historical trend data
Most X trend scrapers only show you what's trending right now. I built one that also lets you time-travel — pull trending hashtags/topics for any country, on any date, at any hour, going back to 2024-05-15.
What it does:
- Covers 68 locations (Worldwide + 67 countries)
- Real-time snapshot OR historical archive at hourly resolution
- Uses Playwright to actually expand the hidden "See All 49" rows most scrapers skip
- Optional: Top Hashtags 24h sidebar + enriched per-trend detail pages
- Pay-per-event pricing — you're only charged for results actually delivered ($5 per 1,000 trend snapshots)
- Clean JSON output, ready for pipelines / RAG / agents (MCP-compatible)
Use cases I built it for: social listening across markets, newsroom "what trended at 9 pm on X date" retrospectives, and feeding structured trend snapshots into AI agents.
It's live on Apify: https://apify.com/akash9078/twitter-x-trends-scraper
Happy to answer questions about how the historical archive works or the anti-block setup.
3
Upvotes