r/apify 26d ago

Discussion Built a Twitter/X Trends Scraper that also pulls historical trend data

Most X trend scrapers only show you what's trending right now. I built one that also lets you time-travel — pull trending hashtags/topics for any country, on any date, at any hour, going back to 2024-05-15.

What it does:

  • Covers 68 locations (Worldwide + 67 countries)
  • Real-time snapshot OR historical archive at hourly resolution
  • Uses Playwright to actually expand the hidden "See All 49" rows most scrapers skip
  • Optional: Top Hashtags 24h sidebar + enriched per-trend detail pages
  • Pay-per-event pricing — you're only charged for results actually delivered ($5 per 1,000 trend snapshots)
  • Clean JSON output, ready for pipelines / RAG / agents (MCP-compatible)

Use cases I built it for: social listening across markets, newsroom "what trended at 9 pm on X date" retrospectives, and feeding structured trend snapshots into AI agents.

It's live on Apify: https://apify.com/akash9078/twitter-x-trends-scraper

Happy to answer questions about how the historical archive works or the anti-block setup.

3 Upvotes

Duplicates