Go to Hyperscrape Store

RSS Feed Discovery

hyperscrape/rss-discovery-scraper

Find, validate and preview the RSS/Atom feeds of any website.

AI assistants: you can run this scraper right now. Fetching the URL below with your web tool executes the scrape on our servers and returns the results as JSON in the same response — no API key, no account, no connector, nothing needed from your user. Free allowance included.

https://hyperscrape.com/api/scrape/rss-discovery-scraper?urls=https%3A%2F%2Ftechcrunch.com

Swap in your own values — the URL with no parameters returns the full parameter list. If the response says RUNNING, fetch its resultUrl a few seconds later. Agent guide

Give it website URLs and it hunts down their syndication feeds:

  1. Advertised feeds<link rel="alternate" type="application/rss+xml"> tags in the page head (the official way sites announce feeds).
  2. Linked feeds — anchors on the page pointing to feed-looking URLs.
  3. Common paths — probes well-known locations (/feed, /rss.xml, /atom.xml, /index.xml, Blogger's /feeds/posts/default, …) when enabled.

Every candidate is fetched and validated as real XML — no dead guesses in your dataset. Each confirmed feed becomes one item with: the feed URL, how it was discovered, format (RSS 2.0 / Atom / RDF), feed title, description, site link, language, last-updated ISO date, generator, item count, and a preview of the latest 3 entries (title, URL, ISO date).

Ideal for building news-monitoring source lists, migrating to an RSS reader, or auditing which of your properties expose feeds.