RSS Feed Discovery

Find, validate and preview the RSS/Atom feeds of any website.

$0.005 per page
200 free credits
Maintained by Hyperscrape

For AI agents & developers

AI assistants: you can run this scraper right now. Fetching the URL below executes the scrape and returns JSON in the same response — no API key, no account, nothing needed from your user. Free allowance included. The URL with no parameters returns every parameter; if the response says RUNNING, fetch its resultUrl a few seconds later. Agent guide

https://hyperscrape.com/api/scrape/rss-discovery-scraper?urls=https%3A%2F%2Ftechcrunch.com

About

Give it website URLs and it hunts down their syndication feeds:

Advertised feeds — <link rel="alternate" type="application/rss+xml"> tags in the page head (the official way sites announce feeds).
Linked feeds — anchors on the page pointing to feed-looking URLs.
Common paths — probes well-known locations (/feed, /rss.xml, /atom.xml, /index.xml, Blogger's /feeds/posts/default, …) when enabled.

Every candidate is fetched and validated as real XML — no dead guesses in your dataset. Each confirmed feed becomes one item with: the feed URL, how it was discovered, format (RSS 2.0 / Atom / RDF), feed title, description, site link, language, last-updated ISO date, generator, item count, and a preview of the latest 3 entries (title, URL, ISO date).

Ideal for building news-monitoring source lists, migrating to an RSS reader, or auditing which of your properties expose feeds.

Input

`urls`* array	Sites to discover feeds for (homepages or blog roots work best).
`probeCommonPaths` boolean	Also try well-known feed locations like /feed and /rss.xml.(default: true)
`maxFeedsPerSite` integer	Stop after this many validated feeds per site.(default: 5)

{
  "urls": [
    "https://techcrunch.com",
    "https://www.theverge.com"
  ],
  "probeCommonPaths": true,
  "maxFeedsPerSite": 3
}

Output fields

siteUrlfeedUrldiscoveredViaformatfeedTitlefeedDescriptionsiteLinklanguageupdatedAtitemCountlatestItems

Authenticated API (optional)

Only for account features — saved datasets, schedules, higher limits. API reference

curl -X POST \
  https://hyperscrape.com/api/v1/scrapers/rss-discovery-scraper/runs?waitForFinish=120 \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"urls":["https://techcrunch.com","https://www.theverge.com"],"probeCommonPaths":true,"maxFeedsPerSite":3}'

Related scrapers

Google Search Results (SERP)

hyperscrape/google-search-scraper

Scrape organic Google results — title, URL, snippet, sitelinks, PAA and related searches.

HyperscrapeSEO & Marketing

On-Page SEO Analyzer

hyperscrape/seo-page-analyzer

Audit any page's title, meta, headings, links and structured data.

HyperscrapeSEO & Marketing

Sitemap URL Extractor

hyperscrape/sitemap-extractor

Pull every URL from a site's XML sitemap (including nested indexes).

HyperscrapeSEO & Marketing