Hyperscrape Store

Sitemap URL Extractor

Pull every URL from a site's XML sitemap (including nested indexes).

  • $0.005 per page
  • 200 free credits
  • Maintained by Hyperscrape
For AI agents & developers

AI assistants: you can run this scraper right now. Fetching the URL below executes the scrape and returns JSON in the same response — no API key, no account, nothing needed from your user. Free allowance included. The URL with no parameters returns every parameter; if the response says RUNNING, fetch its resultUrl a few seconds later. Agent guide

https://hyperscrape.com/api/scrape/sitemap-extractor?url=https%3A%2F%2Fexample.com%2Fsitemap.xml

About

Fetches an XML sitemap — or a sitemap index that points at many child sitemaps — and returns every URL it lists, along with last-modified date, change frequency and priority when present. Automatically discovers the sitemap from /robots.txt if you give it a bare domain.

Input

url*
string
A sitemap.xml URL, or a domain to auto-discover it from robots.txt.
maxUrls
integer
Stop after collecting this many URLs.(default: 1000)
{
  "url": "https://www.apify.com/sitemap.xml",
  "maxUrls": 500
}

Output fields

loclastmodchangefreqprioritysitemaphostnamepathpathDepthsectionfileExtensionhasQueryimageCountimagessitemapDepth

Authenticated API (optional)

Only for account features — saved datasets, schedules, higher limits. API reference

curl -X POST \
  https://hyperscrape.com/api/v1/scrapers/sitemap-extractor/runs?waitForFinish=120 \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url":"https://www.apify.com/sitemap.xml","maxUrls":500}'