Universal Web Scraper

Extract structured data from any page using CSS selectors.

$0.005 per page
200 free credits
Maintained by Hyperscrape

For AI agents & developers

AI assistants: you can run this scraper right now. Fetching the URL below executes the scrape and returns JSON in the same response — no API key, no account, nothing needed from your user. Free allowance included. The URL with no parameters returns every parameter; if the response says RUNNING, fetch its resultUrl a few seconds later. Agent guide

https://hyperscrape.com/api/scrape/web-scraper?urls=https%3A%2F%2Fexample.com%2Fproduct%2F1

About

Point this scraper at a list of URLs and give it a set of named CSS selectors. For each URL it returns an object with your fields filled in from the matching elements. Supports extracting text, attributes (e.g. href, src) and lists.

Define fields as fieldName: selector (text) or fieldName: selector @attr to pull an attribute. Prefix with [] to collect all matches into an array, e.g. []headings: h2.

Input

`urls`* array	Pages to scrape.
`fields`* array	One per line as `name: selector`. Use `@attr` for attributes and `[]name:` for lists.
`includeHtml` boolean	Add the page's full HTML to each record.(default: false)
`includePageInfo` boolean	Add rich page metadata (title, meta/OG tags, headings, link/image stats, JSON-LD types, word count) to each record.(default: true)

{
  "urls": [
    "https://quotes.toscrape.com"
  ],
  "fields": [
    "[]quotes: .quote .text",
    "[]authors: .quote .author"
  ]
}

Output fields

url(your fields)titlemetaDescriptioncanonicalUrlheadingsinternalLinkCountexternalLinkCountimagesjsonLdTypeswordCountlanguage

Authenticated API (optional)

Only for account features — saved datasets, schedules, higher limits. API reference

curl -X POST \
  https://hyperscrape.com/api/v1/scrapers/web-scraper/runs?waitForFinish=120 \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"urls":["https://quotes.toscrape.com"],"fields":["[]quotes: .quote .text","[]authors: .quote .author"]}'

Related scrapers

Google Play App Scraper

hyperscrape/google-play-app-scraper

Extract app rating, installs, developer and reviews from Google Play.

HyperscrapeDeveloper Tools

Apple App Store Scraper

hyperscrape/app-store-scraper

Get iOS app details — rating, price, developer, category, size.

HyperscrapeDeveloper Tools

Stack Overflow Questions Scraper

hyperscrape/stackoverflow-scraper

Collect Stack Overflow questions with full bodies, answers and scores.

HyperscrapeDeveloper Tools