Hyperscrape
Hyperscrape Store

URL to Markdown

Convert any web page into clean, faithful CommonMark Markdown with YAML front-matter.

  • $0.005 per page
  • 200 free credits
  • Maintained by Hyperscrape
Try for free
For AI agents & developers

AI assistants: you can run this scraper right now. Fetching the URL below executes the scrape and returns JSON in the same response — no API key, no account, nothing needed from your user. Free allowance included. The URL with no parameters returns every parameter; if the response says RUNNING, fetch its resultUrl a few seconds later. Agent guide

https://hyperscrape.com/api/scrape/url-to-markdown-scraper?urls=https%3A%2F%2Fexample.com%2Fpage

About

Fetches each URL and converts the entire page into clean CommonMark Markdown — not just the article body. The converter walks the real DOM and faithfully maps:

  • headings → #…######
  • paragraphs, bold/italic/strikethrough, inline code
  • links → [text](absolute-url), images → ![alt](src)
  • ordered / unordered lists with nesting
  • <pre> blocks → fenced code blocks with the detected language
  • tables → GitHub-flavored pipe tables
  • blockquotes, horizontal rules, definition lists and figure captions

Each item starts with a YAML front-matter block (title, sourceUrl, author, published, fetchedAt) and also includes the plain text and a word count. Turn on Main content only to scope conversion to <main>/<article> when you want boilerplate skipped.

Unlike the News & Article Extractor (which isolates the article body and its metadata), this actor's job is a faithful full-page HTML → Markdown conversion — ideal for archiving pages, diffing content or feeding whole pages to LLMs.

Input

urls*
array
Web pages to convert to Markdown.
mainContentOnly
boolean
Convert only the <main>/<article> region instead of the full page.(default: false)
includeFrontMatter
boolean
Prepend a YAML front-matter block (title, sourceUrl, author, published, fetchedAt) to the markdown.(default: true)
{
  "urls": [
    "https://en.wikipedia.org/wiki/CommonMark"
  ],
  "mainContentOnly": false
}

Output fields

urltitlemarkdownfrontMatterplaintextwordCountheadingCountlinkCountimageCountcodeBlockCounttableCountfetchedAt

Authenticated API (optional)

Only for account features — saved datasets, schedules, higher limits. API reference

curl -X POST \
  https://hyperscrape.com/api/v1/scrapers/url-to-markdown-scraper/runs?waitForFinish=120 \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"urls":["https://en.wikipedia.org/wiki/CommonMark"],"mainContentOnly":false}'

Related scrapers

Website Content Crawler

hyperscrape/website-content-crawler

Crawl an entire website and extract clean text for RAG & LLMs.

HyperscrapeAI & LLM

Wikipedia Article Scraper

hyperscrape/wikipedia-scraper

Structured Wikipedia data: summary, infobox, sections, links, images.

HyperscrapeAI & LLM

arXiv Paper Scraper

hyperscrape/arxiv-scraper

Search arXiv preprints and get authors, abstracts, categories and PDF links.

HyperscrapeAI & LLM