arXiv Paper Scraper

Search arXiv preprints and get authors, abstracts, categories and PDF links.

$0.005 per page
200 free credits
Maintained by Hyperscrape

For AI agents & developers

AI assistants: you can run this scraper right now. Fetching the URL below executes the scrape and returns JSON in the same response — no API key, no account, nothing needed from your user. Free allowance included. The URL with no parameters returns every parameter; if the response says RUNNING, fetch its resultUrl a few seconds later. Agent guide

https://hyperscrape.com/api/scrape/arxiv-scraper?query=large%20language%20models

About

Searches arXiv.org via the official export API (export.arxiv.org/api/query, Atom feed — no key needed) and returns one item per paper.

Each item includes: arXiv ID, title, full abstract, author list (with affiliations when present), primary category, all category tags, submission and update dates, abstract-page and PDF links, plus DOI, journal reference and author comment when the paper has them.

Inputs

query — free-text search (matched against all fields). Supports arXiv query syntax like ti:"neural network" or au:hinton.
category — optional arXiv category (e.g. cs.AI, stat.ML) to restrict results.
sortBy — relevance, most recently submitted, or most recently updated.
maxItems — number of papers to return (paginated automatically).

Input

`query`* string	Free-text search. Supports arXiv field prefixes like ti:"..." (title) or au:... (author).
`category` string	Optional arXiv category to restrict to, e.g. cs.AI, cs.CL, stat.ML, math.CO.
`sortBy` select	How to order results.(default: "relevance")
`maxItems` integer	How many papers to fetch.(default: 25)

{
  "query": "large language models",
  "sortBy": "relevance",
  "maxItems": 25
}

Output fields

arxivIdtitleabstractauthorsprimaryCategorycategoriespublishedAtupdatedAtabsUrlpdfUrldoijournalRefcomment

Authenticated API (optional)

Only for account features — saved datasets, schedules, higher limits. API reference

curl -X POST \
  https://hyperscrape.com/api/v1/scrapers/arxiv-scraper/runs?waitForFinish=120 \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"query":"large language models","sortBy":"relevance","maxItems":25}'

Related scrapers

Website Content Crawler

hyperscrape/website-content-crawler

Crawl an entire website and extract clean text for RAG & LLMs.

HyperscrapeAI & LLM

Wikipedia Article Scraper

hyperscrape/wikipedia-scraper

Structured Wikipedia data: summary, infobox, sections, links, images.

HyperscrapeAI & LLM

Crossref DOI Metadata Scraper

hyperscrape/crossref-scraper

Search 150M+ Crossref records: DOI metadata, citation counts, references and licenses.

HyperscrapeAI & LLM