Skip to content
endpoints
2endpoints
items per credit
~2.5 millionitems per credit
typical call
1–3 stypical call

In practice

One Hacker News call

Hacker News stories and comments matching a query, by relevance or newest first, with filters for type, author, story, points and dates: title, link, author, points, comment count, text and time. Up to 100 per page; page on with `cursor`. A query reaches only its first 1,000 results. About 2 million results per credit. Values are illustrative.

request
curl -G "https://api.scrapelyserp.com/v1/structured/hackernews/search" \
  -H "Authorization: Bearer $SCRAPELY_API_KEY" \
  --data-urlencode "query=web scraping" \
  -d sort=date
response
{
  "endpoint": "hackernews/search",
  "url": "https://news.ycombinator.com/",
  "credits": 0.000028,
  "duration_ms": 1480,
  "data": {
    "query": "rust",
    "type": "story",
    "sort": "relevance",
    "total": 61311,
    "results": [
      {
        "id": "22238335",
        "type": "story",
        "title": "Why Discord is switching from Go to Rust",
        "url": "https://blog.discordapp.com/why-discord-is-switching-from-go-to-rust-a190bbca2b1f",
        "hn_url": "https://news.ycombinator.com/item?id=22238335",
        "author": "Sikul",
        "points": 1582,
        "comments": 642,
        "text": null,
        "created_at": "2020-02-04T17:30:40.000Z",
        "story_id": "22238335",
        "story_title": null,
        "parent_id": null
      }
    ],
    "next_cursor": "2"
  }
}

What it returns

Hacker News as typed JSON

Every call answers the same way: the endpoint, the page it read, what it cost and the data, in a documented shape. Nothing to parse.

  • Search stories, comments, Ask HN and Show HN
  • Title, link, author, points, comment count, text, time
  • Filter by author, story, minimum points and date range
  • Up to 100 items by id in one call
  • Cursor paging

Pricing

Every endpoint, one balance

One credit costs $3.50: each call spends credits in proportion to the data it moves, and a page we could not read costs nothing. Items per credit are typical.

Hacker News endpoints: items per credit, items per call and typical call time
EndpointPer creditPer callTypical call
GET /v1/structured/hackernews/searchHacker News search≈ 2 million resultsup to 100 per call1–3 s
GET /v1/structured/hackernews/itemsHacker News items≈ 2.5 million itemsup to 100 per call3–30 s

Start pulling product data

Create an account, buy a credit pack and fetch products from any live retailer. No subscription, and what you buy never expires.

POST api.scrapelyserp.com/v1/products { "platform", "marketplace", "ids": […] }