Skip to content

Discourse forums · live

Discourse forums data, one call away.

Search and topics on any public Discourse forum, as JSON. Typed JSON from one GET call — you only pay for the data you pull.

Get started Read the docs
endpoints
2endpoints
posts per credit
~7.5 millionposts per credit
typical call
1–2 stypical call

In practice

One Discourse forums call

Posts matching a query on any public Discourse forum: topic title, author, excerpt, likes, tags and category. 50 per page; page on with `cursor`. About 7.5 million posts per credit. Values are illustrative.

request
curl -G "https://api.scrapelyserp.com/v1/structured/discourse/search" \
  -H "Authorization: Bearer $SCRAPELY_API_KEY" \
  -d forum=meta.discourse.org \
  -d query=webhooks
response
{
  "endpoint": "discourse/search",
  "url": "https://meta.discourse.org/search?q=webhooks",
  "credits": 0.000028,
  "duration_ms": 1480,
  "data": {
    "posts": [
      {
        "id": "257177",
        "url": "https://meta.discourse.org/t/trigger-a-zapier-task-with-discourse-webhooks/56753/1",
        "author": "example",
        "author_name": null,
        "title": "Trigger a Zapier task with Discourse Webhooks",
        "text": "Want to use Discourse Webhooks to trigger a task? Let's get started!…",
        "created_at": "2017-02-01T22:11:22.521Z",
        "likes": 32,
        "replies": 29,
        "reposts": null,
        "tags": [
          "webhooks"
        ],
        "community": "Documentation",
        "link": null,
        "media": []
      }
    ],
    "next_cursor": "2"
  }
}

What it returns

Discourse forums as typed JSON

Every call answers the same way: the endpoint, the page it read, what it cost and the data, in a documented shape. Nothing to parse.

  • Search any public Discourse forum
  • A topic's posts in order
  • Author, text, likes, tags, category
  • Cursor paging

Pricing

Every endpoint, one balance

One credit costs $3.50: each call spends credits in proportion to the data it moves, and a page we could not read costs nothing. Items per credit are typical.

Discourse forums endpoints: items per credit, items per call and typical call time
EndpointPer creditPer callTypical call
GET /v1/structured/discourse/searchDiscourse search≈ 7.5 million posts50 per call1–2 s
GET /v1/structured/discourse/topicDiscourse topic≈ 750,000 posts20 per call1–2 s

Start pulling product data

Create an account, buy a credit pack and fetch products from any live retailer. No subscription, and what you buy never expires.

Get startedTalk to us about your catalogue

POST api.scrapelyserp.com/v1/products { "platform", "marketplace", "ids": […] }