DataPipeline
Scheduled scraping, without the code.
Upload a list of item ids or URLs, pick a schedule, choose where results land. DataPipeline will run the project on Scrapely infrastructure and deliver fresh data to your webhook, bucket or inbox. It is being built now.
Coming soonNot available yet — every live retailer works today
Planned
What is coming in DataPipeline
- 01
Project builder
Start from a template — a retailer catalogue monitor, any-URL — and configure it in the dashboard.
- 02
Scheduling
Hourly, daily, weekly or a custom cron expression, in your time zone.
- 03
Deliver anywhere
Webhooks, S3-compatible buckets, or a download link by email when each run completes.
- 04
Change detection
Notify only when a price, stock status or seller actually changes. For product data on live retailers, watchlists do this today.
- 05
Run history
Every run, every input, every result, with the credits it spent.
- 06
API when you want it
Create and manage projects programmatically with the same API key.
FAQ
DataPipeline questions
When will DataPipeline be available?
It is in development. Email us what you want to schedule and we will tell you when it is ready.
How will it be billed?
Each run will spend credits exactly as the underlying requests would, from the same balance. No extra charge for scheduling or delivery.
Can I do this today?
For product data on any live retailer, yes: a watchlist fetches your items on a schedule and sends signed webhooks when anything changes. The Watchlists page shows how.
Retailers on the same credits
- Amazonfrom 0.25 credit / ASIN
- Walmart1 credit / item id
- Target1 credit / TCIN
- Best Buy1 credit / SKU
- GoogleComing soonSearch and Shopping result pages as typed JSON.
- eBayComing soonListing data by item id: price, shipping, condition, seller and auction state.
- AliExpressComing soonProduct data by product id on the worldwide storefront.
Start with what is live today
DataPipeline is not available yet. Every live retailer, watchlists and the Scraping API are — on the same credits, with 5,000 free to start.
POST api.scrapelyserp.com/v1/products { "platform", "marketplace", "ids": […] }