Scrapegraphai · Web Data

ScrapeGraphAI / Crawl website (start)

Starts a crawl from url following links up to maxDepth (default 2), same domain unless allowExternal, converting each page to markdown. Returns a crawl id; poll ScrapeGraphAI / Crawl status, then read pages with ScrapeGraphAI / Crawl pages. maxPages 10-500 sets the price.

Live data

You are looking at the live public catalog.

unverifiedRequest shape unavailableUnverified

Published API evidence

Public metadata only. Response bodies, credentials, and internal review notes are never displayed.

No verification date is claimed. No response capture is claimed.

Request parameters

allowedTypes body · required
MIME types to accept; PDFs are excluded because they bill per page. Use ["text/html"].
allowExternal body · optional
excludePatterns body · optional
fetchConfig body · optional
Fetch options (stealth is not offered: it adds 5 credits)
formats body · required
includePatterns body · optional
maxDepth body · optional
maxLinksPerPage body · optional
maxPages body · required
url body · required

Provider docs How to run it