Firecrawl API / Scrape multiple URLs and optionally extract information using an LLM

Request parameters

• actions body · optional

  Actions to perform on the page before grabbing the content

• blockAds body · optional

  Enables ad-blocking and cookie popup blocking.

• excludeTags body · optional

  Tags to exclude from the output.

• formats body · optional

  Output formats to include in the response. You can specify one or more formats, either as strings (e.g., `'markdown'`) or as objects with additional options (e.g., `{ type: 'json', schema: {...} }`). Some formats require specific options to be set. Example: `['markdown', { type: 'json', schema: {...} }]`.

• headers body · optional

  Headers to send with the request. Can be used to send cookies, user-agent, etc.

• ignoreInvalidURLs body · optional

  If invalid URLs are specified in the urls array, they will be ignored. Instead of them failing the entire request, a batch scrape using the remaining valid URLs will be created, and the invalid URLs will be returned in the invalidURLs field of the response.

• includeTags body · optional

  Tags to include in the output.

• location body · optional

  Location settings for the request. When specified, this will use an appropriate proxy if available and emulate the corresponding language and timezone settings. Defaults to 'US' if not specified.

• maxAge body · optional

  Returns a cached version of the page if it is younger than this age in milliseconds. If a cached version of the page is older than this value, the page will be scraped. If you do not need extremely fresh data, enabling this can speed up your scrapes by 500%. Defaults to 2 days.

• maxConcurrency body · optional

  Maximum number of concurrent scrapes. This parameter allows you to set a concurrency limit for this batch scrape. If not specified, the batch scrape adheres to your team's concurrency limit. Example: 10

• mobile body · optional

  Set to true if you want to emulate scraping from a mobile device. Useful for testing responsive pages and taking mobile screenshots.

• onlyMainContent body · optional

  Only return the main content of the page excluding headers, navs, footers, etc.

• parsers body · optional

  Controls how files are processed during scraping. When "pdf" is included (default), the PDF content is extracted and converted to markdown format, with billing based on the number of pages (1 credit per page). When an empty array is passed, the PDF file is returned in base64 encoding with a flat rate of 1 credit total.

• proxy body · optional

  Specifies the type of proxy to use. - **basic**: Proxies for scraping sites with none to basic anti-bot solutions. Fast and usually works. - **enhanced**: Enhanced proxies for scraping sites with advanced anti-bot solutions. Slower, but more reliable on certain sites. Billed at the same credit cost as basic. - **auto**: Firecrawl will automatically retry scraping with enhanced proxies if the basic proxy fails. Enhanced proxies carry no credit surcharge, so either way only the regular cost is...

• removeBase64Images body · optional

  Removes all base 64 images from the output, which may be overwhelmingly long. The image's alt text remains in the output, but the URL is replaced with a placeholder.

• skipTlsVerification body · optional

  Skip TLS certificate verification when making requests

• storeInCache body · optional

  If true, the page will be stored in the Firecrawl index and cache. Setting this to false is useful if your scraping activity may have data protection concerns. Using some parameters associated with sensitive scraping (actions, headers) will force this parameter to be false.

• timeout body · optional

  Timeout in milliseconds for the request.

• urls body · required
• waitFor body · optional

  Specify a delay in milliseconds before fetching the content, allowing the page sufficient time to load.

• webhook body · optional

  A webhook specification object.

• zeroDataRetention body · optional

  If true, this will enable zero data retention for this batch scrape. To enable this feature, please contact help@firecrawl.dev