Firecrawl Batch Scrape

Tool to scrape multiple URLs in batch with concurrent processing. Use when you need to scrape multiple web pages efficiently with customizable formats and content filtering.

Precio

$0.05 / llamada

Pago unificado

Compatible con tu saldo en USD de Aident

• urlsarray

  Obligatorio
  The URLs to be scraped in batch. At least one URL is required.
• proxystring
  Proxy type to use for requests.
• maxAgeinteger
  Cache validity period in milliseconds. Default is 2 days.
• mobileboolean
  If true, emulate a mobile device when scraping. Defaults to false.
• actionsarray
  Browser actions to perform on each page before scraping.
• formatsarray
  Desired output formats for the scraped content. Defaults to ['markdown'].
• headersobject
  Custom HTTP headers to send with each request.
• timeoutinteger
  Request timeout in milliseconds.
• waitForinteger
  Delay in milliseconds before content retrieval. Useful for pages with dynamic content. Defaults to 0.
• webhookobject
  Webhook configuration for batch scrape notifications
• blockAdsboolean
  If true, block advertisements during scraping. Defaults to true.
• locationobject
  Location settings for the request

• data

  Obligatorio
  Data from the action execution
• errorstring
  Error if any occurred during the execution of the action
• successfulboolean

  Obligatorio
  Whether or not the action execution was successful or not

Aún no hay casos de uso relacionados verificados.