Tool to scrape multiple URLs in batch with concurrent processing. Use when you need to scrape multiple web pages efficiently with customizable formats and content filtering.
urlsRequiredarrayThe URLs to be scraped in batch. At least one URL is required.
proxystringProxy type to use for requests.
maxAgeintegerCache validity period in milliseconds. Default is 2 days.
mobilebooleanIf true, emulate a mobile device when scraping. Defaults to false.
actionsarrayBrowser actions to perform on each page before scraping.
formatsarrayDesired output formats for the scraped content. Defaults to ['markdown'].
headersobjectCustom HTTP headers to send with each request.
timeoutintegerRequest timeout in milliseconds.
waitForintegerDelay in milliseconds before content retrieval. Useful for pages with dynamic content. Defaults to 0.
webhookobjectWebhook configuration for batch scrape notifications
blockAdsbooleanIf true, block advertisements during scraping. Defaults to true.
locationobjectLocation settings for the request
dataRequiredData from the action execution
errorstringError if any occurred during the execution of the action
successfulRequiredbooleanWhether or not the action execution was successful or not
Aident-managed access. Risk level 2 of 5.
$0.05 / call
No published Skills explicitly reference this Action yet.