Scrapes a publicly accessible URL, optionally performing pre-scrape browser actions or extracting structured JSON using an LLM, to retrieve content in specified formats.
urlRequiredstringThe fully qualified URL of the web page to scrape. Must start with 'http://' or 'https://' and be a valid web URL.
actionsarrayAn optional list of browser actions (e.g., click, write, wait, press) to perform on the page before scraping. Useful for interacting with dynamic content, filling forms, or navigating through page elements.
formatsarrayA list of desired output formats for the scraped content. Defaults to ['markdown']. Cannot include both 'screenshot' and 'screenshot@fullPage'. If 'json' is included, jsonOptions must be provided.
timeoutintegerMaximum time in milliseconds to wait for the scraping request to complete. Defaults to 30000.
waitForintegerTime in milliseconds to wait for the page to load or for dynamic content to render before starting the scrape. Defaults to 0.
locationobjectLocation settings for the request
excludeTagsarrayA list of HTML tags to specifically exclude from the output. Content within these tags will be removed.
includeTagsarrayA list of HTML tags to specifically include in the output. Content within these tags will be prioritized.
jsonOptionsobjectOptions for JSON extraction
onlyMainContentbooleanIf true, attempts to extract only the main article content, excluding headers, footers, navigation bars, and ads. Defaults to true.
dataRequiredData from the action execution
errorstringError if any occurred during the execution of the action
successfulRequiredbooleanWhether or not the action execution was successful or not
Aident-managed access. Risk level 2 of 5.
$0.0008 / call