Scrapes a publicly accessible URL, optionally performing pre-scrape browser actions or extracting structured JSON using an LLM, to retrieve content in specified formats.
Write actionRisk level 2 of 5Aident-managed access
The fully qualified URL of the web page to scrape. Must start with 'http://' or 'https://' and be a valid web URL.
actionsarray
An optional list of browser actions (e.g., click, write, wait, press) to perform on the page before scraping. Useful for interacting with dynamic content, filling forms, or navigating through page elements.
formatsarray
A list of desired output formats for the scraped content. Defaults to ['markdown']. Cannot include both 'screenshot' and 'screenshot@fullPage'. If 'json' is included, jsonOptions must be provided.
timeoutinteger
Maximum time in milliseconds to wait for the scraping request to complete. Defaults to 30000.
waitForinteger
Time in milliseconds to wait for the page to load or for dynamic content to render before starting the scrape. Defaults to 0.
locationobject
Location settings for the request
excludeTagsarray
A list of HTML tags to specifically exclude from the output. Content within these tags will be removed.
includeTagsarray
A list of HTML tags to specifically include in the output. Content within these tags will be prioritized.
jsonOptionsobject
Options for JSON extraction
onlyMainContentboolean
If true, attempts to extract only the main article content, excluding headers, footers, navigation bars, and ads. Defaults to true.
Observable output
data
Required
Data from the action execution
errorstring
Error if any occurred during the execution of the action
successfulboolean
Required
Whether or not the action execution was successful or not