Aident logoAident logo centerAident Loadout
Use CasesPricingDocs
ENStart Now
AppsKadoa ToolsKadoa Post Crawl
Kadoa Tools

Kadoa Post Crawl

Starts a new web crawling session to crawl and index pages from a website. Use this tool when you need to: - Crawl an entire website or specific sections - Gather page content for extraction or analysis - Index multiple pages from a domain Returns a session_id that can be used w…

Write actionRisk level 2 of 5API key connection
Use Kadoa Post Crawl

Pricing and limits

Aident logo

Product

Aident LoadoutAident Playbook EditorOpen-CUAK

About

AppsSkillsUse CasesDocsBlogPricingDownloadsPrivacy PolicyTerms of Service

Alternatives

vs Composiovs Zapier
llms.txtGet an AI summary of Aident LoadoutSummarize with ChatGPTSummarize with ClaudeSummarize with GeminiSummarize with Perplexity

© Aident Labs, 2024-2026

Pricing
Free
Unified payment
Not currently supported

Inputs

  • urlstring
    URL to start crawling, must be a valid URI
  • timeoutinteger
    Maximum crawling time in milliseconds, e.g., 1800000 for 30 minutes
  • maxDepthinteger
    Maximum depth to traverse during the crawl
  • maxPagesinteger
    Maximum number of pages to crawl
  • startUrlsarray
    Multiple start URLs (mutually exclusive with 'url'). Must belong to same domain/subdomain
  • proxyCountrystring
    Country code for proxy configuration, e.g., 'DE'
  • strictDomainboolean
    Restrict crawler to the exact domain without subdomains
  • pathsFilterInarray
    List of path patterns to include in the crawl
  • pathsFilterOutarray
    List of path patterns to exclude from the crawl

Observable output

  • data
    Required
    Data from the action execution
  • errorstring
    Error if any occurred during the execution of the action
  • successfulboolean
    Required
    Whether or not the action execution was successful or not

Skills that use this Action

Related use cases

No verified related use cases are linked yet.

Official source

Provider source

Skills that use this Action

No published Skills explicitly reference this Action yet.