n8n-nodes-xcrawl
v1.0.1
Published
Scrape, crawl, and extract structured data from any website using the XCrawl API.
Maintainers
Readme
n8n-nodes-xcrawl
Scrape pages, crawl sites, map URLs, and search the web using the XCrawl API.
Prerequisites
- An XCrawl account
- An XCrawl API Key (obtained from your account dashboard)
Installation
In your n8n instance, go to Settings → Community Nodes → Install and enter:
n8n-nodes-xcrawlCredentials
After installation, create a new XCrawl API credential and enter your API Key.
Supported Operations
Scraping
| Operation | Description | | ----------------- | ---------------------------------------------------------------- | | Scrape | Scrape content from a single URL. Supports sync and async modes. | | Get Scrape Result | Retrieve the result of an async scrape job by scrape ID. |
Crawling
| Operation | Description | | ---------------- | ----------------------------------------------------------------------- | | Crawl | Crawl an entire site asynchronously and collect content from all pages. | | Get Crawl Result | Retrieve the result of a crawl job by crawl ID. |
Map & Search
| Operation | Description | | --------- | --------------------------------------------- | | Map | Get a list of all URLs found on a site. | | Search | Search the web by keyword and return results. |
Output Formats (Scrape & Crawl)
markdown— Cleaned Markdown contenthtml— Cleaned HTMLraw_html— Raw HTMLlinks— List of links found on the pagesummary— AI-generated summaryscreenshot— Page screenshot (viewport or full page)json— AI-structured JSON extraction (requires a prompt)
Compatibility
Requires n8n version 1.0.0 or later.
Links
- Website: xcrawl.com
- API Docs: xcrawl.com/docs
