sitemap-to-url-crawler
v1.0.0
Published
Sitemap to URL Crawler: RAG & AI Data Feeder — free API client for the Apify platform. No API key setup, thousands of structured results, export to JSON, CSV or Excel.
Downloads
116
Maintainers
Readme
Sitemap to URL Crawler: RAG & AI Data Feeder
Sitemap to URL Crawler: RAG & AI Data Feeder — a Node.js client for the Apify Actor. Pull Sitemap to URL data at scale with no API-key hassle: thousands of clean, structured results you can export to JSON, CSV or Excel.
▶️ Run it on Apify: https://apify.com/logiover/sitemap-to-url-crawler
Install
npm install sitemap-to-url-crawlerUsage
const scrape = require("sitemap-to-url-crawler");
(async () => {
const items = await scrape({}, { token: process.env.APIFY_TOKEN });
console.log(items.length, "results");
console.log(items[0]);
})();Get your free Apify token at https://console.apify.com/account/integrations.
Input
| Field | Type | Description |
|---|---|---|
| startUrls | array | Start URLs (Domain or Sitemap) |
| maxUrls | integer | Max URLs to Extract |
| proxyConfiguration | object | Proxy Configuration |
All fields optional — run with empty input {} for a broad default result set.
Output
Each result item includes fields such as: url, lastmod, changefreq, priority, sourceSitemap.
Why use this
- ⚡ Thousands of results per run, auto-paginated
- 🔑 No Sitemap to URL login or reverse-engineering — just call the Actor
- 📦 Export to JSON, CSV, Excel, JSONL, XML
- ☁️ Runs on Apify cloud — schedule it, add webhooks, wire into Make / Zapier / n8n
FAQ
Do I need an API key?
Only a free Apify token (grab one at https://console.apify.com/account/integrations). No Sitemap to URL login and no scraping setup on your side.
How many results can I get?
Thousands per run. Raise the limit in the input to pull more — the Actor paginates for you.
What export formats are supported?
Results are plain JSON in code; from the Apify dataset you can export CSV, Excel, JSON, JSONL or XML.
Is this an official Sitemap to URL API?
No. It is an unofficial Sitemap to URL data client on the Apify platform — a maintained alternative when there is no official or affordable API.
Links
- ▶️ Run the Actor: https://apify.com/logiover/sitemap-to-url-crawler
- 📚 Docs & examples: https://github.com/logiover/sitemap-to-url-crawler
- 🧰 More scrapers by logiover: https://apify.com/logiover
MIT © 2026 logiover · Client library for the hosted Apify Actor. Not affiliated with Sitemap to URL.
