socialcrawl-mcp

Give your AI agent access to 44 platforms — social media, commerce & product reviews, app stores, places & travel, business reputation, web research, full web scraping & browser automation, prediction markets, search trends, cross-platform Prism composites, and a universal cross-platform meta-search — through a single API

Overview | Installation | Setup | Usage | Tools | Platforms

Overview

socialcrawl-mcp is an MCP (Model Context Protocol) server that connects AI agents to the SocialCrawl API — a unified data API covering 44 platforms and 357 endpoints.

Retrieve profiles, posts, comments, search results, trending content, and analytics from TikTok, Instagram, YouTube, Twitter/X, LinkedIn, Reddit, GitHub, Hacker News, Polymarket, and 30 more platforms. Pull products, reviews, and sellers from Amazon and Google Shopping; apps, charts, and reviews from Google Play and the Apple App Store; places, hotels, and traveler reviews from Tripadvisor and Google Business; brand reputation from Trustpilot; Korean search across 11 Naver corpora; cross-web brand mentions with sentiment via Content Analysis; Google News headlines and Google Finance quotes — plus web research via Tavily and Perplexity, AI-powered X search via Grok, and a single /search/everywhere endpoint that fans out across 12+ sources in one call.

New in this release: a major LinkedIn expansion (44 endpoints — full profiles & company pages, posts/reposts/reactions, comments & replies, people & company-people search, structured profile sub-resources, jobs, company insights, and groups), deeper Instagram coverage (followers/following, similar accounts, post likers, stories, tagged & location feeds, post-reshare stats, engagement analytics, and one-call reels/posts feeds with per-item share counts), and new YouTube capabilities (trending & advanced search, autocomplete suggestions, playlist items, and downloadable media files — audio, video, subtitles, thumbnails). Alongside the Prism family — server-side composite endpoints that fan out across many platforms and fold the results into one report (universal URL lookup, full comments harvesting, cross-source reputation, share-of-voice, brand-mention and consumer-demand nowcasts, AI consensus answers, crisis radar, creator vetting, and video/app/product intelligence). One API key, one consistent response format, every platform.

What the MCP server does:

• Discovers available platforms and endpoints dynamically
• Fetches live social media data on your behalf
• Validates requests locally before making API calls (saves credits)
• Provides built-in API documentation the agent can query on demand

Installation

Remote server (hosted — no install)

Connect straight to the hosted Streamable HTTP endpoint — nothing to install or run:

Claude Code (works in the CLI and Claude Code on the web / cloud sandboxes)

claude mcp add --scope user --transport http socialcrawl https://mcp.socialcrawl.dev/mcp \
  --header "Authorization: Bearer sc_your_key_here"

Any client that reads .mcp.json

{
  "mcpServers": {
    "socialcrawl": {
      "type": "http",
      "url": "https://mcp.socialcrawl.dev/mcp",
      "headers": { "Authorization": "Bearer ${SOCIALCRAWL_API_KEY}" }
    }
  }
}

Cursor / Windsurf / VS Code — choose the HTTP ("streamable-http") server type with the same URL and header. x-api-key: sc_your_key_here works as an alternative header.

The discovery tools (socialcrawl_list_platforms, socialcrawl_list_endpoints, socialcrawl_get_docs) work without a key, so you can explore before signing up. claude.ai custom connectors (Settings → Connectors) require OAuth, which ships in a follow-up release — use the header-based setup above in the meantime.

Prefer running it locally? Every stdio option below works exactly as before.

npm

npm install -g socialcrawl-mcp

Available on npm. Most users don't need this — the MCP client configs below use npx and auto-install on first run.

Claude Code (quickest)

claude mcp add --scope user socialcrawl -- npx -y socialcrawl-mcp

Then set your API key:

claude mcp add-env socialcrawl SOCIALCRAWL_API_KEY sc_your_key_here

Claude Desktop

Add to ~/Library/Application Support/Claude/claude_desktop_config.json (macOS) or %APPDATA%\Claude\claude_desktop_config.json (Windows):

{
  "mcpServers": {
    "socialcrawl": {
      "command": "npx",
      "args": ["-y", "socialcrawl-mcp"],
      "env": {
        "SOCIALCRAWL_API_KEY": "sc_your_key_here"
      }
    }
  }
}

Cursor

Add to .cursor/mcp.json in your project root or ~/.cursor/mcp.json globally:

{
  "mcpServers": {
    "socialcrawl": {
      "command": "npx",
      "args": ["-y", "socialcrawl-mcp"],
      "env": {
        "SOCIALCRAWL_API_KEY": "sc_your_key_here"
      }
    }
  }
}

VS Code (Claude Code)

Add to .vscode/mcp.json in your project or your user settings:

{
  "servers": {
    "socialcrawl": {
      "type": "stdio",
      "command": "npx",
      "args": ["-y", "socialcrawl-mcp"],
      "env": {
        "SOCIALCRAWL_API_KEY": "sc_your_key_here"
      }
    }
  }
}

Windsurf

Add to your Windsurf MCP configuration:

{
  "mcpServers": {
    "socialcrawl": {
      "command": "npx",
      "args": ["-y", "socialcrawl-mcp"],
      "env": {
        "SOCIALCRAWL_API_KEY": "sc_your_key_here"
      }
    }
  }
}

Other MCP-compatible clients

Any MCP client that supports stdio transport can use this server. The general pattern is:

• Command: npx
• Args: ["-y", "socialcrawl-mcp"]
• Environment: SOCIALCRAWL_API_KEY set to your API key

Restart your AI client after saving the configuration.

Setup

1. Get your API key

Sign up at socialcrawl.dev and grab your API key from the dashboard. Every account starts with 100 free credits — no credit card required.

2. Add the key to your config

Replace sc_your_key_here in the installation config above with your actual API key (starts with sc_).

[!TIP] You can also set SOCIALCRAWL_API_KEY as a system environment variable instead of putting it in the MCP config. The discovery and documentation tools work even without a key — only actual API requests need one.

Usage

Ask your AI agent in natural language. The MCP server handles the rest.

Fetch a profile

Get the TikTok profile for @charlidamelio

The agent calls socialcrawl_request with platform: "tiktok", resource: "profile", params: { handle: "charlidamelio" } and returns structured profile data including followers, bio, verification status, and engagement metrics.

Search across platforms

Search YouTube for "machine learning tutorials"

Get post comments

Get the comments on this Instagram post: https://instagram.com/p/CwA1234abcd

Cross-platform research

Compare the follower counts of @mkbhd on TikTok, Instagram, YouTube, and Twitter

The agent makes 4 sequential API calls — one per platform — and compiles the results into a comparison.

Explore available endpoints

What social media platforms can you access?

Show me all the TikTok endpoints

Access documentation

How does the SocialCrawl credit system work?

Example response

Every response follows a unified envelope format:

{
  "success": true,
  "platform": "tiktok",
  "endpoint": "/v1/tiktok/profile",
  "data": {
    "content": { "text": "...", "media_urls": ["..."] },
    "author": { "username": "charlidamelio", "followers": 156000000 },
    "engagement": { "likes": 5200, "engagement_rate": 0.045 },
    "metadata": { "language": "en", "content_category": "entertainment" }
  },
  "credits_used": 1,
  "credits_remaining": 99
}

[!NOTE] The same response structure is returned for every platform — no per-platform parsing logic needed.

Available Tools

The MCP server exposes 7 tools:

| Tool | Description | Needs API key? | |------|-------------|----------------| | socialcrawl_list_platforms | Discover all 44 platforms with their endpoints and capabilities | No | | socialcrawl_list_endpoints | See all endpoints, required parameters, and credit costs for a platform | No | | socialcrawl_request | Make any SocialCrawl API call — profiles, posts, comments, search, trends, analytics, Prism composites. GET endpoints take query params; POST batch endpoints (e.g. youtube/videos, prism/profiles) take their array/object body. Supports an optional idempotencyKey for retry-safe calls. | Yes | | socialcrawl_check_balance | Check remaining credits and recent deduction summary. Calls /v1/credits/balance — costs 0 credits. | Yes | | socialcrawl_monitors | Create and manage stateful monitors that re-run any recipe on a cadence, deliver results to a signed webhook, and accumulate a time-series. Actions: create, list, get, runs, timeseries, pause, resume, delete. | Yes | | socialcrawl_web | Full web scraping & browser automation (the web platform). Sync scrape/search/map/extract; async crawl/batch_scrape/agent jobs with poll/cancel; stateful monitors; interactive browser sessions. One action per endpoint. | Yes | | socialcrawl_get_docs | Access detailed API documentation by topic or platform | No |

Three of the seven tools work without an API key — they query local bundled data. socialcrawl_request, socialcrawl_check_balance, socialcrawl_monitors, and socialcrawl_web require a key.

Monitors — schedule any recipe

socialcrawl_monitors wraps any registry endpoint or Prism composite in a scheduled, stateful monitor (/v1/monitors/*). It re-runs the recipe hourly/daily/weekly (or on a cron), delivers each result to an HMAC-signed webhook, raises alerts on metric thresholds or changes, and keeps a per-run time-series you can read back. "Prism answers once; monitors watch it for you." Managing monitors costs 0 credits; each scheduled run bills the recipe's normal cost plus a 1-credit scheduling premium. See socialcrawl_get_docs topic monitors for the full contract.

Web — scrape, crawl, browse

socialcrawl_web drives the full web-scraping and browser-automation surface (the web platform, /v1/web/*) through a single action parameter:

• Sync reads — scrape (URL → markdown/HTML/screenshot/links), search (web search with page content), map (discover a site's URLs), extract (LLM structured data from a page).
• Async jobs — crawl a whole site, batch_scrape many URLs, or agent (autonomous multi-step web task); each returns a job you poll with job_get/job_list and stop with job_cancel.
• Monitors — monitor_create/list/get/update/delete/checks re-check a URL on a cadence and deliver changes to a webhook.
• Sessions — session_create/get/list, session_execute (run code in the live page), session_close.

Pricing varies by action (scrape 1cr, search 2cr, extract & session_create 5cr, agent 25cr; job/monitor/session management 0cr). See socialcrawl_get_docs topic web.

Smart validation

Before making any API call, socialcrawl_request validates locally that the platform exists, the endpoint exists, and all required parameters are present. If something is wrong, it tells the agent exactly how to fix it — without consuming any credits.

Retry-safe requests

Pass an idempotencyKey to socialcrawl_request (UUIDv4 recommended) to make the call retry-safe. If the request is replayed within 24h, the server returns the original response and deducts 0 credits (X-Idempotent-Replay: true).

Supported Platforms

| Platform | Endpoints | Data Available | |----------|-----------|----------------| | LinkedIn | 44 | Profiles & company pages, posts, reposts, reactions, comments & replies, people/company-people search, profile sub-resources (experience, education, skills, certifications…), jobs (search, company jobs, details), company insights, groups, transcripts, Ad Library, profile-360 | | Instagram | 33 | Profiles, posts, reels, comments (incl. single-comment lookup), highlights, stories, tagged & location feeds, followers/following, similar accounts, post likers, reshare stats, one-call reels/posts feeds with share counts, engagement analytics, search (reels/hashtag/profile/location/music), trending, transcripts, profile-360 | | Prism | 33 | Cross-platform composites — URL lookup, comment harvesting, batch comment-lookup & profile-lookup, handle-audit, brand mentions, demand signals, AI visibility, crisis radar/post-mortem, reputation, share-of-voice, creator vetting, AI consensus answers, video/app/product intelligence | | YouTube | 28 | Channels, videos, shorts, comments & replies, sponsors, playlists & items, community posts, search (advanced + autocomplete), trending, live streams, media files (audio/video/subtitles/thumbnails), transcripts, batch videos/channels/transcripts, profile-360 | | Facebook | 22 | Pages, posts, comments, groups, photos, reels, events, Marketplace, transcripts, full Ad Library | | Web Scraping | 22 | Scrape, web search, site map, LLM extract, async crawl/batch-scrape/agent jobs, change monitors, interactive browser sessions, document parse — driven by socialcrawl_web | | TikTok | 20 | Profiles, videos, comments & replies (incl. single-comment lookup), search, trending, audience, followers, live, songs, transcripts, profile-360 | | GitHub | 12 | Users, repos, issues, PRs, READMEs, releases, search, repo dossier, user profile-velocity | | Naver | 12 | Korea's #1 portal — blog, news, book, encyclopedia, cafe, KiN, local, shopping, doc, image, web search, brief | | Content Analysis | 10 | Cross-web brand mentions, sentiment, rating distributions, phrase/category trends | | Google | 10 | Web search, Ads Transparency, Business Profile (info, reviews, updates, Q&A), Travel hotels | | Apple App Store | 9 | App search, search suggestions, app details, reviews, charts, listings database, reference data | | Google Play | 9 | App search, search suggestions, app details, reviews, charts, listings database, reference data | | Twitter/X | 8 | Profiles, tweets, communities, video transcripts, AI search via Grok, profile-360 | | Reddit | 7 | Subreddits, posts, comments, search, transcripts, omni-search VoC sweep | | Spotify | 6 | Artists, tracks, albums, podcasts, episodes, search | | Amazon | 5 | Product search, ASIN details, reviews, sellers, shop pages | | Pinterest | 5 | Pins, boards, search, URL save-counts | | Rumble | 5 | Search, channel videos, video details, comments, transcripts | | Threads | 5 | Profiles, posts, keyword search, user search | | TikTok Shop | 5 | Products, reviews, listings, search, creator showcases | | Google Shopping | 4 | Product search, product details, cross-retailer reviews, sellers | | Hacker News | 4 | Story search, story, comment tree, profile | | Tavily | 4 | Web search (with LLM answer), URL extraction, sitemap, full crawl | | Twitch | 4 | Profiles, clips, videos, schedules | | Bluesky | 3 | Profiles, posts | | Google Finance | 3 | Instrument quotes, markets overview, ticker search | | Kwai | 3 | Profiles, posts | | Truth Social | 3 | Profiles, posts | | Google Trends | 2 | Interest-over-time (explore) + rising/breakout related queries | | Tripadvisor | 2 | Place search, traveler reviews | | Trustpilot | 2 | Business search, company reviews | | Universal Search | 2 | One query fanned out across 12+ platforms (20cr); forums lane | | Google News | 1 | Real-time Google News SERP search | | Kick | 1 | Clips | | Komi | 1 | Link pages | | Linkbio | 1 | Link pages | | Linkme | 1 | Link pages | | Linktree | 1 | Link pages | | Perplexity | 1 | Sonar web research with cited sources | | Pillar | 1 | Link pages | | Polymarket | 1 | Prediction-market research — multi-query fan-out + ranking | | Snapchat | 1 | Profiles | | Utility | 1 | Age & gender detection |

Total: 357 endpoints across 44 platforms.

Error Handling

The MCP server handles errors gracefully and gives the agent actionable guidance:

| Error | What the agent sees | |-------|---------------------| | Missing API key | Prompts to set SOCIALCRAWL_API_KEY with link to sign up | | Invalid API key | Asks to check the key configuration | | Insufficient credits | Shows balance and links to billing page | | Bad platform/resource | Suggests using discovery tools to find the right endpoint | | Missing parameters | Lists exactly what's missing with examples | | Resource not found (404) | Reports the upstream resource doesn't exist; credits auto-refunded (BIL-01) | | Idempotency-Key conflict (409) | Tells the agent the key was used by another account — generate a fresh one | | Idempotency-Key payload mismatch (422) | Tells the agent the same key was reused with different params | | Method not allowed (405) | Reminds the caller that /v1/* is GET-only | | Concurrency limit (429) | Asks the caller to back off (50 concurrent/key max) | | Upstream error (502) | Reports the failure; credits refunded automatically | | Platform unavailable (503) | Circuit breaker open; credits refunded; retry in 30s |

Links

• Get Your API Key — 100 free credits, no credit card required
• API Documentation — full endpoint reference, credits, and error codes
• SocialCrawl Website
• npm Package
• MCP Registry
• Getting Started Guide
• How It Works