@muid-io/crawl4ai-rag-mcp

MCP client for connecting to Crawl4AI RAG system. This package bridges stdio (used by Claude Code and other MCP clients) to the SSE transport used by the Crawl4AI RAG FastMCP server.

Features

• 🌐 Web crawling and content extraction
• 🔍 RAG (Retrieval Augmented Generation) capabilities
• 🧠 Knowledge graph integration
• 📚 Document management and search
• 🤖 AI hallucination detection

Installation

No installation needed! Use directly with npx:

npx @muid-io/crawl4ai-rag-mcp@latest

Claude Code Configuration

Add to your Claude Code MCP servers:

claude mcp add crawl4ai-rag npx -y @muid-io/crawl4ai-rag-mcp@latest

Or manually add to your MCP configuration:

{
  "mcpServers": {
    "crawl4ai-rag": {
      "command": "npx",
      "args": ["-y", "@muid-io/crawl4ai-rag-mcp@latest"],
      "env": {
        "CRAWL4AI_URL": "https://rag-mcp.muid.io/sse"
      }
    }
  }
}

Available Tools

Core Tools

1. crawl_single_page - Crawl a single web page
2. smart_crawl_url - Intelligently crawl with automatic URL type detection
3. get_available_sources - List all crawled sources
4. perform_rag_query - Search content using RAG

Optional Tools (when configured)

5. search_code_examples - Search for code examples
6. parse_github_repository - Parse GitHub repos into knowledge graph
7. check_ai_script_hallucinations - Validate AI-generated code
8. query_knowledge_graph - Query Neo4j knowledge graph

Environment Variables

• CRAWL4AI_URL - Server URL (default: https://rag-mcp.muid.io/sse)
• DEBUG - Enable debug logging (set to "true")

Server Information

• Production Server: https://rag-mcp.muid.io
• Documentation: https://github.com/coleam00/mcp-crawl4ai-rag
• Status: No authentication required

Example Usage

Once configured, you can use the tools in Claude Code:

"Crawl the React documentation and store it"
"Search for information about React hooks"
"What sources are available in the database?"

Troubleshooting

If you see connection errors:

1. Check server status: curl -I https://rag-mcp.muid.io/sse
2. Enable debug mode: Set DEBUG=true in environment
3. Verify network connectivity

License

MIT

Support

For issues or questions, visit: https://github.com/muid-io/crawl4ai-rag-mcp-client