911-scraper-mcp
v1.0.9
Published
911Proxy Universal Web Scraper MCP Server - supports HTML extraction and screenshots
Downloads
125
Maintainers
Readme
911 Scraper MCP
🌐 Global web scraping capabilities for AI assistants via Model Context Protocol
✨ Features
- 🌍 Global Proxies: Access websites from 200+ countries and regions
- 📄 HTML Scraping: Extract complete HTML content from any webpage
- 📸 Screenshots: Automatically save full-page or viewport screenshots
- 🔄 JavaScript Rendering: Support for dynamic websites and SPAs
- 🚀 Batch Processing: Scrape multiple URLs at once
- 🤖 AI-Friendly: Designed for Claude, ChatGPT, and other AI assistants
🎯 Use Cases
- Content Analysis: Let AI analyze any website's content
- Competitor Research: Scrape competitor website information
- Data Collection: Batch collect webpage data
- Website Monitoring: Regularly check for webpage changes
- Geo-Targeting: Access websites from different countries
📦 Quick Start
1. Get 911Proxy API Credentials
- Visit 911proxy.com and register an account
- Create an API sub-account (Product Type: Scraper API)
- Get your username and password
2. Configure in AI Client
Claude Desktop
Edit the config file:
- macOS:
~/Library/Application Support/Claude/claude_desktop_config.json - Windows:
%APPDATA%/Claude/claude_desktop_config.json
Add configuration:
{
"mcpServers": {
"911-scraper": {
"command": "npx",
"args": ["-y", "911-scraper-mcp"],
"env": {
"SCRAPER_USERNAME": "your-api-username",
"SCRAPER_PASSWORD": "your-api-password"
}
}
}
}Cherry Studio
In Settings → MCP Servers, add the same configuration as above.
🔧 Special Configuration for NVM Users
If you use NVM (Node Version Manager), MCP clients may not be able to find npx automatically. You'll need to specify the full path to npx in your configuration.
Step 1: Find Your Node and NPX Paths
Run the following commands to locate your NVM installation:
Windows (Command Prompt or PowerShell):
where node
where npxmacOS:
which node
which npxLinux:
which node
which npxStep 2: Note the Output
You should see output similar to:
Windows:
C:\Users\Administrator\AppData\Roaming\nvm\v22.21.1\node.exe
C:\Users\Administrator\AppData\Roaming\nvm\v22.21.1\npx.cmdmacOS:
/Users/yourname/.nvm/versions/node/v22.21.1/bin/node
/Users/yourname/.nvm/versions/node/v22.21.1/bin/npxLinux:
/home/yourname/.nvm/versions/node/v22.21.1/bin/node
/home/yourname/.nvm/versions/node/v22.21.1/bin/npxStep 3: Update Your MCP Configuration
Use the full path to npx from Step 2 in your configuration file:
Windows Configuration:
{
"mcpServers": {
"911-scraper": {
"command": "C:\\Users\\Administrator\\AppData\\Roaming\\nvm\\v22.21.1\\npx.cmd",
"args": ["-y", "911-scraper-mcp"],
"env": {
"SCRAPER_USERNAME": "your-api-username",
"SCRAPER_PASSWORD": "your-api-password",
"PATH": "C:\\Users\\Administrator\\AppData\\Roaming\\nvm\\v22.21.1;%PATH%"
}
}
}
}macOS Configuration:
{
"mcpServers": {
"911-scraper": {
"command": "/Users/yourname/.nvm/versions/node/v22.21.1/bin/npx",
"args": ["-y", "911-scraper-mcp"],
"env": {
"SCRAPER_USERNAME": "your-api-username",
"SCRAPER_PASSWORD": "your-api-password",
"PATH": "/Users/yourname/.nvm/versions/node/v22.21.1/bin:${PATH}"
}
}
}
}Linux Configuration:
{
"mcpServers": {
"911-scraper": {
"command": "/home/yourname/.nvm/versions/node/v22.21.1/bin/npx",
"args": ["-y", "911-scraper-mcp"],
"env": {
"SCRAPER_USERNAME": "your-api-username",
"SCRAPER_PASSWORD": "your-api-password",
"PATH": "/home/yourname/.nvm/versions/node/v22.21.1/bin:${PATH}"
}
}
}
}Important Notes:
- Replace
yournamewith your actual username - Replace
v22.21.1with your actual Node.js version from Step 2 - On Windows, use double backslashes (
\\) in paths - On macOS/Linux, use forward slashes (
/) in paths - Don't forget to replace
your-api-usernameandyour-api-passwordwith your actual 911Proxy credentials
3. Restart AI Client
After configuration, restart Claude Desktop or Cherry Studio.
💬 Usage Examples
Once configured, simply send instructions to your AI:
📄 Scrape Webpage Content
Help me scrape https://www.example.com and summarize the content📸 Take Screenshot
Take a screenshot of https://www.google.com homepage🌍 Use Specific Region Proxy
Access https://www.google.com using Japan proxy and take a screenshot🔄 Scrape Dynamic Website
Scrape https://www.sojson.com with JavaScript rendering enabled📦 Batch Scraping
Help me batch scrape these websites:
1. https://www.example1.com
2. https://www.example2.com
3. https://www.example3.com🖼️ Screenshot Location
Screenshots are automatically saved to:
- Windows:
C:\Users\YourName\Downloads\scraper-screenshots\ - macOS:
/Users/YourName/Downloads/scraper-screenshots/ - Linux:
/home/yourname/Downloads/scraper-screenshots/
AI can help you open the screenshots folder:
Open screenshots folder⚙️ Advanced Configuration
Custom Screenshot Directory
Add to env in config file:
{
"env": {
"SCRAPER_USERNAME": "your-username",
"SCRAPER_PASSWORD": "your-password",
"SCREENSHOTS_DIR": "/custom/path/screenshots"
}
}Supported Country Codes
Common codes: US (United States), HK (Hong Kong), JP (Japan), GB (United Kingdom), DE (Germany), FR (France), SG (Singapore)
Note: CN (Mainland China) will be automatically mapped to HK (Hong Kong)
Supported Language Codes
Common codes: en-US (English), zh-CN (Chinese Simplified), ja-JP (Japanese), ko-KR (Korean), es-ES (Spanish)
❓ FAQ
Q1: Why does requesting both HTML and screenshot only return HTML?
A: 911Proxy API can only return one format per request. AI will automatically make two separate requests: first for HTML, then for screenshot.
Q2: Where are the screenshots?
A: Screenshots are saved in the scraper-screenshots subfolder in your Downloads folder. Tell AI "open screenshots folder" to view them.
Q3: Why is Google still in English when I set Japanese language?
A: You need to set both region and language. For example:
Access Google using Japan proxy and Japanese languageQ4: Batch scraping times out, what should I do?
A:
- Recommend scraping no more than 3 websites at once
- Or make requests in batches
- Avoid using batch scraping with JavaScript rendering
Q5: How to verify configuration is successful?
A: Send to AI:
Help me test the web scraping featureIf the tool list includes scrape_url, configuration is successful.
🔧 Troubleshooting
Configuration Not Working
- Check JSON format is correct (use JSON validator)
- Verify environment variable names are spelled correctly
- Restart AI client
- Check client logs
API Credentials Error
Ensure:
- Username and password are correct
- API sub-account type is Scraper API (product_type: 18)
- Account has sufficient balance
Can't Find Screenshots Folder
Tell AI:
Where are screenshots saved?📞 Get Help
- 911Proxy Official: 911proxy.com
📄 License
MIT License - see LICENSE file for details
🙏 Credits
Built with Model Context Protocol (MCP)
Powered by 911 Proxy
