@rezalabs/url-scanner
v1.0.0
Published
Recursively scans project code files for URLs and API endpoints
Maintainers
Readme
@rezalabs/url-scanner
Recursively scans project code files for URLs and API endpoints.
Features
- Extracts HTTP/HTTPS, WebSocket, FTP URLs
- Detects API endpoints and REST paths
- Identifies environment variable URLs
- URL classification by service type
- Multiple output formats (Markdown, JSON, CSV)
- Deduplication support
- Line number tracking
- .gitignore support
Installation
npm install -g @rezalabs/url-scannerUsage
Basic Usage
url-scannerThis generates a PROJECT-URLS.md file in the current directory.
Options
url-scanner [options]
Options:
-o, --output <file> Output file (default: PROJECT-URLS.md)
-f, --format <type> Output format: markdown|json|csv (default: markdown)
-c, --clipboard Copy result to clipboard
--no-gitignore Ignore .gitignore file
-d, --include-duplicates Include duplicate URLs
-v, --verbose Verbose output
--version Show version number
-h, --help Show helpExamples
Generate report in JSON format:
url-scanner --format json --output urls.jsonInclude duplicate URLs:
url-scanner --include-duplicatesGenerate CSV for analysis:
url-scanner --format csv --output urls.csvURL Classification
The tool automatically classifies URLs into categories:
- Local Development - localhost, 127.0.0.1
- Version Control - GitHub, GitLab, Bitbucket
- Google Services - Google APIs, Firebase
- AWS Services - S3, EC2, Lambda
- Azure/Microsoft - Azure services, Microsoft APIs
- Authentication - Auth0, Okta, Cognito
- CDN - CloudFront, Cloudflare, jsDelivr
- Payment - Stripe, PayPal
- Email - SendGrid, Mailgun, Postmark
- Monitoring - Sentry, Datadog, Grafana
- And many more...
Scanned File Types
The tool scans a wide range of file types including:
- JavaScript/TypeScript (.js, .jsx, .ts, .tsx, .vue, .svelte)
- Python (.py)
- Go (.go)
- Configuration files (.json, .yaml, .toml, .xml, .env)
- HTML/CSS (.html, .css, .scss, .less)
- And more...
Contributing
Contributions are welcome! Please see the main Contributing Guide.
License
MIT
