web-search

web-search is a Unix-style CLI for web search, extraction, and proxy rotation over the hosted REST API.

It talks to:

• https://web-search.oremuslabs.app for API requests
• https://search.oremuslabs.app indirectly through the API for SearXNG-backed search

The CLI exposes three commands:

• search for SearXNG-backed web results
• extract for Trafilatura-backed page extraction
• rotate for manual VPN/proxy rotation

Install

GitHub Release tarball

npx -y https://github.com/Oremus-Labs/web-search/releases/latest/download/web-search.tgz search "vatican"

npm

npx -y @oremus-labs/web-search search "vatican"

Configuration

Optional environment variables:

• WEB_SEARCH_API_URL
  • Defaults to https://web-search.oremuslabs.app
• USER_AGENT
  • Preferred command: web-search

Commands

search

web-search search "vatican" --json
web-search search "site:docs.python.org asyncio" --language en --time-range year

Flags:

• --json
• --pageno <n>
• --time-range day|month|year
• --language <code>
• --safesearch 0|1|2

extract

web-search extract "https://example.com/article" --json
web-search extract "https://github.com/org/repo/blob/main/README.md" --max-chars 4000 --start-char 0

Flags:

• --json
• --include-comments
• --include-tables
• --no-proxy
• --max-chars <n>
• --start-char <n>
• --max-fetch-bytes <n>
• --fetch-timeout-seconds <n>
• --user-agent <value>
• --accept-language <value>
• --plain-text-fallback
• --no-rewrite-github-blob-to-raw
• --max-total-seconds <n>

rotate

web-search rotate --json

Local development

cd web-search
npm install
npm test
npm run build
WEB_SEARCH_API_URL="http://127.0.0.1:18090" npm run smoke

Local cluster access

Port-forward the in-cluster API if you do not want to use the public hostname:

kubectl -n searxng port-forward svc/searxng-web-search-api 18090:8090
WEB_SEARCH_API_URL="http://127.0.0.1:18090" web-search search "example domain"

Notes

• This repo no longer provides an MCP server.
• The Kubernetes-side MCP endpoint and MCP session recovery logic were replaced by a plain REST API.