sitego

Fetch HTML and convert to Markdown, or fetch llms.txt as-is.

Install

npm install -D sitego

Usage

# Convert HTML to Markdown
npx sitego search https://example.com

# Fetch llms.txt by URL
npx sitego docs https://hono.dev/llms.txt

# Fetch llms.txt by config key
npx sitego docs hono

# Fetch llms-full.txt by config key
npx sitego docs hono --full

Config

// sitego.config.ts
import { defineConfig } from 'sitego/config'

export default defineConfig({
  llms: {
    hono: 'https://hono.dev/llms.txt',
  },
  'llm-full': {
    hono: 'https://hono.dev/llms-full.txt',
  },
})

License

Distributed under the MIT License. See LICENSE for more information.