@openclaw/amazon-scraper-core

Core library for Amazon scraping with advanced anti-detection (P0+P1 protection).

This is the underlying library used by @openclaw/commerce-buddy CLI. Use this package if you want to build your own custom scraping solution.

Installation

npm install @openclaw/amazon-scraper-core

Usage

import { SessionManager, searchProducts, scrapeReviews } from '@openclaw/amazon-scraper-core';

async function scrape() {
  // Initialize session
  const sessionManager = new SessionManager();
  const { context } = await sessionManager.initialize();
  const page = await context.newPage();

  // Ensure logged in
  await sessionManager.ensureLoggedIn(page);

  // Search products
  const products = await searchProducts(page, 'wireless mouse');

  // Scrape reviews
  for (const product of products.slice(0, 5)) {
    const reviews = await scrapeReviews(page, product.url);
    console.log(`${product.title}: ${reviews.length} reviews`);
  }

  // Cleanup
  await sessionManager.cleanup();
}

scrape();

API

SessionManager

Manages browser sessions with persistent login:

const sessionManager = new SessionManager();
const { browser, context } = await sessionManager.initialize();
await sessionManager.ensureLoggedIn(page);
await sessionManager.saveSession();
await sessionManager.cleanup();

searchProducts(page, keyword)

Search Amazon and return product list:

const products = await searchProducts(page, 'laptop');
// Returns: Product[]

scrapeReviews(page, productUrl)

Scrape reviews from a product page:

const reviews = await scrapeReviews(page, productUrl);
// Returns: Review[]

Anti-Detection Features

• P0 Protection: WebDriver hiding, Chrome API spoofing
• P1 Protection: Canvas, WebGL, Audio fingerprinting evasion
• Human Behavior: Natural mouse, typing, scrolling
• Session Management: Persistent login state

License

MIT