@apify-scrapers/shared

Shared utilities and constants for Apify e-commerce scrapers.

Installation

npm install @apify-scrapers/shared

Usage

Import utilities

import { 
    detectPlatform, 
    getNextPageUrl, 
    extractProductId, 
    normalizeProductUrl, 
    convertToCSV, 
    cleanProductData 
} from '@apify-scrapers/shared';

Import constants

import { 
    PLATFORM_SELECTORS, 
    DEFAULT_CONFIG 
} from '@apify-scrapers/shared';

Import specific modules

// Import only utilities
import { convertToCSV } from '@apify-scrapers/shared/utils';

// Import only constants
import { PLATFORM_SELECTORS } from '@apify-scrapers/shared/constants';

API Reference

Utilities

detectPlatform(url)

Detects the e-commerce platform from a URL.

getNextPageUrl(url, pageNum, platform)

Generates the next page URL for pagination.

extractProductId(productUrl)

Extracts product ID from a product URL.

normalizeProductUrl(productUrl, baseUrl)

Normalizes product URLs to absolute URLs.

convertToCSV(data, options)

Converts data array to CSV format.

cleanProductData(productData)

Cleans and standardizes product data.

Constants

PLATFORM_SELECTORS

CSS selectors for different e-commerce platforms (Shopee, Lazada).

DEFAULT_CONFIG

Default configuration for scrapers.

Supported Platforms

• Shopee: Singapore, Malaysia, Indonesia, Philippines, Thailand, Vietnam
• Lazada: Singapore, Malaysia, Indonesia, Philippines, Thailand, Vietnam

License

MIT