Slector

Preparing Queries for Web-Scraping

This package is used to create 'Slectors' (otherwise known as DOM Queries) which you can then use in your Web Scraping | Machine Learning projects.

Quickstart Guide

Initialise a Node Project.

Install Slector:

npm install slector -D

Import Slector:

import Slector from "slector";

Create a Slector options object:

const options = {showExtConsole: true, collectionTypes: ["EndPoint", "Method Description"], startUrl: "https://www.coingecko.com/en/api/documentation", slectors: previousSlectors, exportTextContent: true,}

Slector Options Available

| Property | Definition | Required? | | ----------------- | --------------------------------------------------------------------- | --------- | | collectionTypes | string[]: The available Slector names/categories/groups. | ✅ | | startUrl | string: The first url to navigate to (after extension setup) | ✅ | | slectors | slectors[]: Previously exported slector data to load on setup. | ❌ | | exportTextContent | boolean: Will collect text content of all highlighted DOM elements. | ❌ | | showExtConsole | boolean: Will open background-script inspector on startup. | ❌ |

Create a new Slector Instance:

const slector = new Slector(options);

Run Slector and export data:

const res = await slector.slect();

Open the browser, make your selections, and when you click 'DONE' in the extension - return all your Slector Instance JSON data.