Installation

npm add @openaddresses/batch-generic

Example Usage

The Generic Pool object is a wrapper around a Drizzle-ORM PgDatabase with the addition of several functions related to connection management and generation of internal JSON schemas.

import { Pool } from '@openaddresses/batch-generic';

async function start() {
    const pool = await Pool.connect('postgres://<conn-str>', schema);

    await pool.end();
}

Write/Read Load Balancing

If your database is deployed as a single writer with a cluster of read replicas, a { write, read } pair of connection strings can be provided in place of a single connection string. Read queries issued by the Modeler (from, list, count, iter, stream) are load balanced round-robin across the read connection(s), while write queries (generate, commit, delete, clear) are issued against the write connection.

import Modeler, { Pool } from '@openaddresses/batch-generic';

async function start() {
    const pool = await Pool.connect({
        write: 'postgres://writer.example.com:5432/db',
        read: [
            'postgres://reader-1.example.com:5432/db',
            'postgres://reader-2.example.com:5432/db'
        ]
    }, schema);

    const model = new Modeler(pool, schema.MyTable);

    await model.from(1);        // routed to a reader
    await model.commit(1, {});  // routed to the writer

    // pool.read returns the next reader pool for custom read queries
    await pool.read.select().from(schema.MyTable);

    await pool.end();
}

Note: read replicas are typically subject to replication lag - immediately reading back a row after a write may return stale data.

Tables

Each table within the database should also receive it's own Class definition that extends Generic. Upon Pool connection, a JSON Schema is generated dynamically for each table in the database. This schema is then used to ensure that objects always dynamically mirror their in database representations. State of the class is thus managed almost entirely though the database definition and automatically mirrored to the class.

CREATE TABLE dog (
    id      BIGSERIAL PRIMARY KEY,
    breed   TEXT,
    size    TEXT NOT NULL,
    tags    JSONB
);

import Generic from '@openaddresses/batch-generic';

class MyClass extends Generic {
    static _table = '<postgres table name>';
}

import { Pool } from '@openaddresses/batch-generic';
import Dog from './lib/types/dog.js';

async function start() {
    const pool = await Pool.connect('<postgres://<conn-str>');

    const dog = await Dog.from(pool, 1);
    await dog.commit({
        breed: 'newfie',
        size: 'large',
        tags: ['tag']
    });
    await dog.delete();

    await pool.end();
}

Views

Views are also supported by extending the Generic class. Views are given access to read-only functions such as list() or from() but access to write functions such as commit() or generate() will produce an error.

CREATE TABLE view_dog
    AS
        SELECT
            *
        FROM
            dog

import Generic from '@openaddresses/batch-generic';

class MyClass extends Generic {
    static _view = '<postgres view name>';
}

import { Pool } from '@openaddresses/batch-generic';
import Dog from './lib/views/dog.js';

async function start() {
    const pool = await Pool.connect('<postgres://<conn-str>');

    const dog = await Dog.from(pool, 1);

    await pool.end();
}

Docs

API Docs can be found here