@nest-native/jobs
v0.1.0
Published
Background jobs for NestJS without Redis — a Drizzle-backed job queue (SQLite, Postgres + MySQL) with transactional enqueue, retries, delayed and unique jobs
Maintainers
Readme
@nest-native/jobs
[!NOTE] v0.x — early but stable. The producer, claimer, handler discovery, and the three Drizzle stores are implemented and tested at 100% coverage. SQLite, Postgres, and MySQL are supported.
The problem it solves
Most NestJS apps grow a first background job long before they need a queueing system: send a welcome email after signup, generate a report, retry a flaky webhook. The official NestJS answer is @nestjs/bullmq — which means operating Redis for what is often a handful of jobs a minute. And because Redis is a second system, the classic dual-write bug appears on day one: the signup commits but the process crashes before queue.add() — the email is never sent. Or queue.add() succeeds and the transaction rolls back — a welcome email for a user that does not exist.
@nest-native/jobs stores jobs in the same Drizzle database your app already has:
- Transactional enqueue —
enqueue()inserts the job row inside your business transaction (via@nestjs-cls/transactional). The job exists if and only if your writes committed. - Nest-native execution — declare a class with
@JobHandler('email.welcome'), register it as a provider, and the claimer dispatches to it with full DI. Handlers are discovered at bootstrap; duplicate names throw at startup. - Retries, delays, priorities, unique jobs — jittered exponential backoff (or
RetryableError's explicitdelayMs),PermanentErrorto fail fast,runAt/delayMsscheduling,priorityordering, anduniqueKeydedup among active jobs. - Zero runtime dependencies — everything (Nest, Drizzle, your driver) is a peer you already installed.
Install
npm install @nest-native/jobs
# plus your driver (peer dependencies):
npm install drizzle-orm @nestjs-cls/transactional better-sqlite3 # or pg / mysql2Entry points
| Import | Contents |
| --- | --- |
| @nest-native/jobs | core engine — JobsService (enqueue), JobsClaimer + runWorkerLoop, @JobHandler + JobsHandlerExplorer, RetryableError/PermanentError, the JobStore seam, JobsModule |
| @nest-native/jobs/sqlite | better-sqlite3 (synchronous) store + the jobs table definition |
| @nest-native/jobs/postgres | node-postgres (async) store + table definition |
| @nest-native/jobs/mysql | mysql2 (async) store + table definition |
| @nest-native/jobs/testing | drainJobs + RecordingJobHandler for hermetic tests |
Usage
// app.module.ts — wire CLS + the dialect store once
JobsModule.forRoot({
drizzleInstanceToken: DRIZZLE,
store: new SqliteJobStore(),
});
// user.service.ts — enqueue inside the business transaction
@Injectable()
export class UserService {
constructor(
@InjectTransaction() private readonly db: AppDatabase,
private readonly jobs: JobsService<SqliteJobStore>,
) {}
@Transactional()
register(email: string) {
this.db.insert(users).values({ email }).run();
this.jobs.enqueue({
name: 'email.welcome',
payload: { email },
uniqueKey: `welcome:${email}`, // dedup among active jobs
});
// both rows commit atomically; a throw rolls both back
}
}
// welcome-email.handler.ts — executed by the claimer, with full DI
@JobHandler('email.welcome')
@Injectable()
export class WelcomeEmailHandler implements JobHandler {
async handle(payload: Record<string, unknown>, ctx: JobContext) {
await this.mailer.send(String(payload.email)); // throw RetryableError / PermanentError to steer retries
}
}
// worker (same process or a dedicated one)
const controller = new AbortController();
void runWorkerLoop(app.get(JobsClaimer), { signal: controller.signal });Delivery is at-least-once: a worker crash mid-job means the row is reclaimed after stuckTimeoutMs and run again. Make handlers idempotent or key their side effects on ctx.jobId.
The uniqueKey contract
uniqueKey means "unique among active jobs", identically on all three dialects: a full unique index on (name, unique_key), and terminal transitions (completed, failed) clear the key. Enqueueing a duplicate (name, uniqueKey) while one is pending/processing is a no-op that returns the existing row; once that job finishes, the key is free again. Jobs without a uniqueKey never collide.
Honest comparison
| | BullMQ (@nestjs/bullmq) | pg-boss | @nest-native/jobs |
| --- | --- | --- | --- |
| Backing store | Redis (required) | Postgres only | the Drizzle DB you already run — SQLite, Postgres, or MySQL |
| NestJS integration | official wrapper module | none (framework-agnostic) | native — module, DI, @JobHandler decorators |
| Enqueue in your DB transaction | no (Redis is a second system) | yes (raw SQL in your tx) | yes — first-class, via @nestjs-cls/transactional |
| Delivery | Redis push (blocking ops) | polling + LISTEN/NOTIFY | polling claimer |
| Throughput | very high | high | right-sized — polling batches, fine for most apps' background work |
| Repeatable / cron jobs | yes | yes | no (non-goal — use @nestjs/schedule) |
| Dashboards, rate limiting | yes | partial | no |
| Runtime dependencies | Redis server + client | pg | zero (peers you already have) |
If you need tens of thousands of jobs per second, sandboxed processors, or a dashboard, use BullMQ — it is excellent at that. If you run Postgres without Nest, pg-boss is battle-tested. This library is for the large middle: NestJS + Drizzle apps that want reliable background jobs without operating another system.
Non-goals (v0.1)
- Cron / repeatable jobs —
@nestjs/schedulealready does this well; combine it withenqueue()if you want scheduled work to flow through the queue. - Dashboards / UI, rate limiting, concurrency groups.
- LISTEN/NOTIFY push — the claimer polls;
pollIntervalMsis your latency knob. - Redis-class throughput — this is a polling claimer over your relational DB, by design.
Part of the nest-native family. Not affiliated with the NestJS core team. MIT licensed.
