@trieb.work/nextjs-turbo-redis-cache
v1.15.0
Published
Designed for speed, scalability, and optimized performance, nextjs-turbo-redis-cache is your custom cache handler for demanding production environments.
Readme
nextjs-turbo-redis-cache - Next.js Cache Handler
The ultimate Redis Cache Handler for Next.js 15 / 16 and the app router. Built for production-ready, large-scale projects, it delivers unparalleled performance and efficiency with features tailored for high-traffic applications. This package has been created after extensibly testing the @neshca package and finding several major issues with it.
Key Features:
- Batch Tag Invalidation: Groups and optimizes delete operations for minimal Redis stress.
- Request Deduplication: Prevents redundant Redis get calls, ensuring faster response times.
- In-Memory Caching: Includes local caching for Redis get operations to reduce latency further. Don't request redis for the same key multiple times.
- Efficient Tag Management: in-memory tags map for lightning-fast revalidate operations with minimal Redis overhead.
- Intelligent Key-Space Notifications: Automatic update of in-memory tags map for expired or evicted keys.
This library offers you an easy and high performant caching solution for docker, Kubernetes or Google Cloud Run deployments of Next.js. Read more on how it originated at TRWK> Case Study.
Compatibility
This package is compatible with Next.js 15.0.3 and above while using App Router. It is not compatible with Next.js 14.x. or 15-canary or if you are using Pages Router.
Redis Server need to have Redis Server Version 2.8.0 or higher and have to be configured with notify-keyspace-events to be able to use the key-space notifications feature.
Tested versions are:
- Nextjs 15.0.3 + redis client 4.7.0
- Nextjs 15.2.4 + redis client 4.7.0
- Nextjs 15.3.2 + redis client 4.7.0
- Nextjs 15.4.7 + redis client 4.7.0
- Nextjs 16.0.3 + redis client 4.7.0 (cacheComponents: false)
- Nextjs 16.2.3 + redis client 4.7.0 (cacheComponents: false)
- Nextjs 16.2.3 + redis client 4.7.0 (cacheComponents: true)
Cache Components (Next.js 16+) are fully supported. Automated test coverage includes 'use cache', cacheTag, and cacheLife flows in the Cache Components integration suite.
For Cache Components, see the "Cache Components handler (Next.js 16+)" section below.
Getting started
Enable redis key-space notifications for Expire and Evict events
redis-cli -h localhost config set notify-keyspace-events ExeInstall package
pnpm install @trieb.work/nextjs-turbo-redis-cacheSetup environment variables in your project/deployment
REDISHOST and REDISPORT environment variables are required. KEY_PREFIX, VERCEL_URL, VERCEL_ENV are optional. For the bundled Next.js handlers (default cache handler and Cache Components handler), the key prefix precedence is:
- options.keyPrefix → KEY*PREFIX → VERCEL_URL → BUILD_ID (from
.next/BUILD_ID) →UNDEFINED_URL*
For direct usage of RedisStringsHandler, the default remains framework-agnostic:
- options.keyPrefix → KEY*PREFIX → VERCEL_URL →
UNDEFINED_URL*
VERCEL_ENV is used to determine the database to use. Only VERCEL_ENV=production will show up in DB 0 (redis default db). All other values of VERCEL_ENV will use DB 1, use redis-cli -n 1 to connect to different DB 1. This is another protection feature to avoid that different environments (e.g. staging and production) will overwrite each other.
Furthermore there exists the DEBUG_CACHE_HANDLER environment variable to enable debug logging of the caching handler once it is set to true.
There exists also the SKIP_KEYSPACE_CONFIG_CHECK environment variable to skip the check for the keyspace configuration. This is useful if you are using redis in a cloud environment that forbids access to config commands. If you set SKIP_KEYSPACE_CONFIG_CHECK=true the check will be skipped and the keyspace configuration will be assumed to be correct (e.g. notify-keyspace-events Exe).
KILL_CONTAINER_ON_ERROR_THRESHOLD: Optional environment variable that defines how many Redis client errors should occur before the process exits with code 1. This is useful in container environments like Kubernetes where you want the container to restart if Redis connectivity issues persist. Set to 0 (default) to disable this feature. For example, setting KILL_CONTAINER_ON_ERROR_THRESHOLD=10 will exit the process after 10 Redis client errors, allowing the container orchestrator to restart the container.
REDIS_COMMAND_TIMEOUT_MS: Optional environment variable that sets the timeout in milliseconds for Redis get command. If not set, defaults to 500ms. The value is parsed as an integer, and if parsing fails, falls back to the 500ms default.
Option A: minimum implementation with default options
extend next.config.js with:
const nextConfig = {
...
cacheHandler: require.resolve("@trieb.work/nextjs-turbo-redis-cache")
...
}Make sure to set either REDIS_URL or REDISHOST and REDISPORT environment variables.
Option B: create a wrapper file to change options
create new file customized-cache-handler.js in your project root and add the following code:
const { RedisStringsHandler } = require('@trieb.work/nextjs-turbo-redis-cache');
let cachedHandler;
module.exports = class CustomizedCacheHandler {
constructor() {
if (!cachedHandler) {
cachedHandler = new RedisStringsHandler({
database: 0,
keyPrefix: 'test',
timeoutMs: 2_000,
revalidateTagQuerySize: 500,
sharedTagsKey: '__sharedTags__',
avgResyncIntervalMs: 10_000 * 60,
redisGetDeduplication: false,
inMemoryCachingTime: 0,
defaultStaleAge: 1209600,
estimateExpireAge: (staleAge) => staleAge * 2,
});
}
}
get(...args) {
return cachedHandler.get(...args);
}
set(...args) {
return cachedHandler.set(...args);
}
revalidateTag(...args) {
return cachedHandler.revalidateTag(...args);
}
resetRequestCache(...args) {
return cachedHandler.resetRequestCache(...args);
}
}extend next.config.js with:
const nextConfig = {
...
cacheHandler: require.resolve("./customized-cache-handler")
...
}A working example of above can be found in the test/integration/next-app-customized folder.
Available Options
| Option | Description | Default Value |
| ----------------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| redisUrl | Redis connection url | process.env.REDIS_URL? process.env.REDIS_URL : process.env.REDISHOST ? redis://${process.env.REDISHOST}:${process.env.REDISPORT} : 'redis://localhost:6379' |
| database | Redis database number to use. Uses DB 0 for production, DB 1 otherwise | process.env.VERCEL_ENV === 'production' ? 0 : 1 |
| keyPrefix | Prefix added to all Redis keys | RedisStringsHandler default: process.env.KEY_PREFIX \|\| process.env.VERCEL_URL \|\| 'UNDEFINED_URL_' Next handlers resolve: options.keyPrefix \|\| KEY_PREFIX \|\| VERCEL_URL \|\| BUILD_ID \|\| 'UNDEFINED_URL_' |
| sharedTagsKey | Key used to store shared tags hash map in Redis | '__sharedTags__' |
| getTimeoutMs | Timeout in milliseconds for time critical Redis operations. If Redis get is not fulfilled within this time, returns null to avoid blocking site rendering. | process.env.REDIS_COMMAND_TIMEOUT_MS ? (Number.parseInt(process.env.REDIS_COMMAND_TIMEOUT_MS) ?? 500) : 500 |
| revalidateTagQuerySize | Number of entries to query in one batch during full sync of shared tags hash map | 250 |
| avgResyncIntervalMs | Average interval in milliseconds between tag map full re-syncs | 3600000 (1 hour) |
| redisGetDeduplication | Enable deduplication of Redis get requests via internal in-memory cache. | true |
| inMemoryCachingTime | Time in milliseconds to cache Redis get results in memory. Set this to 0 to disable in-memory caching completely. | 10000 |
| defaultStaleAge | Default stale age in seconds for cached items | 1209600 (14 days) |
| estimateExpireAge | Function to calculate expire age (redis TTL value) from stale age | Production: staleAge * 2 Other: staleAge * 1.2 |
| socketOptions | Redis client socket options for TLS/SSL configuration (e.g., { tls: true, rejectUnauthorized: false }) | { connectTimeout: timeoutMs } |
| clientOptions | Additional Redis client options (e.g., username, password) | undefined |
| killContainerOnErrorThreshold | Number of consecutive errors before the container is killed. Set to 0 to disable. | Number.parseInt(process.env.KILL_CONTAINER_ON_ERROR_THRESHOLD) ?? 0 : 0 |
| valueSerializer | Pluggable wire-format codec for Redis string values (compression, encryption, custom encoding). See Custom value serializer. | jsonCacheValueSerializer (JSON.stringify with built-in Buffer and Map encoding) |
Custom value serializer (compression, encryption)
By default cache entries are stored as JSON.stringify(...) with built-in
Buffer and Map encoding. For workloads where the encoded payload is large
(big RSC trees, large fetch responses) or sensitive (PII), you can plug in a
custom codec - gzip, brotli, AES, anything - via the valueSerializer option,
without forking this package or losing the existing dedup / batch / keyspace
features.
Contract
serialize(entry)is called on everyset()with the in-memoryCacheEntry. It must return the string written to Redis, or aPromise<string>for async codecs.deserialize(stored)is called on every cache hit with the exact string read from Redis. It must return aCacheEntry,null, or aPromiseof either. Returningnullis treated as a cache miss - the handler returnsnullfromget()without surfacing an error.- Both methods may be async, enabling non-blocking codecs such as
zlib.brotliCompressorcrypto.subtlethat don't block the Node.js event loop. Synchronous implementations continue to work unchanged. - Only the main cache-entry storage path is routed through the serializer. Internal structures (
__sharedTags__,__revalidated_tags__,inMemoryDeduplicationCache) are not affected.
Default export for reuse
The default serializer is exported so you can wrap it (e.g. compress + JSON
fallback) or compare against it by reference to detect that no custom
serializer was configured. The underlying Buffer / Map JSON helpers used by
the default are also exported for use inside custom codecs:
import {
jsonCacheValueSerializer,
bufferAndMapReplacer,
bufferAndMapReviver,
} from '@trieb.work/nextjs-turbo-redis-cache';Important: a plain
JSON.stringify(value)does not preserve nativeBufferorMapvalues inside a cache entry. RSC payloads containBuffers. If you write a custom codec that doesn't use the exportedbufferAndMapReplacer/bufferAndMapReviver(or doesn't wrapjsonCacheValueSerializer), expect those to come back as plain objects.
Example: gzip (sync)
Wraps bufferAndMapReplacer / bufferAndMapReviver so native Buffer and
Map values inside the cache entry round-trip unchanged. gzipSync /
gunzipSync block the event loop - prefer the async brotli example below for
hot workloads.
import { gzipSync, gunzipSync } from 'node:zlib';
import {
RedisStringsHandler,
bufferAndMapReplacer,
bufferAndMapReviver,
} from '@trieb.work/nextjs-turbo-redis-cache';
const gzipSerializer = {
serialize(value) {
const json = JSON.stringify(value, bufferAndMapReplacer);
return gzipSync(json).toString('base64');
},
deserialize(stored) {
const buf = Buffer.from(stored, 'base64');
return JSON.parse(gunzipSync(buf).toString('utf8'), bufferAndMapReviver);
},
};
export default class CustomizedCacheHandler {
constructor() {
this.handler = new RedisStringsHandler({
valueSerializer: gzipSerializer,
});
}
// ... delegate get/set/revalidateTag/resetRequestCache to this.handler
}Example: brotli (async, non-blocking)
Uses promisify(brotliCompress) and promisify(brotliDecompress) so
compression runs on a worker thread and doesn't block the event loop.
import { promisify } from 'node:util';
import { brotliCompress, brotliDecompress } from 'node:zlib';
import {
RedisStringsHandler,
bufferAndMapReplacer,
bufferAndMapReviver,
} from '@trieb.work/nextjs-turbo-redis-cache';
const brotliCompressAsync = promisify(brotliCompress);
const brotliDecompressAsync = promisify(brotliDecompress);
const brotliSerializer = {
async serialize(value) {
const json = JSON.stringify(value, bufferAndMapReplacer);
const compressed = await brotliCompressAsync(Buffer.from(json, 'utf8'));
return compressed.toString('base64');
},
async deserialize(stored) {
const buf = Buffer.from(stored, 'base64');
const decompressed = await brotliDecompressAsync(buf);
return JSON.parse(decompressed.toString('utf8'), bufferAndMapReviver);
},
};
export default class CustomizedCacheHandler {
constructor() {
this.handler = new RedisStringsHandler({
valueSerializer: brotliSerializer,
});
}
// ... delegate get/set/revalidateTag/resetRequestCache to this.handler
}Operational notes
- Changing the serializer makes existing Redis keys unreadable. Any change
to the codec - swapping JSON for gzip, bumping a compression level, rotating
an encryption key - means previously written entries can no longer be
decoded. Either flush the affected keys (
FLUSHDB, or scopedUNLINKofkeyPrefix*) or bumpkeyPrefixbefore deploying so old and new entries live in disjoint keyspaces. BufferandMapencoding is built into the default. The defaultjsonCacheValueSerializeruses this package'sbufferAndMapReplacer/bufferAndMapReviverso nativeBufferandMapvalues inside aCacheEntryround-trip transparently. If you write a custom serializer that doesn't reuse those (e.g. plainJSON.stringifyover a binary payload), expect RSC payloadBuffers to come back as plain{ type: 'Buffer', data: [...] }objects. Reuse the exported default inside your codec, or use the exportedbufferAndMapReplacer/bufferAndMapReviver, to keep that behavior.- The in-memory deduplication cache stores the wire-format string verbatim.
When
redisGetDeduplicationis enabled (default), the value seeded afterset()and returned to subsequentget()calls is the exact string produced byserialize(). With a compressing or encrypting codec that means every dedup hit re-runsdeserialize()(i.e. re-decompresses or re-decrypts). For very hot keys, evaluate whether the per-hit codec cost outweighs the Redis round-trip the dedup is saving. - Other internal trieb structures are not affected by
valueSerializer. Only the main cache entries written byset()and read byget()go through the codec. The shared-tags map and the revalidated-tags map are untouched. - Cache Components handler is out of scope for now. This option only
affects
RedisStringsHandler. The Next.js 16+CacheComponentsHandlerdoes not currently route throughvalueSerializer; that's a candidate follow-up.
TLS Configuration
To connect to Redis using TLS/SSL (e.g., when using Redis over rediss:// URLs), you can configure the socket options. Here's an example:
const { RedisStringsHandler } = require('@trieb.work/nextjs-turbo-redis-cache');
let cachedHandler;
module.exports = class CustomizedCacheHandler {
constructor() {
if (!cachedHandler) {
cachedHandler = new RedisStringsHandler({
redisUrl: 'rediss://your-redis-host:6380', // Note the rediss:// protocol
socketOptions: {
tls: true,
rejectUnauthorized: false, // Only use this if you want to skip certificate validation
},
});
}
}
// ... rest of the handler implementation
};Consistency of Redis and this caching implementation
To understand consistency levels of this caching implementation we first have to understand the consistency of redis itself: Redis executes commands in a single-threaded manner. This ensures that all operations are processed sequentially, so clients always see a consistent view of the data. But depending on the setup of redis this can change:
- Strong consistency: only for single node setup
- Eventual consistency: In a master-replica setup (strong consistency only while there is no failover)
- Eventual consistency: In Redis Cluster mode
Consistency levels of Caching Handler: If Redis is used in a single node setup and Request Deduplication is turned off, only then the caching handler will have strong consistency.
If using Request Deduplication, the strong consistency is not guaranteed anymore. The following sequence can happen with request deduplication: Instance 1: call set A 1 Instance 1: served set A 1 Instance 2: call get A Instance 1: call delete A Instance 2: call get A Instance 2: served get A -> 1 Instance 2: served get A -> 1 (served 1 but should already be deleted) Instance 1: served delete A
The time window for this eventual consistency to occur is typically around the length of a single redis command. Depending on your load ranging from 5ms to max 100ms. If using local in-memory caching (Enabled by RedisStringsHandler option inMemoryCachingTime), the window for this eventual consistency to occur can be even higher because additionally also synchronization messages have to get delivered. Depending on your load typically ranging around 50ms to max of 120ms.
Since all caching calls in one api/page/server action request is always served by the same instance this problem will not occur inside a single request but rather in a combination of multiple parallel requests. The probability that this will occur for a single user during a request sequence is very low, since typically a single user will not make the follow up request during this small time window of typically 50ms. To further mitigate the Problem and increase performance (increase local in-memory cache hit ratio) make sure that your load balancer will always serve one user to the same instance (sticky sessions).
By accepting and tolerating this eventual consistency, the performance of the caching handler is significantly increased.
Development
- Run
pnpm installto install the dependencies - Run
pnpm buildto build the project - Run
pnpm lintto lint the project - Run
pnpm formatto format the project - Run
pnpm run-dev-serverto test and develop the caching handler using the nextjs integration test project - If you make changes to the cache handler, you need to stop
pnpm run-dev-serverand run it again.
Testing
To run all tests you can use the following command:
pnpm build && pnpm testFor CI, we use dedicated scripts:
pnpm test:ci
pnpm test:integration:build-id-prefixFolder layout / runners:
- Vitest (unit + integration) lives in
src/**/*.test.ts(x)andtest/**. - Playwright (E2E) lives in
tests/**(seeplaywright.config.ts). test/browser/**contains Vitest tests that hit a running Next.js app over HTTP. Despite the folder name, this is not Playwright and does not use Vitest browser mode.
Unit tests
To run unit tests you can use the following command:
pnpm build && pnpm test:unitIntegration tests
To run integration tests you can use the following command:
pnpm build && pnpm test:integrationTo run the BUILD_ID integration test independently:
pnpm build && pnpm test:integration:build-id-prefixE2E tests (Playwright)
To run Playwright tests (tests/**) you can use:
pnpm test:e2eThe integration tests will start a Next.js server and test the caching handler. You can modify testing behavior by setting the following environment variables:
- SKIP_BUILD: If set to true, the integration tests will not build the Next.js app. Therefore the nextjs app needs to be built before running the tests. Or you execute the test once without skip build and the re-execute
pnpm test:integrationwith skip build set to true. - SKIP_OPTIONAL_LONG_RUNNER_TESTS: If set to true, the integration tests will not run the optional long runner tests.
- DEBUG_INTEGRATION: If set to true, the integration tests will print debug information of the test itself to the console.
Integration tests may have dependencies between test cases, so individual test failures should be evaluated in the context of the full test suite rather than in isolation.
Cache Components handler (Next.js 16+)
This package can be used as a Cache Components handler (Node.js runtime) for Next.js apps that enable Cache Components.
This is experimental support and the Next.js Cache Components APIs may still change. We don't have a larger production project right now available to test this in real world conditions.
Enable Cache Components + cache handler
Install the package in your Next.js app:
pnpm add @trieb.work/nextjs-turbo-redis-cache redisIn your Next.js app, enable Cache Components and point cacheHandlers.default to a module that exports the handler instance:
// next.config.ts
import type { NextConfig } from 'next';
const nextConfig: NextConfig = {
cacheComponents: true,
cacheHandlers: {
default: require.resolve('./cache-handler.js'),
},
};
export default nextConfig;// cache-handler.js
const { redisCacheHandler } = require('@trieb.work/nextjs-turbo-redis-cache');
module.exports = redisCacheHandler;If you prefer ESM:
// cache-handler.js
import { redisCacheHandler } from '@trieb.work/nextjs-turbo-redis-cache';
export default redisCacheHandler;Required environment variables
REDIS_URL(recommended): e.g.redis://localhost:6379
Optional:
VERCEL_URL: used as a key prefix for multi-tenant isolation (also useful in tests). If unset, a default prefix is used.REDIS_COMMAND_TIMEOUT_MS: timeout (ms) for Redis commands used by the handler.
Local manual testing (Cache Lab)
This repo includes a dedicated Next.js Cache Components integration app with real pages for manual testing.
- Start Redis locally.
- Install + start the Cache Components test app:
pnpm -C test/integration/next-app-16-2-3-cache-components install
pnpm -C test/integration/next-app-16-2-3-cache-components devThen open the Cache Lab pages:
/cache-lab/cache-lab/use-cache-nondeterministic/cache-lab/cachelife-short/cache-lab/tag-invalidation/cache-lab/stale-while-revalidate/cache-lab/runtime-data-suspense
To run the Playwright E2E tests against a running dev server:
PLAYWRIGHT_BASE_URL=http://localhost:3101 pnpm test:e2eSome words on nextjs caching internals
Nextjs will use different caching objects for different pages and api routes. Currently supported are kind: APP_ROUTE and APP_PAGE.
app//route.ts files will request using the APP_ROUTE kind. app//page.tsx files will request using the APP_PAGE kind. /favicon.ico file will request using the APP_ROUTE kind.
Fetch requests (inside app route or page) will request using the FETCH kind.
License
This project is licensed under the MIT License. See the LICENSE file for details.
Sponsor
This project is created and maintained by the Next.js & Payload CMS agency TRWK>, formerly trieb.work.
