@anvia/fastembed

FastEmbed embedding model adapter for Anvia.

Use this package when you want local embedding generation through fastembed, especially for RAG workflows that should avoid remote embedding APIs.

Installation

pnpm add @anvia/fastembed @anvia/core fastembed

In this monorepo, the package is available through the workspace:

pnpm --filter @anvia/fastembed build

Usage

import { embedDocuments, InMemoryVectorStore } from "@anvia/core";
import { createFastEmbedEmbeddingModel } from "@anvia/fastembed";

const embeddingModel = await createFastEmbedEmbeddingModel();

const documents = await embedDocuments(
  embeddingModel,
  [
    {
      id: "password-reset",
      title: "Password reset policy",
      body: "Password reset links expire after 30 minutes.",
    },
    {
      id: "priority-support",
      title: "Priority support",
      body: "Enterprise customers receive priority support.",
    },
  ],
  {
    id: (document) => document.id,
    content: (document) => `${document.title}\n${document.body}`,
  },
);

const store = InMemoryVectorStore.fromDocuments(documents);
const index = store.index(embeddingModel);

const results = await index.search({
  query: "How long does a password reset link last?",
  topK: 3,
});

console.log(results);

Default Model

The default embedding model is:

fast-bge-small-en-v1.5

You can pass another FastEmbed model name:

const embeddingModel = await createFastEmbedEmbeddingModel({
  model: "fast-bge-base-en-v1.5",
  maxBatchSize: 32,
});

Exports

• FastEmbedEmbeddingModel
• createFastEmbedEmbeddingModel
• DEFAULT_FASTEMBED_EMBEDDING_MODEL
• FastEmbedEmbeddingModelName
• FastEmbedEmbeddingModelOptions
• FastEmbedRuntime

Development

pnpm --filter @anvia/fastembed typecheck
pnpm --filter @anvia/fastembed test
pnpm --filter @anvia/fastembed build