GPT4All Typescript Client

Intro

This is a fork of gpt4all-ts repository, which is a TypeScript implementation of the GPT4all language model. This fork is intended to add additional features and improvements to the original codebase.

Install

yarn install

Usage

import { GPT4All } from "gpt4all-ts-client";

// Instantiate GPT4All with default or custom settings
const gpt4all = new GPT4All("gpt4all-lora-unfiltered-quantized"); // Default is 'gpt4all-lora-quantized' model

// Initialize and download missing files
const forceDownload = false;
await gpt4all.init(forceDownload);

// Open the connection with the model
await gpt4all.open();
// Generate a response using a prompt
const prompt = "Tell me about how Open Access to AI is going to help humanity.";
const response = await gpt4all.prompt(prompt);
console.log(`Prompt: ${prompt}`);
console.log(`Response: ${response}`);

// Close the connection when you're done
gpt4all.close();

Example usage

yarn build
yarn dev

Author

👤 Huynh Duc Dung @jellydn

• Website: https://productsway.com/
• Twitter: @jellydn
• Github: @jellydn

🤝 Contributing

Contributions, issues and feature requests are welcome!

Feel free to check issues page.

Show your support

Give a ⭐️ if this project helped you!