🪄

AI functions for Typescript

Magically generate results for your Typescript functions by utilizing large language models (LLMs) like GPT-4 from OpenAI.

Warning

The code in this repository (including this README) was created with GPT-4. This is not a production repository and caution should be used when running this code.

tl;dr

How does it work?

This library uses a Typescript transformer to take the return type of a function, convert that type into a JSON Schema, and then replace the function body with code to query the OpenAI API and validate the response against the JSON Schema.

This library doesn't write code for your functions, it allows you to use LLMs as a runtime.

Features

• Seamlessly transform your TypeScript functions with a simple //@magic comment
• Integrate the latest AI language models such as GPT-4 from OpenAI
• Effortless setup with your existing TypeScript project
• Automagically validate LLM responses against your Typescript interfaces

Usage

Transform your TypeScript functions by adding the //@magic comment.

Here's an example function:

// @magic
async function example(): Promise<Mountain> {
  //Return the 3rd highest mountain
}

When this function is called, it'll leverage an AI language model like GPT-4 and return the following result:

{ name: 'Kangchenjunga', height: { meters: 8586, feet: 28169 } }

Note: In this example, Mountain is defined as:

interface Height {
  meters: number;
  feet: number;
}

interface Mountain {
  name: string;
  height: Height;
}

Prerequisites

The OPENAI_API_KEY environment variable is required to access the OpenAI API. The OPENAI_MODEL environment variable allows you to optionally specify which model to use, and defaults to gpt-3.5-turbo if not set.

export OPENAI_API_KEY=your_api_key_here
export OPENAI_MODEL=gpt-4 #this step is optional

Installation

First, install @jumploops/magic as a development dependency using:

npm install --save-dev @jumploops/magic

Setup with ts-patch

npm install -D ts-patch
ts-patch install

Now, add the plugin to your tsconfig.json:

{
  "compilerOptions": {
    "plugins": [
      { "transform": "@jumploops/magic/transformer" }
    ]
  }
}

Setup with ttypescript

Install ttypescript:

npm i -D ttypescript

Next, add the plugin to your tsconfig.json:

{
  "compilerOptions": {
    "plugins": [
      { "transform": "@jumploops/magic/transformer" }
    ]
  }
}

Compile your project using ttypescript:

ttsc

API Reference

@magic

Use //@magic to annotate a TypeScript function that you want to transform into a call to an external LLM. The function should be async.

Example:

// @magic
async function example(): Promise<Mountain> {
  //Return the 3rd highest mountain
}

Prior Art

This package took inspiration from Marvin - build AI functions that use an LLM as a runtime

Contributing

We welcome contributions! Please open an issue or submit a pull request if you'd like to help improve @jumploops/magic.

License

MIT License.