openai-fine-tuning-jsonl-validator

Openai Fine Tuning Jsonl Validator — Moderate-to-high niche search volume driven by developers getting opaque validation errors when submitting OpenAI fine-tuning jobs.

Zero dependencies. Pure functions, no I/O, no DOM. Runs in Node and in the browser unchanged.

Try it without installing anything: https://owaiskhan.website/tools/openai-fine-tuning-jsonl-validator/

Install

npm install openai-fine-tuning-jsonl-validator

Use

import { openaiFineTuningJsonlValidator } from 'openai-fine-tuning-jsonl-validator';

const result = openaiFineTuningJsonlValidator(input);
console.log(result);

API

function approximateTokens(text)

Approximate token count for a string using the cl100k_base heuristic. Real tiktoken is ~4 chars per token on average English text.

function countExampleTokens(example)

Count tokens for a single fine-tuning example object. Mirrors the logic from OpenAI's cookbook num_tokens_from_messages.

function estimateCost(totalTokens, model, epochs)

Estimate fine-tuning cost for a dataset. @param {number} totalTokens

function validateExample(obj, lineIndex)

Validate a single parsed example object. Returns an array of error strings (empty = valid).

function autoFixExample(obj)

Attempt to auto-fix common issues in a single example. Returns a new (fixed) object and a list of applied fix descriptions.

function openaiFineTuningJsonlValidator(jsonlText, options)

Validate (and optionally auto-fix) a raw JSONL string. @param {string|null} jsonlText Raw text content of the .jsonl file.

Why this exists

The hosted version at https://owaiskhan.website/tools/openai-fine-tuning-jsonl-validator/ runs this exact module in the browser — the page and the package cannot disagree, because there is one implementation. Nothing you paste into the hosted tool leaves your browser.

Keywords

openai fine tuning jsonl validator · openai fine tuning jsonl format · validate openai training data online · jsonl token counter openai · chatgpt fine tuning dataset validator · tiktoken jsonl dataset validator

License

MIT © Owais Khan