chatlint

This npm package is a name reservation. The tool is written in Python.

ChatLint is a conformance test suite for LLM chat templates. It renders the Jinja file a model ships against 49 conversation shapes and checks six properties, so template defects are caught in CI instead of in production.

pip install chatlint
chatlint check path/to/chat_template.jinja

Source, documentation and the public scoreboard covering 786 templates across 4,387 model repositories: https://github.com/dimondevceo/ChatLint

This package holds the chatlint name on npm so the JavaScript and Python ecosystems point at the same project. It contains no code. If a JavaScript port ever ships, it will be published here.