claude2parquet

A command-line tool to convert Claude Code session logs to Parquet format for data analysis and AI applications.

Installation

npm install -g claude2parquet

Usage

Command Line

# Export Claude Code logs for current directory to claude_code_<project>.parquet
claude2parquet

# Export logs from all projects
claude2parquet --all

# Export to custom filename
claude2parquet --output logs.parquet

# Export logs for a specific project directory
claude2parquet --project ~/code/myapp

Example

$ claude2parquet
✓ Exported 231 messages from 6 sessions to claude_code_myapp.parquet

╭────────────────────────────────────────────────╮
│ Analyze logs with Hyperparam:                  │
│ npx hyperparam scope claude_code_myapp.parquet │
╰────────────────────────────────────────────────╯

Output Schema

The generated Parquet file contains the following columns:

• project (STRING): Project name derived from the session directory
• session_id (STRING): Unique session identifier
• uuid (STRING): Unique message identifier
• timestamp (STRING): Message timestamp in ISO format
• type (STRING): Message type (user or assistant)
• role (STRING): Message role
• model (STRING): Model used for assistant messages
• content (STRING): Flattened message content
• version (STRING): Claude Code version
• cwd (STRING): Working directory at time of message
• git_branch (STRING): Active git branch at time of message

Requirements

• Node.js
• Claude Code must be installed with session logs in ~/.claude/projects/

Log Retention

Claude Code deletes session logs older than 30 days by default. To retain more history, set cleanupPeriodDays in ~/.claude/settings.json:

{ "cleanupPeriodDays": 365 }

Options

• --output <file>, -o <file>: Output parquet filename (default: claude_code_<project>.parquet, or claude_code.parquet with --all)
• --project <path>: Filter logs to a specific project directory
• --all: Export logs from all projects
• --since <date>: Only include rows on or after this date (YYYY-MM-DD or ISO timestamp)
• --until <date>: Only include rows on or before this date (YYYY-MM-DD or ISO timestamp); bare dates are inclusive of the full day
• --help, -h: Show help message

Use Cases

• Analyzing Claude Code usage patterns across projects
• Training ML models on human-AI coding interactions
• Creating datasets for software engineering research
• Building usage dashboards and productivity metrics

Hyperparam

Hyperparam is a tool for exploring and curating AI datasets, such as those produced by claude2parquet.