@vernox/csv-cleaner
v1.0.0
Published
Simple utility to clean and normalize CSV files - removes duplicates, fixes formatting, standardizes headers
Readme
CSV Cleaner
Simple utility to clean and normalize CSV files.
Features
- 🗑️ Remove duplicate rows
- ✂️ Trim whitespace from all values
- 🔤 Standardize headers (lowercase, snake_case)
- 📊 Clean and normalize data
Installation
npm install @vernox/csv-cleanerUsage
CLI
# Basic usage
npx @vernox/csv-cleaner input.csv output.csv
# Keep duplicates
npx @vernox/csv-cleaner input.csv output.csv --no-duplicates
# Don't trim whitespace
npx @vernox/csv-cleaner input.csv output.csv --no-trimAs Module
const { CSVCleaner } = require('@vernox/csv-cleaner');
const cleaner = new CSVCleaner({
removeDuplicates: true,
trimWhitespace: true,
standardizeHeaders: true
});
await cleaner.clean('input.csv', 'output.csv');Example
Input (messy.csv):
First Name ,Last Name , EMAIL
" John ", " Doe ", " [email protected] "
" Jane ", " Smith ", " [email protected] "
" John ", " Doe ", " [email protected] " # DuplicateOutput (clean.csv):
first_name,last_name,email
John,Doe,[email protected]
Jane,Smith,[email protected]Options
--no-duplicates- Keep duplicate rows--no-trim- Don't trim whitespace--no-standardize- Don't standardize headers
License
MIT
Part of @vernox utilities
