file-filter

Filter a list of files to including only the unique files, based on content

Install

$ npm install --save file-filter

Usage

var fileFilter = require('file-filter');

fileFilter(['file-filter', 'file1.txt', 'duplicateFile1.txt', 'file2.txt']).then(results => {
	// results => {strict: {...}, loose: {...}, unprocessed: {...}}
});

CLI

$ npm install --global file-filter

$ file-filter --help

  Filter a list of files to only the unique files, based on content

  Usage
    $ file-filter [input]
    $ [input] | file-filter

  Options
    -i Invert the results so that it shows you only the duplicates. Default: false
    -s Append the summary about the number of unique files and duplicates. Default: false
    -S Show only the summary about the number of unique files and duplicates. Default: false
    -W By default, the comparisons ignore whitespace. This makes it so that it respects whitespace differences. Default: false
  Examples
    $ file-filter file1.txt duplicateFile1.txt file2.txt
    file1.txt
    file2.txt

  # Assuming we're in a directory that has the same files as above
    $ ls | file-filter
    file1.txt
    file2.txt

API

fileFilter(input)

Returns a Promise that resolves to an object of objects, containing the results of the comparisons.

The object returned is structured like so:

	{
		// Strict contains the result of a strict comparison
		strict: {
			uniques: [...], // Array of strings of the unique filenames
			duplicates: [...], // Array of strings of the duplicate filenames
			files: [{name, hash, content}, ...] // Array of objects containing file name, the file hash and content used for the comparison
		},

		// Loose contains the result, but it ignores all whitespace in the comparison
		loose: {
			uniques: [...],
			duplicates: [...],
			files: [...]
		},

		// Unprocessed contains two arrays, one for any directories and one for anything else that was passed in but can't be read for whatever reason.
		unprocessed: {
			dirs: [...],
			misc: [...]
		}
	}

input

Required Type: string|Array

This is the list of files to filter. It can be an array of files, or a newline separated string.

License

MIT © Nate Cavanaugh