Batch Runner (@peter.naydenov/batch-runner)

Description

Execute a batch job with a simple call. Batch itself contains a name, source of data and a job to be executed. Batch runner will execute the job for each item in the source.

Source is a function that returns an array of items. Source function will be executed on each job run request so the source can be dynamic. Each item will be passed to the job function.

In job run request you can provide extra data parameters that will be passed to the job function as well after the item from the source.

Library batch-runner is a framework agnostic. No dependencies.

Installation

Here is how to install the library:

npm i @peter.naydenov/batch-runner

Methods

Library has only two methods:

  define : 'define a batch'
, run    : 'run a batch'

Definition of Batch

batch.define ( {
      name   : 'string. Name of the batch'
    , source : 'function(optional). Should return a source of data for the job'
    , job    : 'job to be executed'
    , final  : 'final refinement of the results ( after version 2.4.0 )' 

How to use

Simplified example:

import batchRunner from '@peter.naydenov/batch-runner'

const batch = batchRunner();   // Creates a batch repository
batch.define ({
                      name   : 'myBatch'
                    , source : () => [1, 2, 3]
                    , job    : ({item,i,END},x) => console.log(`${item},${x}`)
            });

batch.run ( 'myBatch', 'extra' ) // Extra parameter will be passed to the job function
// -> 1,extra
// -> 2,extra
// -> 3,extra
// Number of extra parameters is not limited

Job definition first argument is an object {item,i,END}, where item is the current item, i is the current source index, END is constant. To stop further function evocation return the END constant. Example:

batch.define ({
                      name   : 'myBatch'
                    , source : () => [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 ]
                    , job    : ({item,i,END},x) => {
                                    return ( i < 2 ) ? item : END
                                  }
            });
let r = batch.run ( 'myBatch' )
// r -> [1,2]

Job always returns an array of results. You can change that by specifying the final function.

batch.define ({
                      name   : 'myBatch'
                    , source : () => [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 ]
                    , job    : ({item,i,END},x) => {
                                    return ( i < 2 ) ? item : END
                                  }
                    , final : ( result ) => result.reduce ( (acc,item) => acc = acc + item, 0 )  // result argument is [1,2]
                                          // convert array to sum of its items
            });
let r = batch.run ( 'myBatch' )
// r -> 3

Links

• History of changes
• Migration Guides

Credits

'@peter.naydenov/batch-runner' was created and supported by Peter Naydenov.

License

'@peter.naydenov/batch-runner' is released under the MIT License.