@modelize/transfer
v0.0.3
Published
Mini ETL.
Downloads
1
Readme
Modelize Transfer
npm i --save @modelize/transfer
Execution Flow
Start a new transfer with basic options: new Transfer().start()
onBefore()
: returnsresumeInfo
- do process:
onLoad()
: consumesresumeInfo
and reduces raw-rows- for each loaded
raw-row
:onFilter()
: consumesraw-row
, returnfalse
to exclude rowtransform()
: consumesraw-row
must producewrite-row
- filtered/transformed
raw-row
is cleaned directly from internal memory
- filtered/transformed
beforeWrite()
: consumeswrite-rows
, may change theresumeInfo
- must be run before
writing
, as the already written rows are cleaned directly from internal memory
- must be run before
- for each
batch-to-write
onWrite()
: consumes batch ofwrite-row
- repeat process if
resumeInfo
notundefined
now