Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

batch mode pipeline

We want to run a generic pipeline ( Read a HDFS file and insert into RDBMS database ) in batch mode ( a set of files) without the need to reset origin (file names might be same). Pipeline should be triggered only after receiving the whole set.