batch mode pipeline

asked 2019-06-17 13:55:57 -0600

KeerthiS gravatar image

We want to run a generic pipeline ( Read a HDFS file and insert into RDBMS database ) in batch mode ( a set of files) without the need to reset origin (file names might be same). Pipeline should be triggered only after receiving the whole set.

edit retag flag offensive close merge delete