Ask Your Question

How to reading data from the file in between source and destiantion

asked 2018-11-30 01:42:49 -0600

edukondalu gravatar image

background: reading some number files from the directory using Dir origin and want read each file, should check valid content is there or not. valid content true then all files should to go destination or else should go error folder.

edit retag flag offensive close merge delete


Can you give an example which explains based on what are you going to validate your data?

Maithri gravatar imageMaithri ( 2018-12-05 23:29:04 -0600 )edit

source produce file name( and destination is Kafka topics.In processor, it will add .landed to file like it will check on server if it will exits it reads the read from valid data exits then the original file will process tokalfa topic else file err

edukondalu gravatar imageedukondalu ( 2018-12-24 09:50:34 -0600 )edit

1 Answer

Sort by ยป oldest newest most voted

answered 2018-12-11 11:15:45 -0600

tdzhangbin gravatar image

You can try to use Stream Selector. In the condition configuration, you can add more conditions to choose different stream to different destinations. Hope this help you.

edit flag offensive delete link more


It is a dynamic file read lookup in process. original , lookup file in the same server and same path. Checksum on landed valid then original will go destination else it will go error folder. Issue how to read landed file. I can read original.

edukondalu gravatar imageedukondalu ( 2018-12-24 10:00:10 -0600 )edit
Login/Signup to Answer

Question Tools

1 follower


Asked: 2018-11-30 01:42:49 -0600

Seen: 113 times

Last updated: Dec 11 '18