Ask Your Question
0

How to reading data from the file in between source and destiantion

asked 2018-11-30 01:42:49 -0500

edukondalu gravatar image

background: reading some number files from the directory using Dir origin and want read each file, should check valid content is there or not. valid content true then all files should to go destination or else should go error folder.

edit retag flag offensive close merge delete

Comments

Can you give an example which explains based on what are you going to validate your data?

Maithri gravatar imageMaithri ( 2018-12-05 23:29:04 -0500 )edit

source produce file name(abc.zip) and destination is Kafka topics.In processor, it will add .landed to file like abc.zip.landed. it will check on server if it will exits it reads the read from abc.zip.landed.if valid data exits then the original file abc.zip will process tokalfa topic else file err

edukondalu gravatar imageedukondalu ( 2018-12-24 09:50:34 -0500 )edit

1 Answer

Sort by ยป oldest newest most voted
0

answered 2018-12-11 11:15:45 -0500

tdzhangbin gravatar image

You can try to use Stream Selector. In the condition configuration, you can add more conditions to choose different stream to different destinations. Hope this help you.

edit flag offensive delete link more

Comments

It is a dynamic file read lookup in process. abc.zip original ,abc.zip.landed lookup file in the same server and same path. Checksum on landed valid then original will go destination else it will go error folder. Issue how to read landed file. I can read original.

edukondalu gravatar imageedukondalu ( 2018-12-24 10:00:10 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2018-11-30 01:42:49 -0500

Seen: 29 times

Last updated: Dec 11 '18