Ask Your Question
1

Is a processor necessary between Directory origin and HDFS destination?

asked 2017-11-28 05:55:06 -0500

anonymous user

Anonymous

updated 2018-09-05 07:49:49 -0500

Shruthi gravatar image

I am new to StreamSets. I need to send files from local to HDFS.

edit retag flag offensive close merge delete

2 Answers

Sort by ยป oldest newest most voted
1

answered 2017-11-29 02:42:47 -0500

Shruthi gravatar image

updated 2017-11-29 02:45:10 -0500

Processor is not necessary. You can do it simply by creating a pipeline with origin "Directory" and destination "Hadoop FS". Refer this for more details https://streamsets.com/documentation/...

https://streamsets.com/documentation/...

edit flag offensive delete link more
0

answered 2017-11-29 00:09:14 -0500

metadaddy gravatar image

You can connect the Directory origin directly to the HDFS destination.

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2017-11-28 05:55:06 -0500

Seen: 66 times

Last updated: Nov 29 '17