Ask Your Question

File is not Loaded Into HDFS from Local Using Streamsets (validated Successfully!)

asked 2018-10-22 07:56:43 -0600

El Mehdi OUAFIQ gravatar image

updated 2018-11-02 04:58:22 -0600

I just have started using streamsets, and i'm trying to load a text file from local to HDFS. Please note: I'm using Cloudera Manager, here is a view of "core-site.xml": core-site.xml

The file is located in "/home/cloudera/Desktop"

Here is a view of the source (Local) configuration in Streamsets: Local file configuration in Streamsets

Here is a view of Hadoop fs configuration in Streamsets: Hadoop fs configuration in Streamsets

It was validated successfully! Pipline Has Been Validated

I'm supposed to find the file in HDFS directory, especially at "/user/cloudera". But when I run it the file hasn't been loaded.

I'm sure I missed something, and I couldn't find answer for this. Could you please help!


edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2018-11-02 04:58:55 -0600

El Mehdi OUAFIQ gravatar image

updated 2018-11-02 04:59:15 -0600

I solved it by adding the extension to the file name

edit flag offensive delete link more
Login/Signup to Answer

Question Tools



Asked: 2018-10-22 07:56:43 -0600

Seen: 271 times

Last updated: Nov 02 '18