Could not read from "ftp://192.168.1.50/test.csv" because it is a not a file

asked 2018-05-15 22:38:02 -0500

prasad9920 gravatar image

updated 2018-05-16 08:37:48 -0500

metadaddy gravatar image

We are getting an error with FTP on StreamSets. We put the source SFTP/FTP client but StreamSets is unable to download file giving error as it is not a file. it works after reset origin but if I put one more file it won't download that file error as shown below. on ftp user having full permission.

2018-05-16 08:25:37,509 [user:*admin] [pipeline:Windows Logon and Logoff- FTP-Secondary/WindowsLogonandLogoffFTPSecondaryc6b1e87e-e5d6-45e8-b47f-4047a3f815d4] [runner:] [thread:ProductionPipelineRunnable-WindowsLogonandLogoffFTPSecondaryc6b1e87e-e5d6-45e8-b47f-4047a3f815d4-Windows Logon and Logoff- FTP-Secondary] WARN  RemoteDownloadSource - File: /test.csv was found in listing, but is not downloadable
org.apache.commons.vfs2.FileNotFoundException: Could not read from "ftp://192.168.1.50/test.csv" because it is a not a file.
    at org.apache.commons.vfs2.provider.AbstractFileObject.getInputStream(AbstractFileObject.java:1315)
    at org.apache.commons.vfs2.provider.DefaultFileContent.getInputStream(DefaultFileContent.java:396)
    at com.streamsets.pipeline.stage.origin.remote.RemoteDownloadSource.produce(RemoteDownloadSource.java:400)
    at com.streamsets.pipeline.configurablestage.DSource.produce(DSource.java:38)
    at com.streamsets.datacollector.runner.StageRuntime$2.call(StageRuntime.java:243)
    at com.streamsets.datacollector.runner.StageRuntime$2.call(StageRuntime.java:237)
    at com.streamsets.pipeline.api.impl.CreateByRef.call(CreateByRef.java:40)
    at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:195)
    at com.streamsets.datacollector.runner.StageRuntime.execute(StageRuntime.java:264)
    at com.streamsets.datacollector.runner.StagePipe.process(StagePipe.java:226)
    at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.processPipe(ProductionPipelineRunner.java:751)
    at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.runPollSource(ProductionPipelineRunner.java:535)
    at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunner.run(ProductionPipelineRunner.java:375)
    at com.streamsets.datacollector.runner.Pipeline.run(Pipeline.java:504)
    at com.streamsets.datacollector.execution.runner.common.ProductionPipeline.run(ProductionPipeline.java:112)
    at com.streamsets.datacollector.execution.runner.common.ProductionPipelineRunnable.run(ProductionPipelineRunnable.java:74)
    at com.streamsets.datacollector.execution.runner.standalone.StandaloneRunner.start(StandaloneRunner.java:754)
    at com.streamsets.datacollector.execution.runner.common.AsyncRunner.lambda$start$3(AsyncRunner.java:152)
    at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:227)
    at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33)
    at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:223)
    at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.lambda$call$0(SafeScheduledExecutorService.java:227)
    at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33)
    at com.streamsets.pipeline.lib.executor.SafeScheduledExecutorService$SafeCallable.call(SafeScheduledExecutorService.java:223)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
    at com.streamsets.datacollector.metrics.MetricSafeScheduledExecutorService$MetricsTask.run(MetricSafeScheduledExecutorService.java:100)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.FileNotFoundException: ftp://192.168.1.50/test.csv
    at org.apache.commons.vfs2.provider.ftp.FtpFileObject.doGetInputStream(FtpFileObject.java:609)
    at org.apache.commons.vfs2.provider.AbstractFileObject.getInputStream(AbstractFileObject.java:1307)
    ... 30 more
2018-05-16 08:42:37 ...
(more)
edit retag flag offensive close merge delete

Comments

I am also facing same issue. Is there any solution for this

Selftuts gravatar imageSelftuts ( 2018-05-18 01:26:13 -0500 )edit