Ask Your Question
1

Recover a corrupt pipeline post disk space error

asked 2018-09-21 09:13:06 -0500

eohehirA gravatar image

updated 2018-09-21 09:14:05 -0500

Hi,

I received a disk out of spaces error while I was working on a pipeline on Streamsets Data Collector. I have cleared up some disk space but now I cannot open the pipeline I was working on.

When I try to open the pipeline, I get the following error

"CONTAINER_0206 - Cannot load details for pipeline 'GroundspeedProcessExcelFiles8e376a8f-d17f-4d92-b609-d2ef2f031e71': com.fasterxml.jackson.databind.JsonMappingException: Unexpected end-of-input within/between Object entries"

Stack trace is as follows:

com.streamsets.datacollector.store.PipelineStoreException: CONTAINER_0206 - Cannot load details for pipeline 'GroundspeedProcessExcelFiles8e376a8f-d17f-4d92-b609-d2ef2f031e71': com.fasterxml.jackson.databind.JsonMappingException: Unexpected end-of-input within/between Object entries at [Source: sun.nio.ch.ChannelInputStream@4f3e8b11; line: 1587, column: 1173] at [Source: sun.nio.ch.ChannelInputStream@4f3e8b11; line: 1587, column: 5] (through reference chain: com.streamsets.datacollector.restapi.bean.PipelineConfigurationJson["stopEventStages"]->java.util.ArrayList[0]) at com.streamsets.datacollector.store.impl.FilePipelineStoreTask.load(FilePipelineStoreTask.java:443) at com.streamsets.datacollector.store.impl.CachePipelineStoreTask.load(CachePipelineStoreTask.java:150) at com.streamsets.datacollector.restapi.PipelineStoreResource.getPipelineInfo(PipelineStoreResource.java:667) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:144) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:161) at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:160) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:99) at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:389) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:347) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102) at org.glassfish.jersey.server.ServerRuntime$2.run(ServerRuntime.java:326) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267) at org.glassfish.jersey.internal.Errors.process(Errors.java:315) at org.glassfish.jersey.internal.Errors.process(Errors.java:297) at org.glassfish.jersey.internal.Errors.process(Errors.java:267) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:317) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:473) at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:427) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:388) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:341) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:228) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:841) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634) at com.streamsets.datacollector.http.GroupsInScopeFilter.lambda$doFilter$0(GroupsInScopeFilter.java:82) at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:33) at com.streamsets.datacollector.http.GroupsInScopeFilter.doFilter(GroupsInScopeFilter.java:81) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1621 ...

(more)
edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
0

answered 2018-09-21 20:42:57 -0500

metadaddy gravatar image

The exception is saying that the pipeline file is corrupt - it looks like the file was truncated, likely when you ran out of disk space. About the only thing you can do is to restore it from a backup, I'm afraid.

edit flag offensive delete link more

Comments

1

I had published an older version so was able to import that to SDC and update with recent changes. Thanks.

eohehirA gravatar imageeohehirA ( 2018-09-24 02:58:38 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2018-09-21 09:13:06 -0500

Seen: 21 times

Last updated: Sep 21