Ask Your Question

pipelineState.json disappears

asked 2018-09-07 07:01:04 -0600

Dean Han gravatar image

updated 2018-09-07 07:07:56 -0600

I have met this situation several times. Looks like when OS was shutdown while pileline was running, this situation might be happened. How to find this file? Due to this, pipeline can not opened in SDC.

CONTAINER_0209 - Pipeline state file '/home/xxx/streamsets-datacollector-3.3.1/data/runInfo/SQL1b6ad774-0b9c-404d-ad3b-36747abcbd2d/0/pipelineState.json' doesn't exist

Just checked and found this file is there, but it is empty.


edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2018-09-07 10:16:12 -0600

metadaddy gravatar image

If you don't have a backup, there are a couple of different ways to proceed.

If pipelineStateHistory.json is there, you can copy its last entry to pipelineState.json

Otherwise, you can create a 'fresh' pipelineState.json from the following template. Change New2763da54-8dd2-42fa-8fbe-e5e6e0a2edc4 to your pipeline's id.

  "pipelineId" : "New2763da54-8dd2-42fa-8fbe-e5e6e0a2edc4",
  "rev" : "0",
  "user" : "admin",
  "status" : "EDITED",
  "message" : "Pipeline edited",
  "timeStamp" : 1498585585337,
  "attributes" : {
    "IS_REMOTE_PIPELINE" : false
  "executionMode" : "STANDALONE",
  "metrics" : null,
  "retryAttempt" : 0,
  "nextRetryTimeStamp" : 0,
  "name" : "New2763da54-8dd2-42fa-8fbe-e5e6e0a2edc4"
edit flag offensive delete link more


Thanks a lot! It fixed it after putting the latest timestamp from the older files.

Kumar Abinash gravatar imageKumar Abinash ( 2020-07-03 02:13:05 -0600 )edit
Login/Signup to Answer

Question Tools

1 follower


Asked: 2018-09-07 07:01:04 -0600

Seen: 1,046 times

Last updated: Sep 07 '18