Ask Your Question

TOERROR_00 - Sent to error by previous stage

asked 2019-08-09 14:22:12 -0500

daveh gravatar image

Getting this error in a To Error stage after a Stream Selector condition sends it there. However, pipeline is set to send errors to a file and examining the file doesn't show which 'previous stage' sent the error.

Any help is appreciated.


edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2019-08-13 19:33:45 -0500

metadaddy gravatar image

Ensure that the Error Record Policy for the pipeline is 'Record as it was seen by the stage that sent it to error stream'. Then the error record's stagesPath field will contain a : separated list of the stages the record traversed. The last entry in that list is the droid you're looking for.

edit flag offensive delete link more


I can see the last stage in the flow as you directed which is the Stream Selector. Thing is if I replace the To Error stage with the Trash Stage, the pipeline works fine and the appropriate records end up going to the trash stage. Which indicates?? that the pipeline is not erroring out.

daveh gravatar imagedaveh ( 2019-08-14 13:18:41 -0500 )edit

The Stream Selector stage is correctly routing the record based on a value returned from an HTTP Client stage. If a "bad" value is returned then I just want to send the record the pipelines error handling which is not set to send it to another pipeline (which in turns sends out a Kafka message)

daveh gravatar imagedaveh ( 2019-08-14 13:20:16 -0500 )edit

Sorry for the multiple comments, but with only so many charcaters, I don't know what to do otherwise. Should I just edit the question?

daveh gravatar imagedaveh ( 2019-08-14 13:21:06 -0500 )edit

I think I found a solution -- use the SDC RPC stage (the same RPC set up for the pipeline). However, would still like to know why To Error is not working. Do I understand its usage?

daveh gravatar imagedaveh ( 2019-08-14 13:34:40 -0500 )edit

You can indeed edit the question to add more detail there. The 'To Error' stage sends any incoming records to the error stream, just as if they'd triggered an error by, for example, violating a precondition.

metadaddy gravatar imagemetadaddy ( 2019-08-14 13:36:47 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower


Asked: 2019-08-09 14:22:12 -0500

Seen: 130 times

Last updated: Aug 13 '19