Cron Scheduler Origin Error

asked 2020-07-20 09:38:21 -0500

SIJavierLanda gravatar image

Hello Guys,

I'm new to StreamSets and by the moment I'm running SDC 3.16.1 in Kubernetes (Had to build my own image installing jdc-lib and orchestrator-lib).

I have a Pipeline that looks like this:

image description

Its very simple, I'm just copying some data from sql server db to mysql and have the pipeline to stop after no-more-data event is triggered, I did this by following the guide at docs, it works fine.

Now I want to schedule this pipeline to be executed every day at 9pm, I saw that there's been added some libs that allow this without creating a cronjob in my server crontab, so aftear reading a bit I created this other pipeline: image description Honestly I'm not sure about the "To Error" destination, i just didn't know which destination use to finish this orchestation pipeline, I think I might read a little more.

The thing here is that when I run this pipeline it ends automatically and it prints an error on logs that says: 'ERROR The scheduler cannot be restarted after shutdown() has been called." image description

Any idea of what can be happening? Do I need to config anything else than just installing orchestation libs?

Hope you can help me guys, thanks in advance!


Javier Landa.

edit retag flag offensive close merge delete


Just wanted to add that I cloned the pipeline and it worked fine, don't why this happened. Thanks anyways.

SIJavierLanda gravatar imageSIJavierLanda ( 2020-07-21 14:50:16 -0500 )edit