How to upgrade a data pipeline running on production by OPS?
I want to know what's the best practice to upgrade a data pipeline running on production by OPS. For developer, he can export an updated data pipeline configuration in json file then handle it to OPS and ask latter to deploy it on production.
For OPS, he need
- stop & remove the old target data pipeline
- import the new target data pipeline, change those pipeline parameters to adapt with production environment
- check and run new target data pipeline
Am I right?
My questions are:
- How the new data pipeline resume processing from the offset left from the old data pipeline?
- Should I keep the same pipeline UUID with old one in new one?
- What about need upgrade SDC platform itself?