Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

How to add/inject a new field into a pipeline

I've got a JDBC query consumer executing some SQL and pushing to Kafka. I need to add or inject an additional field (a literal) into the pipeline. It's easy with the query consumer; I just add a literal into the SELECT statement. But with a multi-table consumer I can't define SQL (which is really frustrating, TBH). I can easily imagine needing to do this with other origins as well.

So, what are some ways/best practices to do this sort of thing within streamsets?