Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

How can I query or report on my pipelines?

I'm trying to gather some documentation on our StreamSets pipelines. Is it possible to query the Data Collector repository? For example, I'd like to identify all our pipelines that use a JDBC query origin and have a certain set of tags. For those, I'd like to pull pieces of information like the pipeline title, JDBC connection string, and SQL query, and retrieve those as a CSV or insert them into a database table (this will be combined with other documentation from other sources). Is that all possible? Thanks!