893 questions

I always got this BinaryLog Client was unable to connect

• mysqlbinarylog

Basic Tutorial - 2 stages to the same destination

• tutorial

33

views

1

answer

1

vote

2018-10-04 11:15:50 -0600 metadaddy

Is it possible to view runtime properties via StreamSets Data Collector UI?

• datacollector
• config

HTTP Client request logging

• httpclient
• request
• logging

Get pipeline to make a DB entry on finish

37

views

1

answer

no

votes

2018-10-03 00:08:55 -0600 Maithri

Failed to connect to Postgresql db using JDBC Multitable Consumer

Kinesis consumer failing when using InitialPosition "AT_TIMESTAMP"

• Kinesis
• Consumer
• timestamp
• initialposition

Can I get HTTP 204 returned from streamsets?

• askstreamsets
• Streamset
• streamsets

96

views

1

answer

1

vote

2018-10-02 12:10:57 -0600 metadaddy

Kafka consumer creation/interruption during pipeline validation

• kafka
• multitopic
• Consumer
• validation
• exception

26

views

1

answer

1

vote

2018-10-01 19:46:33 -0600 metadaddy

Can pipeline stages communicate bidirectionally?

I am using HTTP server as origin and destination is local FS. My data is originating in "json" and need to in SQL format at destination or any readable So what Processor need to add.

Limit number of resources consumed by a batch job

• sdc
• batch-job
• resources

21

views

1

answer

no

votes

2018-09-30 01:45:38 -0600 Maithri

JDBC_29 - Query must include '200' in WHERE clause and in ORDER BY clause before other columns.

Shell executor not executing AWS cli commands as expected

92

views

1

answer

no

votes

2018-09-28 09:41:34 -0600 metadaddy

Unable to start Streamsets

Using SDC Processor

Create Record in Custom Processor in Threads outside the process method

Support both Custom Processor/ Custom Origin in single Block

32

views

1

answer

1

vote

2018-09-26 19:10:45 -0600 metadaddy

If I have a CDC origin (e.g. Oracle CDC) do I need to create multiple JDBC producer for each table. Looking at the config it seems so.

Convert to date string - record:errorTime()

• error
• datetime

13

views

no

answers

no

votes

2018-09-25 07:20:38 -0600 Maithri

How to achieve CDC using MySQL Binary Log and JDBC lookup when there are large number of tables?

• CDC
• mysqlbinarylog
• jdbclookup
• table

48

views

1

answer

1

vote

2018-09-24 19:21:40 -0600 metadaddy

Best practices on starting/stopping pipelines

• streamsets
• pipeline

Error while running pipeline with run time parameters

Can I call data collector rest api from within a pipeline?

• datacollector
• rest
• httpclient
• api

What is the architecture design of StreamSets Data Collector?

23

views

1

answer

1

vote

2018-09-21 20:42:57 -0600 metadaddy

Recover a corrupt pipeline post disk space error

How to ensure pipeline is fetching data from all the tables mentioned in JDBC multitable origin?

• jdbcMultitable
• Data
• destination
• preview

25

views

1

answer

1

vote

2018-09-21 08:58:10 -0600 metadaddy

Mongo DB Lookup

Filter File Tail records on the edge

• sdcedge
• sdc
• filter
• tailfile
• tail

How to store status in ETL pipeline?

• ETL
• JDBCQuery