779 questions

34

views

1

answer

no

votes

2018-09-18 23:10:25 -0500 Maithri

how to create pipeline load all CDC from multiple tables in a MySQL DB

• CDC
• mysql

Data preview only showing 10 records

Oracle CDC client origin with Redo Logs option not able to capture changes

• CDC

Replace all . with _ in field names

Mongodb destination charset encoding issue

• MongoDB

Is there a method in streamsets to calculate time difference in seconds between 2 given date/time ?

• datetime

17

views

1

answer

no

votes

2018-09-17 07:15:28 -0500 Maithri

Is the directory origin able to read new files in a directory (files are written in such directory in a regular time interval) or it reads all files present in the directory every times?

• directory
• origin

I am using HTTP server as origin and destination is local FS. My data is originating in "json" and need to in SQL format at destination or any readable So what Processor need to add.

JDBC Stages and On Unknown Type => Convert to String

how to do Row to column pivot/transposition

• row
• to
• column
• pivot
• transposition

is there any process does kafka producer acknowledge of received messages?

19

views

1

answer

1

vote

2018-09-14 10:07:48 -0500 metadaddy

How to deduplicate kafka messages with SDC?

• kafka

ElasticSearch as origin in Incremental mode

• elasticsearch
• origin

36

views

1

answer

no

votes

2018-09-14 00:02:03 -0500 Maithri

Write XML files

• xml
• Files

18

views

1

answer

1

vote

2018-09-13 14:19:16 -0500 metadaddy

Change S3 prefix based on filename

Why I get the error "[runner:] [thread:Spool Directory Runner - 0] WARN SpoolDirRunnable - Ignoring file <file1> in spool directory as is lesser than offset file <file2>"?

• directory
• origin
• spooling

I am trying to run through the Spark Evaluator tutorial, and get an exception when running preview. Has anyone seen this before?

• SparkTransformer

19

views

1

answer

no

votes

2018-09-13 23:03:06 -0500 Maithri

How to specify the Table name pattern in the Oracle CDC Client tab

• Oracle
• CDC
• table

52

views

1

answer

no

votes

2018-09-14 04:05:03 -0500 Shruthi

Streamsets pipeline Error while writing Data in Hadoop

• streamsets
• hadoop

What are the performance benchmarks of SDC?

Working with very large files (>100GB)

What does it mean by field to parse and target field in JSON Parser?

• streamsets
• json

Remove existing files before transferring files

• streamsets
• pipeline
• file
• hadoop

Error in Ldap Authentication

• LDAP
• JAAS

Data Type Conversion

• Data
• type

Q about Teradata CDC feature

• CDC
• teradata

How to ensure pipeline is fetching data from all the tables mentioned in JDBC multitable origin?

• jdbcMultitable
• Data
• destination
• preview

Unable to write data from jython evaluator, Streamsets

• streamsets
• jython

how to collect IPFIX and sflow data from UDP port

• IPFIX
• sflow

SDC_RESOURCES

• sdc_resources