2199 questions

how to trigger the pipeline only after a particular file is available in the source

• directory

parameters in notification payload

• notification
• webhook

How to cache certain rules in StreamSets

how to process all file in a directory?

• directory
• subdirectories

MongoDB destination is not finding the nested unique index keys

• mongo
• MongoDB_destination

Field level update is not working with nested JSON structure in MongoDB destination

• MongoDB_destination

How to check if a list contains an item?

• el

JDBC Producer - unable to load special characters in Oracle table properly

How to execute file upload

• fileupload
• http-client
• httpclient
• httpclientprocessor

Not able to access /etc/sdc folder

how to registering sdc

• registering

Nested the list map in XML file

• list
• jythonEvaluator
• list_map

What column order does StreamSets select from Oracle?

• Oracle
• OracleCDC
• csv
• s3
• s3Target

296

views

1

answer

no

votes

2020-10-14 02:06:46 -0500 AC

jdbc query executor

• jdbc
• query
• executor

Error getting metadata topic <topic xyz> from broker <broker name>

Mysql JDBC Multitable with multiple schemas

• mysql
• jdbc
• jdbcMultitable

How to convert the object which has date field to json without changing the date format

How to create a header for fixed width delimited file

• Fixed
• length
• fields

Can I use sdc for outbox pattern?

• MsSql
• outboxpattern

Data migration from SQL server to mongodb

• MongoDB
• Data
• DataMigration

Cannot send a request outside the Docker container

• docker

Multiple Hadoop FS Destinations in Hive Drift Sync?

• datacollector
• hive
• avro
• hadoopfs

An exception occurred during starting pipeline with spark

• StreamsetTransformer
• SparkTransformer
• spark
• Transform

Initial snapshot for MySQL binlog origin

• mysqlbinarylog
• CDC
• origin

Streamsets DC Pipeline S3 origin stage error "Data read has a different length than the expected"

• s3Origin
• avro
• json

Why Jython-Evaluator is producing multiple records for each input record when used with Multitable-Consumer as the origin in the pipeline?

• jythonEvaluator
• jython
• duplication
• jdbcMultitable

Directory origin starts processing file before it is fully copied

oracle stored procedure

• stored
• procedure
• Oracle

Streamsets transformer "Pyspark" component is giving error while i am trying to read s3 file while same pyspark script is working from emr console

• askstreamsets
• Streamset
• streamsets
• StreamsetTransformer

Error: Invalid Hive Type Definition: {} smallint

• datacollector
• hive