Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

Update MongoDB destination based on _id column

Hi,

I am having MongoDB collection test1 as origin and also trying to update a different MongoDB collection test. I am trying to update based on _id(MongoDB default unique key) column.

It is not updating the target. The _id column is of data type object in MongoDB collection but when I run data preview on Streamsets processors it is processed as String. Can we change the data type of a column to Object type (tried using Field Type Converter processor but object data type is not present).

I have also read in Streamsets JIRA that MongoDB destination does not allow upserts with non-string unique keys: https://issues.streamsets.com/browse/SDC-4743

Can you please explain how to proceed with this scenario.

Update MongoDB destination based on _id column

Hi,

I am having MongoDB collection test1 as origin and also trying to update a different MongoDB collection test. I am trying to update based on _id(MongoDB default unique key) column.

It is not updating the target. The _id column is of data type object in MongoDB collection but when I run data preview on Streamsets processors it is processed as String. Can we change the data type of a column to Object type (tried using Field Type Converter processor but object data type is not present).

I have also read in Streamsets JIRA that MongoDB destination does not allow upserts with non-string unique keys: https://issues.streamsets.com/browse/SDC-4743

Can you please explain how to proceed with this scenario.image description

Update MongoDB destination based on _id column

Hi,

I am having MongoDB collection test1 as origin and also trying to update a different MongoDB collection test. I am trying to update based on _id(MongoDB default unique key) column.

It is not updating the target. The _id column is of data type object in MongoDB collection but when I run data preview on Streamsets processors it is processed as String. Can we change the data type of a column to Object type (tried using Field Type Converter processor but object data type is not present).

I have also read in Streamsets JIRA that MongoDB destination does not allow upserts with non-string unique keys: https://issues.streamsets.com/browse/SDC-4743

Can you please explain suggest how to proceed with this scenario.image description