Ask Your Question
0

Load data in to MongoDB Destination [closed]

asked 2018-12-03 13:43:24 -0600

srinath_222 gravatar image

updated 2018-12-03 13:43:47 -0600

Hi,

I am trying to load the data into MongoDB destination. From the data preview I am getting the data as below for MongoDB destination: Input Data
Record1 : {MAP} _id : {STRING} 5c0481fceef182fcebc823b0 id : {STRING} 1 name : {STRING} null dept : {STRING} 10 sdc.mongodb.operation : {STRING} 1

I had configured field sdc.mongodb.opearation as per the documentation https://streamsets.com/documentation/....

But when I ran the pipeline, getting the error as below: MONGODB_13 - Error serializing record 'com.streamsets.pipeline.api.base.OnRecordErrorException: MONGODB_15 - Operation type (insert, update or delete) is not specified in the header for record mongodb_oplog::0::41::0': com.streamsets.pipeline.api.base.OnRecordErrorException: MONGODB_15 - Operation type (insert, update or delete) is not specified in the header for record mongodb_oplog::0::41::0

I had set unique key field as id (field is from incoming data) and checked the upsert option.

Please suggest me how to configure MongoDB destination (having sdc.operation.type header attribute is correct).

edit retag flag offensive reopen merge delete

Closed for the following reason the question is answered, right answer was accepted by srinath_222
close date 2018-12-06 14:12:00.430596

1 Answer

Sort by ยป oldest newest most voted
1

answered 2018-12-04 09:00:28 -0600

srinath_222 gravatar image

Able to load into MongoDB destination.

Used sdc.operation.type in Header Attribute instead of Output Field and it worked.

Thanks.

edit flag offensive delete link more

Question Tools

1 follower

Stats

Asked: 2018-12-03 13:43:24 -0600

Seen: 14 times

Last updated: Dec 04