Ask Your Question

how to store field BLOB (oracle) in amazon S3

asked 2019-06-26 11:46:36 -0500

streamhada gravatar image

updated 2019-06-27 11:33:11 -0500

metadaddy gravatar image

Hi How can I store a field Blob (in my oracle table) in my amazon Bucket.

I created a pipeline :

  • origin => jdbc query consumer and it is selecting my Blob field
  • destination => amazon S3

I am able to copy the file in S3, but i think something is wrong because i can't visualise my pdf file

I configured for amazon S3 :


I tried all of them and it is the only one working, also it copied files in S3 but it is Json, it looks like that

�{"header":{"stageCreator":"JDBCQueryConsumer_01","sourceId":"SELECT BIN_CONTENUFROM ERM.DOCUMENT_E::rowCount:0","stagesPath":"JDBCQueryConsumer_01","trackingId":"SELECT BIN_CONTENUFROM ERM.DOCUMENT_E::rowCount:0::JDBCQueryConsumer_01","previousTrackingId":null,"raw":null,"rawMimeType":null,"errorDataCollectorId":null,"errorPipelineName":null,"errorStage":null,"errorStageLabel":null,"errorCode":null,"errorMessage":null,"errorTimestamp":0,"errorStackTrace":null,"errorJobId":null,"values":{"jdbc.tables":"","jdbc.BIN_CONTENU.jdbcType":"2004"}},"value":{"type":"LIST_MAP","value":[{"type":"BYTE_ARRAY","value":"JVBERi0xLjMKJZKgoooKNCAwIG9iago8PC9UeXBlL1hPYmplY3QKL1N1YnR5cGUvSW1hZ2UKL1dpZHRoIDE2NjQKL0hlaWdodCAyMzM5Ci9CaXRzUGVyQ29tcG9uZW50IDEKL0NvbG9yU3BhY2UvRGV2aWNlR3JheQovRmlsdGVyWy9DQ0lUVEZheERlY29kZV0KL0RlY29kZVBhcm1zWzw8L0NvbHVtbnMgMTY2NCAvUm93cyAyMzM5Pj5dCi9MZW5ndGggMjgyMDMKPj4Kc3RyZWFtCgACwagAsGoALBqACwagAsGoALBqACwagAsGoALBqACwagAsGoALBqACwagAsGoALBqACwagAsGoALBqACwagAsGoALBqACwagAsGoALBqACwagAsGoALBqACwagAsGoALBqACwagAsGoALBqACwagAsGoALBqACwagAsGoALBqACwagAsGoALBqACwagAsGoALBqACwagAsGoALBqACwagAsGoALBqACwagAsGoALBqACwagAsGoALBqACwagAsGoALBqACwagAsGoALBqACwagAsGoALBqACwagAsGoALBqAC11hMkwAWDUAFg1ABYNQAWDUAFg1ABYNQAWDUAFg1ABYNQAWDUAFg1ABYNQAWDUAFg1ABYNQAWDUAFg1ABYNQAWDUAFg1ABYNQAWDUAFg1ABQ==","attributes":{"sdp.classified":"true"},"sqpath":"/BIN_CONTENU","dqpath":"/BIN_CONTENU"}],"sqpath":"","dqpath":""}}

.image description

edit retag flag offensive close merge delete


How have you configured the S3 destination?

metadaddy gravatar imagemetadaddy ( 2019-06-26 11:52:11 -0500 )edit

1 Answer

Sort by » oldest newest most voted

answered 2019-06-27 12:07:25 -0500

metadaddy gravatar image

Set the S3 destination Data Format to Binary and the Binary Field Path to the field containing the blob. It looks like this is /BIN_CONTENU in your example.

image description

edit flag offensive delete link more


thank you for your answer , it is working :)

streamhada gravatar imagestreamhada ( 2019-06-28 02:52:48 -0500 )edit

Great, @streamhada! Could you vote up my answer so people can see that it solves your problem?

metadaddy gravatar imagemetadaddy ( 2019-06-28 17:27:44 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower


Asked: 2019-06-26 11:46:36 -0500

Seen: 854 times

Last updated: Jun 28 '19