Ask Your Question
1

Read from Azure Blob Storage

asked 2020-02-04 11:43:05 -0500

ranjansingh gravatar image

updated 2020-02-04 11:49:58 -0500

metadaddy gravatar image

I have some Excel files stored in Azure blobs. I would like to get the files and process the data to database.

I am using the following:

  • Source: Hadoop FS Standalone
  • File System URI : wasbs://container@storage.blob.core.windows.net/container
  • Additional Configuration
    • name: fs.azure.account.key.storage.blob.core.windows.net
    • value: storage key

I still not able to connect to an Azure blob.

I am new to StreamSets. Please can someone guide/suggest where am I making a mistake.

edit retag flag offensive close merge delete

Comments

Please edit your question and add any errors that you see, including the stack trace from sdc.log

metadaddy gravatar imagemetadaddy ( 2020-02-04 11:50:32 -0500 )edit

1 Answer

Sort by ยป oldest newest most voted
1

answered 2020-02-04 13:49:46 -0500

rupal gravatar image

updated 2020-07-08 23:51:21 -0500

Hi Rajan,

Please try the following configuration and let me know if that succeeds.

Configure 2 properties under Additional Properties: If using Shared Key authentication, configure these 2 properties:

fs.azure.account.key.<storage_account>.blob.core.windows.net=<shared_key> fs.azure.account.keyprovider.<storage_account>.blob.core.windows.net=org.apache.hadoop.fs.azure.SimpleKeyProvider

If not, please share how you've configured the stage and sdc.log for stack trace on the error.

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2020-02-04 11:43:05 -0500

Seen: 243 times

Last updated: Jul 08