Ask Your Question
1

Connect to DigitalOcean Spaces (AWS S3 equivalent)

asked 2019-09-17 10:58:23 -0600

Jose A. gravatar image

updated 2019-09-17 12:00:44 -0600

metadaddy gravatar image

Would it be possible to use Amazon S3 origin to connect to a Digitalocean bucket? Internally both services use the same protocol (both services are equivalent) but I was not able to achieve the connection.

I'm receiving this error

CONTAINER_0701 - Stage 'AmazonS3_01' initialization error: com.amazonaws.services.s3.model.AmazonS3Exception: Bad Request (Service: Amazon S3; Status Code: 400; Error Code: 400 Bad Request; Request ID: 2FCB649974DA9D33; S3 Extended Request ID: lvYbp2stHfH9o6RqifZ59AHzcTc5A/NyqotlC6+uTJDUjwByDagVrk02nOcBySX51RYYw6wfLuc=), S3 Extended Request ID: lvYbp2stHfH9o6RqifZ59AHzcTc5A/NyqotlC6+uTJDUjwByDagVrk02nOcBySX51RYYw6wfLuc=

Does anybody know if it's possible?

Thanks a lot!

edit retag flag offensive close merge delete

Comments

How have you configured the S3 origin? In particular, the region/endpoint?

metadaddy gravatar imagemetadaddy ( 2019-09-17 12:04:54 -0600 )edit

My space is https://XXXXXXXXX.fra1.digitaloceanspaces.com so I have put `eu-central-1` (not sure about that)

Jose A. gravatar imageJose A. ( 2019-09-18 02:22:14 -0600 )edit
add a comment

1 Answer

Sort by ยป oldest newest most voted
0

answered 2019-09-18 13:34:26 -0600

metadaddy gravatar image

Change the region to 'Other - specify' and you can enter the correct endpoint for DigitalOcean Spaces:

image description

Choosing eu-central-1 (or any of the other listed regions) will send the request to AWS.

edit flag offensive delete link more

Comments

I fix it using "Other - specify" as region and the generic endpoint from DigitalOcean "fra1.digitaloceanspaces.com"

Jose A. gravatar imageJose A. ( 2019-09-24 09:03:16 -0600 )edit
add a comment
Login/Signup to Answer

Question Tools

1 follower

subscribe to rss feed

Stats

Asked: 2019-09-17 10:58:23 -0600

Seen: 226 times

Last updated: Sep 18 '19

Related questions

Joining multiple CSVs using hive

Pipeline fails with OutOfMemory "Java Heap size" exception after continuous mysql binlog issue

Only Reset Origin s3 Helps

S3 Origin: need help setting up prefixes...

S3 Origin Exceedingly Slow To Responsd

Streamsets DC Pipeline S3 origin stage error "Data read has a different length than the expected"

Amazon S3 origin: java.lang.NumberFormatException

S3 Origin Event Generation not generating any events

Is it possible to process an output file from another pipeline?

Delete S3 objects

Copyright StreamSets, Inc., 2017.
Licensed under Creative Commons Attribution Share Alike 3.0
about | faq | help | privacy policy | give feedback
Powered by Askbot version 0.7.58