Not able to access RDS postgresql DB from streamsets

asked 2020-02-18 00:51:36 -0500

Sujata HS gravatar image

updated 2020-02-18 10:57:40 -0500

metadaddy gravatar image

Hi,

I have installed streamsets (version 2.4.1.0) in AWS EC2 instance and PostgreSQL(10.4) in AWS RDS. Also configured JDBC drivers required for postgresql in below path and set environment variable.

  • /opt/sdc-extras/streamsets-datacollector-jdbc-lib/lib/
  • gave all permission to the jar file
  • And added below in $SDC_CONF/sdc-security.policy file

    // user-defined external directory
    grant codebase "file:///opt/sdc-extras/-" {
      permission java.security.AllPermission;
    };
    

I used below format for jdbc connection string:

jdbc:postgresql://[HOSTNAME]:[PORT]/[DBNAME]

I am able to access PostgreSQL using other tool like PGadmin but getting below error when i tried to connect using JDBC producer stage/JDBC consumer stage from streamsets

"JDBC_00 - Cannot connect to specified database: com.streamsets.pipeline.api.StageException: 
JDBC_06 - Failed to initialize connection pool: com.zaxxer.hikari.pool.PoolInitializationException: 
Exception during pool initialization: The connection attempt failed"
edit retag flag offensive close merge delete

Comments

1

Are you able to access from the command line from the EC2 machine, where SDC is running, using the same credentials that SDC is configured to use? That's the only reliable way to validate network level reachability and AWS security settings.

jeff gravatar imagejeff ( 2020-02-20 10:25:57 -0500 )edit
1

Also, that's a very old version of Data Collector. I highly recommend using the latest released version if just getting started.

jeff gravatar imagejeff ( 2020-02-20 10:26:15 -0500 )edit