Redshift ETL Integration

The Redshift ETL integration exports data from Singular automatically to a Redshift database. If ETL is enabled for your account, you can follow the instructions below to set the integration up.

For general information about Singular's ETL offering, see the Singular ETL FAQ.

Setup Instructions

1. Create a Redshift User

Create a user with the following command:

CREATE USER singular WITH PASSWORD '<password>';

And then grant it the following permissions:

GRANT CREATE ON DATABASE "<enter database name here>" TO "singular";
GRANT SELECT ON ALL TABLES IN SCHEMA information_schema TO singular;
GRANT SELECT ON ALL TABLES IN SCHEMA pg_catalog TO singular;

Note:

  • The first permission allows Singular to create new schemas in the provided database. It does not allow Singular to read or change other schemas or tables in the database.
  • The second and third permissions allow Singular to verify the structure of the tables that Singular will update.

2. Whitelist Singular Server IPs

If you are using a Security Group and only allow certain IPs to connect to your Redshift instance, you need to add Singular’s servers to the whitelisted IPs in your security group. These are the IPs:

  • 54.183.135.179/32
  • 54.183.113.72/32
  • 13.52.189.144/32

To whitelist Singular server IPs:

  1. Go to your Redshift clusters list and select the cluster you want us to use.

  2. In the cluster settings, select the VPC security group you want to edit:

    step2.png

  3. Go to the Inbound tab and click Edit.

  4. Create three rules with the IPs provided above:

    step4.png

3. Add a Redshift Data Connector

To add a Redshift data connector in Singular:

  1. In your Singular account, go to Settings > Data Connectors and click Add New Connector.
  2. Type in "Redshift Destination".

    mceclip0.png

  3. In the window that opens, fill in the relevant details:

    mceclip1.png

    Field Description
    Username The username and password you created in Step 1. 
    Password
    Hostname The hostname of your Redshift instance.
    Port The port number of your Redshift instance.
    Database Name The database that you granted Singular permissions to.
    Schema Name Enter a name for the schema that Singular will create and write to. Default: "singular".
    Table Name Enter a name for the table that Singular will create and write to. Default: "marketing_data".
    Data Schema The schema of the data loaded into the destination, see ETL Data Schema.
Was this article helpful?
1 out of 1 found this helpful