SFTP ETL Integration

Singular's SFTP ETL integration exports data from Singular automatically to an SFTP Server. If ETL is enabled for your account, you can follow the instructions below to set the integration up.

For general information about Singular's ETL offering, see the Singular ETL FAQ.

Setup Instructions

To add an SFTP data connector in Singular:

  1. In your Singular account, go to Settings > Data Connectors and click Add New Connector.
  2. Type in "SFTP Destination".
  3. In the window that opens, fill in the bucket name you created:

    mceclip1.png

  4. Fill in the connections details including: Username, Password, Hostname & Port Number
  5. Select an output format "CSV" or "Parquet"
  6. Choose output path in your SFTP for example:
    "singular_marketing_data/{date}{extension}"

Note that Singular supports several placeholders (macros) that will get expanded automatically:

Placeholder Description Example
{date} Date of the data being exported from Singular 2020-03-19
{day} Day part of the data being exported from Singular (zero padded) 19
{month} Month part of the data being exported from Singular 03
{year} Year part of the data being exported from Singular 2020
{extension} Output file extension .csv or .parquet
{job_timestamp}  The exact time the ETL job started running.
Use this if you would like to have a new file every day (for example, have a new folder for each run with all the dates that were pulled in that job)
2020-03-20 
{job_date}

The date the ETL job started running.

Similar to {job_timestamp}, but contains only the date of the job rather than the full timestamp.

2020-03-20
Was this article helpful?
0 out of 0 found this helpful