Singular Data Destinations (ETL) FAQ

Singular Data Destinations (ETL) is a premium feature. If you're interested in using this feature, reach out to your Customer Success Manager.

 

Singular can feed data directly into your data warehouse, storage service, or BI platform, where you can use your own BI and visualization tools to process and analyze the data.

By setting up data destinations, you can get your Singular data pushed into your storage service or platform at regular intervals - without requiring any engineering work on your side to implement Singular's Reporting API or process internal BI postbacks.

Which platforms are supported as destinations?

See Data Destinations: Supported Platforms.

What data can be exported?

Type of Data Description Fields Included
Aggregated Campaign Data Ad spend (campaign cost), creative data, install and re-engagement stats, and other KPIs Singular pulls from ad networks and MMPs, broken down by source (network), app, os, country, and other dimensions. See Data Destinations: Aggregated Data Schemas
Aggregated Ad Monetization Data Data about your ad revenue, ad requests, and ad impressions.
User-Level Conversions and Events Data User-level information from Singular's attribution logs, including attributions (conversions) and in-app events. This data is available if you are using Singular's attribution service (for mobile, for web, or cross-device). This data resembles what's you would see when you download attribution logs. See Data Destinations: User-Level Conversions and Events Data Schemas
User-Level Ad Monetization Data If you are collecting user-level ad mon data in Singular (see Setting Up User-Level Revenue Reporting), you can export it using this type of data destination. You can export data from IronSource, AppLovin, and MoPub. Note: User-level ad revenue exports are supported for Redshift and S3 destinations only. See Data Destinations: User-Level Ad Monetization Data Schema

How often is the data refreshed?

Aggregated data is typically pushed every 6 hours, while user-level data (attributions and events) is pushed every hour. Note that this does not necessarily represent the freshness of the data, which depends on other variables, including the data source used by Singular.

For user-level data, you can expect 95% of events to be exported to your system within 3 hours after they occurred. A small minority of events may take a longer time to be processed and exported.

How do I set up data destinations?

mceclip0.png If data destinations are enabled for your account, you will be able to add new destinations through the Data Destinations page:

  1. Log into your Singular account and go to Settings > Data Destinations.
  2. Click Add a New Destination to display a list of the supported destinations for your account. The destinations marked "User-Level" are used to export user-level attributions and events. The others are used to export aggregated data.

However, before you add the destination in Singular, you usually need to perform some configuration steps in the partner platform, e.g. to give Singular permissions to push data to the platform. For instructions for setting up a specific data destination, find the desired destination in the Data Destinations section.

How can I deduplicate the data?

Singular data destination exports don't have a unique key for each row of data. Instead, the data is partitioned, and whenever any information in one of the partitions is changed, Singular fully replaces the existing partition with the new one.

In S3 destinations, each partition is in a separate file. When you process the files, you should look for files that have changed and fully replace your existing data with the new data.

The partition key depends on the type of data:

Export Type Partition Key
Aggregate data (e.g. "S3 Destination") Date
User-level data (e.g. "S3 User-Level Destination") Hour (etl_record_processing_hour_utc)
Ad revenue user-level data (e.g. "S3 Ad Revenue User-Level Destination") Date
Was this article helpful?