[NEW] SKAdNetwork Modeled Metrics: FAQ and Troubleshooting

Troubleshooting

Why don't I see modeled metrics for a campaign?
  • It's possible the campaign has no conversion values at all (all of the postbacks were sent with censored conversion values), which leaves the Singular algorithm with no data to base a model on.
  • For Google campaigns: Google currently reports SKAN installs with missing conversion values as if they have the conversion value 0. Since Singular doesn't know how many conversion values are missing for any campaign, we can't show modeled metrics.
Why doesn't the Modeled Revenue always equal Revenue / CV Ratio?

Modeled metrics are calculated per campaign (or sub campaign, where available). If you run a higher-level report, e.g., only App and Source, the modeled metrics are not recalculated at the App + Source level but rather added up based on the modeled metrics for the relevant campaigns. This is why the Modeled Revenue metric (or other modeled metrics) may be slightly different than the SKAN Metric divided by Conversion Value Ratio.

Why can't I see modeled metrics with a Country or Publisher Site ID breakdown?

Country data is not available in SKAdNetwork, and Publisher Site ID is unavailable whenever the conversion value is censored. To see modeled metrics/events in your report, be sure to unselect the Country and Publisher Site ID dimensions.

FAQ

What are modeled metrics?

For SKAdNetwork campaigns with partial data (due to censored conversion values), Singular can show modeled (extrapolated) metrics for the entire campaign.

Modeled metrics are derived from the installs for which we do have data.

For example:

  • A SKAN campaign has 50 installs, out of which 25 came with a conversion value (the Conversion Value Ratio is 50%).
  • Based on the existing conversion values, the SKAN revenue is $30. 
  • The modeled revenue for the campaign, based on the assumption that the installs with censored conversion values behave like the installs with available conversion values, is $60.

image3.png

If you run a SKAN report at the highest granularity, you can see that the Modeled Revenue is equal to SKAN Revenue divided by the Conversion Value Ratio. The same goes for other modeled metrics and events.

Note that if you run a higher-level report, e.g., only App and Source, the modeled metrics are not recalculated at the App + Source level but rather added up based on the modeled metrics for the relevant campaigns.

This is why the modeled metric may be slightly different from the result of dividing the SKAN metric by the Conversion Value Ratio.

What metrics can Singular model?

Revenue (SKAdNetwork Reports)

Singular offers Modeled SKAN Revenue (relevant only for campaigns with a Revenue model).

For example: 

  • A SKAN campaign has 50 installs, out of which 25 came with a conversion value (the Conversion Value Ratio is 50%).
  • Based on the existing conversion values, the SKAN revenue is $30. 
  • The modeled revenue for the campaign, based on the assumption that the installs with censored conversion values behave like the installs with available conversion values, is $60.

image3.png

Events (SKadNetwork Reports)

Singular offers Modeled SKAN Events (relevant only for campaigns with an Events model). You can select the events you want to see modeled counts for out of a drop-down list.

Conversion Value Count (SKAdNetwork Raw Data Report)

The Modeled Conversion Value Count estimates how many installs in a campaign had a specific conversion value. This is calculated based on the prevalence of these conversion values in the installs we do have conversion values for.

image2.png

image1.png

In the example above, in a campaign with 105 installs, only 35 had conversion values included in the postback. The Modeled Conversion Value Count shows how many installs had each conversion value if we assume that the partial data is representative of all the installs.

Why are modeled metrics needed?

For most iOS 14+ app installs, any information about user behavior - including post-install interactions with the app and how much revenue they brought in - is encoded in the conversion value that is included in Apple's SKAdNetwork postback.

However, not all postbacks contain a conversion value. Apple censors the conversion value for privacy reasons when the number of installs for a campaign doesn't reach a certain threshold. This results in installs for which we don't have any data apart from the app and the attributed network.

To bridge this gap, Singular offers modeled metrics, which are extrapolated for all installs in a certain campaign or sub campaign based on the installs that do have a conversion value.

What is the confidence interval?

To get more information about the reliability of modeled metrics and events, you can choose to see the confidence interval. Singular's algorithm indicates with a high level of confidence that the real value is within this range. 

The value displayed as the modeled metric is the most highly probable value within the confidence interval.

Was this article helpful?