Artwork

ืชื•ื›ืŸ ืžืกื•ืคืง ืขืœ ื™ื“ื™ Shamanth Rao. ื›ืœ ืชื•ื›ืŸ ื”ืคื•ื“ืงืืกื˜ื™ื ื›ื•ืœืœ ืคืจืงื™ื, ื’ืจืคื™ืงื” ื•ืชื™ืื•ืจื™ ืคื•ื“ืงืืกื˜ื™ื ืžื•ืขืœื™ื ื•ืžืกื•ืคืงื™ื ื™ืฉื™ืจื•ืช ืขืœ ื™ื“ื™ Shamanth Rao ืื• ืฉื•ืชืฃ ืคืœื˜ืคื•ืจืžืช ื”ืคื•ื“ืงืืกื˜ ืฉืœื•. ืื ืืชื” ืžืืžื™ืŸ ืฉืžื™ืฉื”ื• ืžืฉืชืžืฉ ื‘ื™ืฆื™ืจื” ืฉืœืš ื”ืžื•ื’ื ืช ื‘ื–ื›ื•ื™ื•ืช ื™ื•ืฆืจื™ื ืœืœื ืจืฉื•ืชืš, ืืชื” ื™ื›ื•ืœ ืœืขืงื•ื‘ ืื—ืจ ื”ืชื”ืœื™ืš ื”ืžืชื•ืืจ ื›ืืŸ https://he.player.fm/legal.
Player FM - ืืคืœื™ืงืฆื™ื™ืช ืคื•ื“ืงืืกื˜
ื”ืชื—ืœ ื‘ืžืฆื‘ ืœื ืžืงื•ื•ืŸ ืขื ื”ืืคืœื™ืงืฆื™ื” Player FM !

๐Ÿ—‚๏ธ How to use econometric models to supplement SKAdNetwork for mobile measurement in iOS 14 - with Brian Krebs (MetricWorks), and Anthony Cross (formerly at Big Fish Games) โš–๏ธ

43:42
 
ืฉืชืคื•
 

Manage episode 278922760 series 2575608
ืชื•ื›ืŸ ืžืกื•ืคืง ืขืœ ื™ื“ื™ Shamanth Rao. ื›ืœ ืชื•ื›ืŸ ื”ืคื•ื“ืงืืกื˜ื™ื ื›ื•ืœืœ ืคืจืงื™ื, ื’ืจืคื™ืงื” ื•ืชื™ืื•ืจื™ ืคื•ื“ืงืืกื˜ื™ื ืžื•ืขืœื™ื ื•ืžืกื•ืคืงื™ื ื™ืฉื™ืจื•ืช ืขืœ ื™ื“ื™ Shamanth Rao ืื• ืฉื•ืชืฃ ืคืœื˜ืคื•ืจืžืช ื”ืคื•ื“ืงืืกื˜ ืฉืœื•. ืื ืืชื” ืžืืžื™ืŸ ืฉืžื™ืฉื”ื• ืžืฉืชืžืฉ ื‘ื™ืฆื™ืจื” ืฉืœืš ื”ืžื•ื’ื ืช ื‘ื–ื›ื•ื™ื•ืช ื™ื•ืฆืจื™ื ืœืœื ืจืฉื•ืชืš, ืืชื” ื™ื›ื•ืœ ืœืขืงื•ื‘ ืื—ืจ ื”ืชื”ืœื™ืš ื”ืžืชื•ืืจ ื›ืืŸ https://he.player.fm/legal.

Our guests today are Brian Krebs and Anthony Cross. Brian is the founder and CEO of MetricWorks, and Anthony formerly at Big Fish Games. In todayโ€™s conversation they offer very interesting perspectives on why SKAdNetwork isnโ€™t enough - and what it needs to be supplemented by in order for mobile measurement to truly reflect the value of marketing efforts.
In todayโ€™s conversation, we reflect on why measurement in a world where marketing is influenced by multiple variables has no clear and easy answers - certainly none seemingly as simple as the solutions that deterministic measurement offered. The solution then is to embrace the multiple variables involved - and use an approach that is a mix of SKAdNetwork, econometric modeling and intelligent experimentation.
Key highlights:
๐ŸŒ“ Why last touch attribution does not give the whole picture
๐Ÿ‹๏ธโ€โ™‚๏ธ Incrementality is THE criteria for marketing effectiveness
๐Ÿค The limitations of SKAdNetwork signals for measurement
๐Ÿงฎ Top statistics-based approaches to measuring incrementality that work
๐Ÿผ How statistical models rely on IDFAs to be useful
๐Ÿงจ No-IDFA is going to blow up the measurement landscape
๐Ÿ“š Big Fish used multiple sources of data in a custom dashboard to solve for attribution
๐Ÿ’ก How Big Fish used data science to get marketing insights
๐Ÿฆ‹ Using data science to comparing LTV curves through a gaming app launch cycle to amp up ROAS
โ—€๏ธ Reverse engineering LTV curves to inform ad spend decisions
๐Ÿ—บ๏ธ Mapping in-app events to monetisation and retention opportunities
๐Ÿ’ธ Spend needs to tie back to business, and LTV is the only way to do that
๐Ÿ“ Where to apply econometric modelling in marketing
๐ŸŽจ How to use media mix models for marketing
๐Ÿ—๏ธ How to build models that calculate impact and outcomes
๐Ÿ’ฏ Micro and macro level factors to consider for accurate predictions
๐Ÿƒ How seasonality and trends impact lift
โš™๏ธ Tweaking factors to generate insights about what-if scenarios
๐Ÿ‘‹ The journey from deterministic to probabilistic has already begun
๐Ÿงช Testing successful campaigns with interrupted time series can give counterintuitive results
๐Ÿ’ช How the post-IDFA landscape is strengthening the case for incrementality testing
๐Ÿ”ป The opportunity cost for interrupted time series experiments
โš–๏ธ The careful balance in ITS experiments
๐Ÿ”Ž Why models are necessary alongside experiments for real validation
๐Ÿงฑ How to construct an econometric model by choosing the right variables
๐Ÿ“… Why daily data is better than weekly data for training models in spite of the increased noise
๐Ÿ“ˆ The value of seasonality and trends encoding in models
๐Ÿ”ฎ The key to good prediction for granularity in each event
๐Ÿ”ฌ Understanding counterfactual experiments and setting baselines
๐Ÿฅ‡ Why incrementality testing is the gold standard now but not post-IDFA
๐Ÿ‘ฌ๐Ÿป The two-fold team buy-ins for testing
๐Ÿค Why transparent partners are very important to a UA team
๐ŸŒŒ Why experiments are tied to a certain level of scale
๐Ÿšผ Why single apps donโ€™t have to worry about incrementality till scale
๐Ÿ‘Œ The tried and tested approach to learning how to model
Check out the show notes here: https://mobileuseracquisitionshow.com/episode/how-to-use-econometric-models-to-supplement-skadnetwork-for-mobile-measurement-in-ios-14-with-brian-krebs-and-anthony-cross/

**
Get more mobile user acquisition goodies here:
http://RocketShipHQ.com
http://RocketShipHQ.com/blog
**
Check out our podcast featuring inside stories of how technology evolves and grows:
http://HowThingsGrow.co

  continue reading

251 ืคืจืงื™ื

Artwork
iconืฉืชืคื•
 
Manage episode 278922760 series 2575608
ืชื•ื›ืŸ ืžืกื•ืคืง ืขืœ ื™ื“ื™ Shamanth Rao. ื›ืœ ืชื•ื›ืŸ ื”ืคื•ื“ืงืืกื˜ื™ื ื›ื•ืœืœ ืคืจืงื™ื, ื’ืจืคื™ืงื” ื•ืชื™ืื•ืจื™ ืคื•ื“ืงืืกื˜ื™ื ืžื•ืขืœื™ื ื•ืžืกื•ืคืงื™ื ื™ืฉื™ืจื•ืช ืขืœ ื™ื“ื™ Shamanth Rao ืื• ืฉื•ืชืฃ ืคืœื˜ืคื•ืจืžืช ื”ืคื•ื“ืงืืกื˜ ืฉืœื•. ืื ืืชื” ืžืืžื™ืŸ ืฉืžื™ืฉื”ื• ืžืฉืชืžืฉ ื‘ื™ืฆื™ืจื” ืฉืœืš ื”ืžื•ื’ื ืช ื‘ื–ื›ื•ื™ื•ืช ื™ื•ืฆืจื™ื ืœืœื ืจืฉื•ืชืš, ืืชื” ื™ื›ื•ืœ ืœืขืงื•ื‘ ืื—ืจ ื”ืชื”ืœื™ืš ื”ืžืชื•ืืจ ื›ืืŸ https://he.player.fm/legal.

Our guests today are Brian Krebs and Anthony Cross. Brian is the founder and CEO of MetricWorks, and Anthony formerly at Big Fish Games. In todayโ€™s conversation they offer very interesting perspectives on why SKAdNetwork isnโ€™t enough - and what it needs to be supplemented by in order for mobile measurement to truly reflect the value of marketing efforts.
In todayโ€™s conversation, we reflect on why measurement in a world where marketing is influenced by multiple variables has no clear and easy answers - certainly none seemingly as simple as the solutions that deterministic measurement offered. The solution then is to embrace the multiple variables involved - and use an approach that is a mix of SKAdNetwork, econometric modeling and intelligent experimentation.
Key highlights:
๐ŸŒ“ Why last touch attribution does not give the whole picture
๐Ÿ‹๏ธโ€โ™‚๏ธ Incrementality is THE criteria for marketing effectiveness
๐Ÿค The limitations of SKAdNetwork signals for measurement
๐Ÿงฎ Top statistics-based approaches to measuring incrementality that work
๐Ÿผ How statistical models rely on IDFAs to be useful
๐Ÿงจ No-IDFA is going to blow up the measurement landscape
๐Ÿ“š Big Fish used multiple sources of data in a custom dashboard to solve for attribution
๐Ÿ’ก How Big Fish used data science to get marketing insights
๐Ÿฆ‹ Using data science to comparing LTV curves through a gaming app launch cycle to amp up ROAS
โ—€๏ธ Reverse engineering LTV curves to inform ad spend decisions
๐Ÿ—บ๏ธ Mapping in-app events to monetisation and retention opportunities
๐Ÿ’ธ Spend needs to tie back to business, and LTV is the only way to do that
๐Ÿ“ Where to apply econometric modelling in marketing
๐ŸŽจ How to use media mix models for marketing
๐Ÿ—๏ธ How to build models that calculate impact and outcomes
๐Ÿ’ฏ Micro and macro level factors to consider for accurate predictions
๐Ÿƒ How seasonality and trends impact lift
โš™๏ธ Tweaking factors to generate insights about what-if scenarios
๐Ÿ‘‹ The journey from deterministic to probabilistic has already begun
๐Ÿงช Testing successful campaigns with interrupted time series can give counterintuitive results
๐Ÿ’ช How the post-IDFA landscape is strengthening the case for incrementality testing
๐Ÿ”ป The opportunity cost for interrupted time series experiments
โš–๏ธ The careful balance in ITS experiments
๐Ÿ”Ž Why models are necessary alongside experiments for real validation
๐Ÿงฑ How to construct an econometric model by choosing the right variables
๐Ÿ“… Why daily data is better than weekly data for training models in spite of the increased noise
๐Ÿ“ˆ The value of seasonality and trends encoding in models
๐Ÿ”ฎ The key to good prediction for granularity in each event
๐Ÿ”ฌ Understanding counterfactual experiments and setting baselines
๐Ÿฅ‡ Why incrementality testing is the gold standard now but not post-IDFA
๐Ÿ‘ฌ๐Ÿป The two-fold team buy-ins for testing
๐Ÿค Why transparent partners are very important to a UA team
๐ŸŒŒ Why experiments are tied to a certain level of scale
๐Ÿšผ Why single apps donโ€™t have to worry about incrementality till scale
๐Ÿ‘Œ The tried and tested approach to learning how to model
Check out the show notes here: https://mobileuseracquisitionshow.com/episode/how-to-use-econometric-models-to-supplement-skadnetwork-for-mobile-measurement-in-ios-14-with-brian-krebs-and-anthony-cross/

**
Get more mobile user acquisition goodies here:
http://RocketShipHQ.com
http://RocketShipHQ.com/blog
**
Check out our podcast featuring inside stories of how technology evolves and grows:
http://HowThingsGrow.co

  continue reading

251 ืคืจืงื™ื

ื›ืœ ื”ืคืจืงื™ื

×
 
Loading …

ื‘ืจื•ื›ื™ื ื”ื‘ืื™ื ืืœ Player FM!

Player FM ืกื•ืจืง ืืช ื”ืื™ื ื˜ืจื ื˜ ืขื‘ื•ืจ ืคื•ื“ืงืืกื˜ื™ื ื‘ืื™ื›ื•ืช ื’ื‘ื•ื”ื” ื‘ืฉื‘ื™ืœื›ื ื›ื“ื™ ืฉืชื”ื ื• ืžื”ื ื›ืจื’ืข. ื–ื” ื™ื™ืฉื•ื ื”ืคื•ื“ืงืืกื˜ ื”ื˜ื•ื‘ ื‘ื™ื•ืชืจ ื•ื”ื•ื ืขื•ื‘ื“ ืขืœ ืื ื“ืจื•ืื™ื“, iPhone ื•ืื™ื ื˜ืจื ื˜. ื”ื™ืจืฉืžื• ืœืกื ื›ืจื•ืŸ ืžื ื•ื™ื™ื ื‘ืžื›ืฉื™ืจื™ื ืฉื•ื ื™ื.

 

ืžื“ืจื™ืš ืขื–ืจ ืžื”ื™ืจ

ืคื•ื“ืงืืกื˜ื™ื ืžื•ื‘ื™ืœื™ื