A/B Testing Archives - Pointzi - Guides, Onboarding & Growth for Web & Mobile Apps

Apr 7

Product Managers: Data-driven experiments are an excuse not to be brave
David Jones Posted In: A/B Testing, Design, Product Managers

Being “data-driven” is “virtual signalling for Product Managers” and not the best method for some product decisions and roles. This snippet from a longer conversation with Patrick Collins of Zip.co digs into the suprising insight of different traits in PMs. Patrick quipped about his experience: “I’ve only been doing this product thing for 10 or →

Mar 2

The Truth about A/B Testing
David Jones Posted In: A/B Experiments, A/B Testing, statistical significance, tutorial

Last Thursday 100+ people crammed into a fireside on Growth and Product.** This blog post covers the conundrum of Statistical significance in A/B experiments: 1. why the size of uplift is important 2. how much data gives me statistical significance? 3. how long you have to run an experiment (you will be shocked) 4. are →

May 23

Onboarding A/B Tests – the math by example
David Jones Posted In: A/B Experiments, A/B Testing, Onboarding, statistical significance

In the previous post I ran through why it makes sense to run onboarding experiments and measuring them under an A/B or A/A/B methodology. I stuck to the qualitative principles and didn’t get “into the weeds” of the math. However, I promised to follow up with an explanation of statistical significance for the geek minded. →

Apr 26

Mobile Onboarding A/B testing simply explained
David Jones Posted In: A/B Experiments, A/B Testing, automation, Multivariate, Onboarding

In earlier posts about Google’s and Twitter’s onboarding tips we mentioned they would absolutely be measuring the impact of Tips and Tours to get the maximum uplift of user understanding and engagement. One method is just by simply looking at your analytics and checking the click-thru rate or whatever other CTA (call-to-action) outcome you desired. →

    Want to get blog updates?