A/B Testing Archives - Pointzi - User Onboarding for Web & Mobile Apps

Product Managers: Data-driven experiments are an excuse not to be brave

Being “data-driven” is “virtual signalling for Product Managers” and not the best method for some product decisions and roles. This snippet from a longer conversation with Patrick Collins of Zip.co digs into the suprising insight of different traits in PMs. Patrick quipped about his experience: “I’ve only been doing this product thing for 10 or →

The Truth about A/B Testing

Last Thursday 100+ people crammed into a fireside on Growth and Product.** This blog post covers the conundrum of Statistical significance in A/B experiments: 1. why the size of uplift is important 2. how much data gives me statistical significance? 3. how long you have to run an experiment (you will be shocked) 4. are →

Onboarding A/B Tests – the math by example

In the previous post I ran through why it makes sense to run onboarding experiments and measuring them under an A/B or A/A/B methodology. I stuck to the qualitative principles and didn’t get “into the weeds” of the math. However, I promised to follow up with an explanation of statistical significance for the geek minded. →

Mobile Onboarding A/B testing simply explained

In earlier posts about Google’s and Twitter’s onboarding tips we mentioned they would absolutely be measuring the impact of Tips and Tours to get the maximum uplift of user understanding and engagement. One method is just by simply looking at your analytics and checking the click-thru rate or whatever other CTA (call-to-action) outcome you desired. →