Subscribe

Archive | Tools

Starting a Growth Team from Scratch

Most high-growth companies now have Growth Teams (e.g. Facebook, Uber). These teams have enormous potential… Creating a Growth Team isn’t as easy as it sounds. You’ll find many roadblocks coming your way and going lean (generating results with small money) is the first step to actually building a standalone team. This article will walk you through the […]

When to Run Multi Armed Bandit Tests Instead of A/B/n Tests

When should you use bandit tests, and when is A/B/n testing best? Though there are some strong proponents (and opponents) of bandit testing, there are certain use cases where bandit testing may be optimal. Question is, when? First, let’s dive into bandit testing and talk a bit about the history of the N-Armed Bandit Problem. […]

How to Turn a Few A/B Tests Into a Revenue-Generating Optimization Program

Even though companies believe in data-driven approaches, many underutilize A/B testing by only running a few per year. While the occasional A/B test is a start, it’s not enough to repeatedly increase revenue and gain compounded conversion lifts. To optimize continuously, organizations must prioritize and invest in a true testing program. According to WhichTestWon, most […]

The Maths Behind Statistically Significant Sample Sizes

Although a commonly used phrase, there is no such thing as a “statistically significant sample” – it’s the result that can be statistically significant, not the sample. Word-mincing aside, for any study that requires sampling – e.g. surveys and A/B tests – making sure we have enough data to ensure confidence in results is absolutely […]

Statistical Significance: 6 things to know!

Statistical significance is all about whether the difference between two numbers is meaningful or just a fluke. In this post I’ll outline 6 things you need to know to make statistical significance for conversion rate A/B tests and broader analytics data. 1) Exactly what it means “The variation achieved a 20% increase in conversions with […]

High Tempo Testing for Success

What is High Tempo Testing? Most growth professionals understand that growth hacking isn’t about a specific tactic, but rather it’s about a process of discovering which tactics will be effective for growing your business. This discovery happens through testing potential growth drivers ranging from new channels to new sharing and engagement features deep within a […]