Archive | MVT

Starting a Growth Team from Scratch

Most high-growth companies now have Growth Teams (e.g. Facebook, Uber). These teams have enormous potential… Creating a Growth Team isn’t as easy as it sounds. You’ll find many roadblocks coming your way and going lean (generating results with small money) is the first step to actually building a standalone team. This article will walk you through the […]

Reach A/B test significance faster with this little known optimization hack!

What if I told you you could run tests up to 2x faster using a standard optimization feature hardly anyone uses? The concept is really not that difficult, but so many people get it wrong that it easily costs marketers and product owners millions of dollars a year in lost revenue. I’ve made the mistake myself, […]

When to Run Multi Armed Bandit Tests Instead of A/B/n Tests

When should you use bandit tests, and when is A/B/n testing best? Though there are some strong proponents (and opponents) of bandit testing, there are certain use cases where bandit testing may be optimal. Question is, when? First, let’s dive into bandit testing and talk a bit about the history of the N-Armed Bandit Problem. […]

Conversion Optimization Tips For Low Traffic Sites

At its core conversion optimization is the idea of testing out different versions of your pages, different copy, different visuals, etc. to make the pages get as much conversion as possible. “I have too little traffic to test; hence, I can’t do conversion optimization.” However, to conduct a scientific test, you need enough visitors to […]

How to Turn a Few A/B Tests Into a Revenue-Generating Optimization Program

Even though companies believe in data-driven approaches, many underutilize A/B testing by only running a few per year. While the occasional A/B test is a start, it’s not enough to repeatedly increase revenue and gain compounded conversion lifts. To optimize continuously, organizations must prioritize and invest in a true testing program. According to WhichTestWon, most […]

How Long to Run A/B Tests: the Known and Unknown

Although split testing has become an essential part of any sound digital strategy, many people have misconceptions about the process — especially the amount of time needed to get results.  When relying solely on anecdotes from others, one can easily over- or under-estimate the time needed to reach a statistically sound conclusion. In this post, […]