Archive by Author

Sample Pollution: The A/B Testing Problem No One is Talking About

Here’s an uncomfortable truth about conversion rate optimization: lots of people are running bad tests without even knowing it. They’re making decisions based on false positives, they’re acting on inconsistent data, they’re avoiding the issue of sample pollution – I could go on. “If you don’t know about sample pollution, stop testing.” The first step […]

Why Sampling Your Analytics Data is Bad

It’s long been the case that the costs associated with using high-quality analytics services force companies into tradeoffs of picking which events or users to track, with sampled data being the most common fate that people resign to. Unfortunately, sampling can be very harmful, leading to a slew of problems including inaccurate test results and a […]

When to Run Multi Armed Bandit Tests Instead of A/B/n Tests

When should you use bandit tests, and when is A/B/n testing best? Though there are some strong proponents (and opponents) of bandit testing, there are certain use cases where bandit testing may be optimal. Question is, when? First, let’s dive into bandit testing and talk a bit about the history of the N-Armed Bandit Problem. […]

Conversion Optimization Tips For Low Traffic Sites

At its core conversion optimization is the idea of testing out different versions of your pages, different copy, different visuals, etc. to make the pages get as much conversion as possible. “I have too little traffic to test; hence, I can’t do conversion optimization.” However, to conduct a scientific test, you need enough visitors to […]

How digital marketing can transform business

Marketing operations is certainly not the sexiest part of marketing, but it is becoming the most important one. With businesses unable to keep pace with evolving consumer behavior and the marketing landscape, the pressure is on to put marketing operations—skilled people, efficient processes, and supportive technology—in a position to enable brands to not just connect […]

How to Turn a Few A/B Tests Into a Revenue-Generating Optimization Program

Even though companies believe in data-driven approaches, many underutilize A/B testing by only running a few per year. While the occasional A/B test is a start, it’s not enough to repeatedly increase revenue and gain compounded conversion lifts. To optimize continuously, organizations must prioritize and invest in a true testing program. According to WhichTestWon, most […]