Subscribe

Archive | Analytics

When to Run Multi Armed Bandit Tests Instead of A/B/n Tests

When should you use bandit tests, and when is A/B/n testing best? Though there are some strong proponents (and opponents) of bandit testing, there are certain use cases where bandit testing may be optimal. Question is, when? First, let’s dive into bandit testing and talk a bit about the history of the N-Armed Bandit Problem. […]

How digital marketing can transform business

Marketing operations is certainly not the sexiest part of marketing, but it is becoming the most important one. With businesses unable to keep pace with evolving consumer behavior and the marketing landscape, the pressure is on to put marketing operations—skilled people, efficient processes, and supportive technology—in a position to enable brands to not just connect […]

SENTIMENT ANALYSIS: WHY IT’S NEVER 100% ACCURATE

If you’ve ever used a social listening or social monitoring tool to analyse sentiment, then you’re familiar with the inaccuracies that afflict all of these tools – from incorrect tagging to skewed sentiment percentages. Why does that happen? The first problem is that some sentences aren’t easy to analyse. In fact, sentences aren’t positive or […]

Algorithmic Personalization

Personalization algorithms influence what you’ve chosen yesterday, what you choose today and what you’ll be choosing tomorrow. Simultaneously, there seems to be something wrong with personalization. We are continuously bumping into obtrusive, uninteresting ads. Our digital personal assistant isn’t all that personal. We’ve lost friends to the algorithmic abyss of the News feed. The content we encounter […]

The Maths Behind Statistically Significant Sample Sizes

Although a commonly used phrase, there is no such thing as a “statistically significant sample” – it’s the result that can be statistically significant, not the sample. Word-mincing aside, for any study that requires sampling – e.g. surveys and A/B tests – making sure we have enough data to ensure confidence in results is absolutely […]

Statistical Significance: 6 things to know!

Statistical significance is all about whether the difference between two numbers is meaningful or just a fluke. In this post I’ll outline 6 things you need to know to make statistical significance for conversion rate A/B tests and broader analytics data. 1) Exactly what it means “The variation achieved a 20% increase in conversions with […]