How Algorithms Affect Your Test and Measure Strategy (2026 Guide)
Two headlines go out. One wins. Ask most business owners how, and the honest answer is usually a gut feeling, or a dashboard nobody fully trusts. What actually decided the winner was an algorithm, quietly running statistical calculations in the background, and most businesses never look closely enough to know whether it was the right call.
In 18 years running Optimise Your Marketing from Cromford Mills in Derbyshire, I have seen more East Midlands businesses guess their way through marketing decisions than measure their way through them, usually because Test and Measure gets treated as the pillar you get to eventually, rather than the one that tells you whether the other 11 are actually working.
This post expands on a point I made in our guide to how algorithms fit into every part of the BIG12: A/B testing and attribution modelling are themselves algorithmic processes, statistical systems deciding which version wins and which channel deserves credit. Here is exactly how they work.
Not sure how your marketing measures up right now?
Take five minutes to see how your business scores across all 12 BIG12 pillars, testing and measurement included.
Take the BIG12 ScorecardA/B Testing Is an Algorithm Deciding a Winner
An A/B test is not simply "which one got more clicks." Behind the scenes, a statistical algorithm calculates confidence levels, decides whether a difference is genuinely significant or just noise, and often continues adjusting traffic allocation between versions as data comes in. Ending a test too early, before the algorithm has enough data to be confident, is one of the most common ways businesses declare a false winner and build a strategy around the wrong headline, CTA or campaign entirely.
Attribution Modelling Is an Algorithm Deciding Who Gets Credit
When a customer sees a social post, clicks a Google ad two weeks later, and converts after opening an email, an attribution algorithm decides how much credit each of those touchpoints deserves. Different models, last-click, first-click, linear, data-driven, will tell you a completely different story about which channel actually drove the sale, and choosing the wrong model can lead you to cut a channel that was quietly doing most of the work.
Every dashboard number you trust was produced by an algorithm making a judgement call about credit or significance. If you have never questioned which model it used, you have never really tested anything, you have just watched a number move. Stuart Baddiley, Optimise Your Marketing
Why Guessing Feels Like a Strategy Until You Measure
Without Test and Measure in place, you are guessing which algorithm signals you are winning or losing on across every other pillar in the BIG12. A gut feeling that a campaign is working can persist for months, quietly costing budget, simply because nobody built a proper system to confirm or challenge it with actual data.
When a Derbyshire retailer discovered its "best" channel was not the real winner
A retail client across the East Midlands had been crediting most of their sales to their final email nudge, based on a last-click attribution model. Once we implemented a data-driven attribution model, it became clear a specific social campaign was doing the real work of first introducing customers weeks earlier. Reallocating budget toward that campaign increased overall conversions by 28% within two months.
See how we approach Test and MeasureHow This Connects to the BIG12 Framework
Test and Measure is the pillar that tells you whether the other 11 are genuinely working, and it draws directly on data flowing through CRM, our related guide to how algorithms affect your CRM covers where a lot of that data originates. Derbyshire businesses who treat measurement as optional are making every other decision in the BIG12 with one eye closed. We cover this properly in our online marketing training, and in our wider guide to where algorithms fit into every part of the BIG12.
See where algorithms are costing you clarity
Benchmark your marketing against all 12 BIG12 pillars in one free scorecard.
Take the BIG12 ScorecardThe challenge is never learning. It is doing.
Knowing that attribution models can tell wildly different stories is the easy part. Actually setting up proper testing discipline, choosing the right attribution model for your business, and trusting the data enough to reallocate budget based on it, is where most Derbyshire and East Midlands business owners run out of time.
That is the gap we close. In 18 years of applying the BIG12 for UK SMBs, the businesses making consistently better decisions are never the ones with the strongest gut instinct, they are the ones who built a proper measurement system and actually trust what it tells them.
If you have never questioned which attribution model your reporting relies on, it is worth finding out what it might be hiding.
Book a free 90-minute audit with Stuart
We will look at your current marketing, benchmark it against the BIG12, and give you a practical set of actions to take. No sales pitch. No fluff. Just 18 years of honest advice applied to your business.
Book your free audit