Category: CRO & experimentation

  • How to run 3–4 growth experiments a week without chaos

    Journal
    Journal

    How to run 3–4 growth experiments a week without chaos

    High test velocity drives faster growth — but only with structure. Here’s how to run multiple experiments a week without descending into chaos or false positives.

    A marketer running tests on a laptop

    Velocity is the point — but only with structure

    The rate at which you learn is set by the rate at which you test. That’s why high-performing growth teams run several experiments a week, not a few a quarter. But velocity without structure is just chaos — half-finished tests, contaminated reads, and a team that’s busy without learning. The trick is a system that makes high velocity safe. We’ve run roughly three to four experiments a week inside a demanding growth environment; here’s how it stays disciplined. [APPROVAL NEEDED]

    The operating rhythm

    • A single prioritised backlog. Every idea enters one ranked queue, scored the same way, so the team always knows what’s next and why. (See prioritising experiments.)
    • A weekly cadence. A short weekly meeting to review last week’s results, promote or kill tests, and launch the next batch. The cadence is what turns individual tests into a rhythm.
    • Standardised test design. A one-page template per experiment — hypothesis, metric, decision rule, sample needed — so setup is fast and every test is comparable.
    • Clear ownership. Each experiment has an owner accountable for running it cleanly and recording the result.

    Avoiding the chaos traps

    Running many tests at once creates specific risks: overlapping tests that contaminate each other’s reads, insufficient volume per test, and results called too early. Manage them by isolating tests that would interfere, only running what you can power adequately, and holding firm on decision rules set in advance. Velocity is not an excuse to lower the evidence bar — it’s a reason to raise it.

    Where AI helps (and where it doesn’t)

    AI-assisted workflows genuinely raise velocity on the production side — generating creative variants, drafting copy, summarising results — which is why we’ve been able to compress turnaround times significantly. [APPROVAL NEEDED] But AI doesn’t replace the hypothesis or the read; more output without discipline just produces more noise faster. Use it to accelerate the parts that are safe to accelerate.

    Document or it didn’t happen

    The output of a high-velocity programme isn’t the individual wins — it’s the accumulating library of what works. If a result isn’t documented as a reusable insight, the velocity is wasted. The discipline of recording every learning is what makes the rhythm compound.

    Frequently asked questions

    Do we need a big team to run several tests a week?

    No — you need structure (one backlog, a weekly cadence, standardised design). A small, disciplined team out-tests a large, chaotic one.

    How do we avoid tests interfering with each other?

    Isolate experiments that would contaminate each other’s reads, and only run what you can power adequately.

    Won’t more tests mean more false positives?

    Only if you lower the bar. Higher velocity demands stricter, pre-set decision rules — not looser ones.

    Want to raise your test velocity without losing rigour? A Growth Diagnostic assesses your experimentation setup. Request a Growth Diagnostic →

  • Landing-page CRO: the changes that actually lift conversion

    Journal
    Journal

    Landing-page CRO: the changes that actually lift conversion

    Not button colours. The landing-page changes that genuinely lift conversion — message match, clarity, friction, proof and speed — from a senior growth operator.

    A landing page being optimised on screen

    The highest-leverage page you’re probably neglecting

    You pay to get people to your landing page, then lose most of them there. Which makes landing-page conversion one of the highest-leverage numbers in your whole growth system — every point of improvement lowers CAC directly and compounds with everything upstream. Yet most “CRO” fixates on trivia (button colours, minor copy tweaks) while ignoring the changes that actually move the number. Here are the ones that do.

    1. Message match

    The single biggest lever: the page must deliver on the promise of the ad or link that brought the visitor. A mismatch between the ad’s message and the page’s headline breaks trust in seconds and tanks conversion. If you run different campaigns, you often need different pages — not one generic page for all traffic.

    2. Clarity over cleverness

    Within seconds, the page must answer: what is this, who is it for, and what do I do next? Clever, abstract headlines lose to clear, specific ones. State the outcome the visitor wants, plainly, above the fold.

    3. Remove friction

    Every unnecessary form field, extra step, or moment of confusion costs conversions. Ask for the minimum you need (you can qualify further later), make the next action obvious, and remove anything that makes the visitor think or hesitate.

    4. Proof where the doubt is

    Place credibility — testimonials, results, recognisable logos, specifics — exactly where a visitor would hesitate. Proof next to the call to action reassures at the moment of decision. (Which is why real testimonials and case studies are worth gathering.)

    5. Speed and mobile

    A slow page or a broken mobile experience silently kills conversion before any of the above matters. Page speed and mobile usability are conversion features, not just technical hygiene — especially for paid traffic, much of which is mobile.

    Test, don’t guess

    Every one of these is a hypothesis to test, not a rule to apply blindly — what wins for your audience is an empirical question. Run the changes through a structured experimentation programme (see the pillar) and keep what your data proves, tied to a trustworthy measurement stack so you’re optimising to real conversions, not vanity clicks.

    Frequently asked questions

    What’s the single biggest landing-page lever?

    Message match — the page delivering on the promise of the ad that brought the visitor. Mismatch destroys conversion fastest.

    Do button colours matter?

    Marginally. Message, clarity, friction, proof and speed move conversion far more than cosmetic tweaks.

    Should each campaign have its own page?

    Often yes — message match usually means tailored pages beat one generic page for all traffic.

    Losing paid traffic at the landing page? A Growth Diagnostic finds where and why. Request a Growth Diagnostic →

  • Prioritising experiments: a simple scoring model

    Journal
    Journal

    Prioritising experiments: a simple scoring model

    A backlog of 50 ideas and no way to choose is why experimentation stalls. A simple impact-effort-confidence scoring model to prioritise the tests that matter.

    A team prioritising a test backlog at a whiteboard

    The real bottleneck isn’t ideas — it’s choosing

    Most growth teams have no shortage of experiment ideas. What they lack is a way to choose between them, so they default to whatever’s loudest, easiest, or most recent. That’s how programmes stall: effort scatters across low-impact tests while the high-impact ones wait. A simple, shared scoring model fixes this — not because the maths is precise, but because it forces an honest, comparable conversation about what to run next.

    A simple scoring model

    Score each idea on three dimensions, each 1–10:

    • Impact — if this works, how much does it move the metric that matters right now?
    • Confidence — how sure are we it’ll work, based on evidence, precedent or logic?
    • Ease — how quick and cheap is it to run?

    Combine them (a simple average or product) into one score, and rank the backlog. Ideas with high impact, reasonable confidence and low effort rise to the top; pet projects with low scores stay honest at the bottom.

    Why it works even though it’s rough

    The scores are estimates, not truth — and that’s fine. The value isn’t precision; it’s that scoring forces the team to articulate why an idea matters, exposes low-value pet projects, and creates a shared, defensible order. It turns “what should we test?” from an argument into a ranked queue. Tie the scoring to your current growth constraint so “impact” always means impact on the thing that matters this quarter.

    Keep it lightweight

    The model earns its keep only if it’s fast. A shared sheet, three quick scores per idea, re-ranked weekly, is enough. Don’t turn prioritisation into a project — the goal is to decide quickly and get back to testing. (This feeds directly into running 3–4 experiments a week.)

    Frequently asked questions

    Isn’t scoring subjective?

    Yes — deliberately. The point is a shared, comparable conversation, not false precision. Rough scores beat loudest-voice prioritisation.

    Which framework — ICE, PIE, RICE?

    Any consistent one works. Impact/Confidence/Ease is the simplest; use what your team will actually maintain.

    How often should we re-score?

    Weekly, lightly — as results come in, confidence and impact estimates change, so the ranking should too.

    Backlog full, direction unclear? A Growth Diagnostic helps you prioritise what to test first. Request a Growth Diagnostic →

  • Building an experimentation programme that compounds

    Journal
    Journal

    Building an experimentation programme that compounds

    One-off tests give one-off wins. A structured experimentation programme builds a compounding advantage.

    Every team runs the occasional test. Few run a programme — a disciplined rhythm where every experiment is prioritised, measured honestly, and documented. One-off tests evaporate; a programme compounds.

    The four elements

    A prioritised backlog; a consistent test method (hypothesis, sizing, decision rule set in advance); velocity (the rate of learning is set by the rate of testing); and a documented learning library.

    Experiment across the whole funnel

    Not just landing pages — acquisition, conversion and retention. The biggest wins often sit in the offer, the audience or the onboarding.

    Measure honestly, or don’t bother

    False positives destroy programmes. Set the decision rule before the test, give it enough volume, and only scale what the evidence proves.