Start with the evidence
Record the baseline dates, spend, unique suitable inquiries, known completions and unresolved outcomes. Note service coverage, staffing and unusual demand conditions. Define what result would justify keeping, revising or reversing the change. A conversion action can be useful evidence, but choose a business outcome that fits the question being tested.
A worked example
Fictional test: “Clarifying the pickup area should reduce confirmed out-of-area requests.” Before the change, four of twelve classified inquiries are outside coverage; afterward, two of ten are outside. That is a descriptive improvement from 33.3% to 20%, but the small cohorts and any changed demand mix limit the conclusion. It does not prove the new wording increased profit.
Choose the next action
Change the identified message while preserving other controllable elements where practical. Log unavoidable changes such as a truck being unavailable or a holiday schedule. Decide a review date that allows enough ordinary activity for a useful comparison; there is no universal sample size for every business decision. Keep a spending and operational limit even when the result remains inconclusive.
Check whether it worked
At review, show counts, rates, costs and unknowns together. Explain what was held similar and what changed. If the data cannot distinguish the hypothesis from other explanations, say inconclusive and choose a smaller follow-up question. A useful test can reveal that the original explanation was wrong; it does not need a positive headline.
Put it to work
A record you can use
- Hypothesis and primary outcome
- Baseline and comparison dates
- Exactly what changes
- Known confounders
- Keep, revise, reverse or inconclusive with evidence
Plain text. No email required. Store completed records in your approved business systems.
Next useful step
Need help applying this to your marketing? A strategy call starts with your business and the evidence you have.
Talk through your next step →For a general editorial question, email Chris. Please leave out customer details. Questions are private, and no response time is promised.