Journal

Creative testing is not the same job as media testing

Colleagues talking in a sunlit office

We are often asked to “read the test.” The folder contains two films, three placements, and a date range in which everything changed at once. That is not a test. That is a busy fortnight.

Two questions, two periods

A creative question: did film A and film B, running in the same placement and weeks, coincide with different outcomes. A media question: did placement X and placement Y, running the same film, coincide with different outcomes. If both change, you may still have a commercial opinion. You do not have a measurement.

In a retail file from last autumn, a new outdoor line went up in the same week as a revised offer. The pack credited the boards. The offer was the first time the category had discounted in a year. We split the page, marked both changes, and refused a single winner.

How to brief us if you want a test read

Change one thing. Keep a comparison (a region, a week, a paused line). Tell us what you will do if A wins — not in theory, in the next insertion order. If there is no next action, save the fee and run the film you prefer.

A visual briefing can show a clean test. It cannot rescue a fortnight in which the brand, the price, and the media all moved and someone still wants a chart titled “winner.”