Failed Test? Try An Ethnographic Study

Most marketers run various tests to before making decisions on new products, packaging, media mix, media levels, creative messaging, etc. Testing is good, but we must also remember that you can’t test everything. How many great product ideas have been stripped of originality by testing or have come out years too late to take advantage of the marketplace? New product development can take three years at large corporations. We must also be cautious about the types of research we use and its limitations.

Ingrid Fetell from Landor says that too often marketers treat focus groups as a quick-and-dirty solution to every knowledge they need. But focus groups have their limitations. After all 80% of new products fail within six months, but almost all pass through focus groups on their way to market. The Seinfeld pilot failed in the eyes of focus groups that said it needed a stronger supporting cast. Focus groups have also rejected the Sony Walkman, Baileys Irish Cream, and the ATM, which was considered “too impersonal.” But some scholars like Harvard Business School professor Gerald Zaltman see ethnographic techniques as having a more accurate ability to gauge consumer opinion given the unconscious nature of the decision-making.

What’s a real life example? Cambridge SoundWorks’ used ethnographic research to determine why sales of its new speakers were slow despite enthusiasm from male prospects. The retailer sent researchers out with video cameras to follow prospective customers for two weeks and they discovered the “spousal acceptance factor.” Men were being talked out of their purchase by girlfriends and wives who thought the speakers were ugly – an insight men didn’t offer up in a traditional focus group. They offered a new range of sneakers with a new look and they became the best-selling product line in the company’s history.

Are you using focus groups because they are quicker and cheaper than quantitative studies? Maybe its time you try an ethnographic study.

Creativity Beats Media In TV ROI

If you merely glanced over a recent article in Advertising Age you may have thought it was about media buying. The first sentence of the article tells us Demographics have almost no effect on whether TV ads produce sales, and consumers’ purchase history is the most reliable predictor of success. Okay I say, but how do I buy TV media based on purchase history?

The article goes on to tell us that ads produce a greater sales lift the closer they come to the purchase decision. Again, can I buy TV ad slots based on my target’s purchase decisions? We do learn however that we shouldn’t shy away prime time placement and higher prices because in general prime time’s sales return on media investment trumps other day parts. That is something we can use – keep buying prime time.

But you may have read this entire article except for the last sentence and missed the most important conclusion highlighted by TRA President Bill Harvey at the Advertising Research Foundation 360 Measurement Day Workshop in Chicago. His company has been pairing data from set-top TV boxes with retail loyalty-card purchase data since 2008.

There are limits to what media choices alone can accomplish. The ads themselves matter most. Mr. Harvey said, “Data suggests 65% of TV ROI is attributable to the creative and 35% to the media.” Now that is something I can control. The worst mistake of all is to spend all your time nitpicking media choices and neglecting to invest in choosing great creative.

Why this lopsided emphasis? Maybe because it was a media workshop and not a creative conference.