What should we be measuring in brand tracking studies?

…In a nutshell, what brands do you buy and why?


Byron Sharpe et al have fairly convincingly proved that the key health metric of a brand is its total universe of users.

The awareness of the brand, the loyalty of the users of the brand and how much they like the brand are all rather academic constructs as all these measures highly correlate with each other and ultimately with the brand’s universe of users. All can be modeled using a Dirichlet distribution model.

The proportion of people who are brand-aware can be modeled from the proportion that are spontaneously aware of that brand. With X number of total users there will be Y number of loyalists and Z number of people who love and recommend the brand. If users drop, liking, awareness and loyalty levels will drop all in parallel. If you asking about liking of brand you will find we all like the brands we use at pretty equal levels.

To illustrate the point, here is an example of data taken from a quite typical brand tracking study where the statistical correlation between brands purchased in the last 12 months and all the other core metrics measured in the brand tracking study has been calculated. The correlation for nearly every metric is above 0.85 and some metrics in the high 0.9’s.


So you could argue that the only brand equity question really worth asking in a brand tracking survey is: “Which of these brands do you use?”



Understanding why people buy brands


What is worth asking question in a brand tracking survey is why people choose brands. This is something that will potentially vary by brand and category and cannot be modelled using a Dirichlet distribution model. This is where the drivers of market movements can be divined.

To measure this it is vitally important that you don’t prompt the respondents for their answers. If you do, these questions will themselves become a proxy measure for brand usage as well.

If you present respondents with a list of brands and an attribute as so many brand trackers tend to do, as it so much easier to associate a brand attribute with the brands you know best than the brands you don’t know, so the brands that get selected the most for each attribute will simply be those brands with the most users. To illustrate this point below is the correlation between purchased in last 12 months and brand attribution for each brand from the same brand tracking survey above and you can see again that it highly correlates.



Below is another example that really helps visualize this issue, it shows the the prompted brand attributes of different telecom services. They correlate on average at c0.85 with brand usage data. 

 

The second reason for not using a promoted brand attribute list is that these lists rarely adequately cover all the diversity of reasons why people actually choose individual brands in individual categories. They are all too often simply generic lists of factors that have little or no relevance to the category. The above example really speaks for itself - ask yourself - do you really make a decision on your choice of telecom provider because it “expresses your personality”? This factor is tenuous at best. 


Below are the results of an experiment where we asked people the reasons for purchasing shampoo. We compared their responses to the prompted attribute responses to an open ended question where over 60 distinct factors were given. We discovered that fewer than half the reasons for purchase were covered off in the closed questions.

The third reason for not using a prompted list process is that is does not tell you anything about the relative strength of different factors. If I ask you if price is important when making a purchase, most people will say yes, but that does not tell you anything about how significant price actually is.

To mine reasons for purchase effectively the exercise needs to be done in way that does not anchor responses, and allows the respondent the freedom to express the actual reasons rather than putting thoughts into their heads. We believe the best way to do this is by asking this question in a more spontaneous open ended format linked to the produce usage question. Asking simply why they chose the brand provides produces a much more varied list of responses by brand.




Using fairly basic text analytics techniques can deliver quant level metrics like the example below, demonstrating the influence and scale of each factor similar to a promoted process. The key difference is that you get far greater differentiation of opinions by brand.

See the example below where the same brand metrics were measured using closed v an open ended approach. You start to see the personality of the brands emerging far more strongly with the open ended question.



Using closed questions all four of these brands are seen as delivering pretty similar levels of cleaning power and gentleness, product strength and feeling. But when you examine the open ended data you see each brand’s unique personality emerging. The perceived cleaning power of Ariel, the gentleness of Fairy for example.


By conducting a detailed analysis of reasons for purchase we were able to show far more than a simple identification and quantification of the primary drivers of purchase. We were able to compare how significant each driver was for each brand. For example below, how often price is mentioned in association with these different shampoo brands varies enormously.


This comparative reason for purchase feedback can also be used to understand the niche issues and micro market movements that you would never normally be produced from a brand tracking survey.

Take the example below of a question we have added to a shampoo tracker for two years running where we asked people to think about the reason why they chose and switched shampoos. In Year 1 we observed 0 mentions of the term Parabins. A year later there were 5 mentions, a tiny number admittedly, but when we examined google search data it was clear that use of Parabins in some shampoos was an emerging and growing issue which was potentially important for marketeers to be aware of.


From this same tracker we were able to pick up movements on several micro factors of potential interest: UV sun protection (three mentions in Year 1 up to eight in Year 2), caffeine (eight mentions up to 12), ‘2 in 1’ (down from 14 to five), general mentions of “chemicals” (up from 15 to 30). None of these issues would be picked up in a traditional tracker but all are potentially useful insights.

In conclusion, with this approach you not only get a handle on the headline issue but also some of the emerging stories underneath.

What can researchers learn from film script writers?

If you study the art of film making, it will tell you that a good film script is based around one great question, that grabs your attention from the off and then the story naturally emerges from this and slowly reveals the answer. The question drives the whole story.

Here are some examples:
  • What if every day was the same? GROUNDHOG DAY 
  • What if a nun was made to be a nanny? THE SOUND OF MUSIC
  • What if a really smart innocent person went to prison? SHAWSHANK REDEPMPTION
  • What if dreams & reality were inter-changeable? MATRIX
  • What if there's more to life than being ridiculously good looking? ZOOLANDER
All the books also emphasise how important good narrative structure is to making a great film i.e. films that people want to watch and concentrate on watching from start to finish. Films construct heroes through which the story is told, and these stories needs to adhere to a strict story structure. There are about 7 of these basic story structures, established from a time well before the dawn of film making, in fact the basic structure of storytelling has hardly changed much for thousands of years.



Building a survey around a great question


I believe a good survey can be built around one great question in the same way and that the key to designing a great survey is then adhering to a strict narrative structure: where you place the respondent in the role of the hero; and the questions in the survey help the respondent to slowly reveal the answers to this central question by telling their own story.

Here are a couple of examples of a simple question that you could build a survey around:

“What is the secret of a really good shampoo?”

From the off, you immediately know the purpose of the survey and you can imagine taking participants on a journey through a series of questions that mine their viewpoint on this topic. You can tie all the questions into this e.g. first of all we would like to establish which brands you have had experience of using, what do you think about these different brands, which are the best in your mind and why? If you were going to sum up what you are looking for in a perfect shampoo what features would it have….etc.

“In a life of hair washing what have you learnt?”

Again this question has an in-built story structure, you might ask people from the outset to think about all the different types of shampoo they have experience of using in the past and what they thought of them, and what brands they have built some affinity with. You could then get them to think about their experiences of good and bad hair days as a result of using certain types of shampoo etc.

It’s interesting how once a good central question is established, the rest of the questions you ask can flow out of this easily and fluidly. Have a go next time you are planning a survey and you will see!

Narrative structure: the key to good surveys


Essentially what you are doing is building a story and like film making it’s important this story adhere to a strict structure. What kills so many survey experiences I believe, is being asked a whole load of questions in no particular order. In the same way as you might walk out of a film if it was just made up of a series of unrelated series of visuals and dialog, if they don’t understand where the survey is going, people get frustrated and are more likely to drop out or not pay attention to the question. A survey is a journey and the respondents need to know where they are going, otherwise they could be like kids in the back of the car asking “are we nearly there yet” every 5 minutes.

Ready-made narratives


Like in story telling where they have mapped out the 7 common plot structure, If you are struggling to think up your own survey narrative there are a number of ready made well established ones you can beg borrow or steal. Here are a couple of examples.

The trial narrative


The “trial” narrative is one we have repeatedly used very successfully. Putting a product or service on trial has an in built narrative structure. You have first the case for the prosecution; what is wrong with a product or service, what are you frustrated by. Then you have the case for the defence; what has the product or service done well. Then you have the jury process where respondents evaluate the pros and cons of a products’ strengths and weaknesses and finally a verdict where respondents are asked to give their final rating. We have used and adapted this idea in a number of ways, across a range of different consumer surveys.



The build a new future narrative


This is another one we have used in different guises. You start out by asking “What are the strengths and weaknesses of current products/service/situation” i.e. what is your life like right now, you then ask “what do you want in a perfect world” you then can explore living in the real world with practical constraints get them to explore trade off solutions. Once drawn into this process you can then challenge participants to design their own version of these product or services with or without any practical constraints and then ask them to cross evaluate each others ideas.


The journey narrative


People can very simply grasp the idea of a journey. So you can use this idea to help guide people though a whole range of survey processes. You basically tell people at the beginning of the survey where they are starting from and where they will end up.



Making the respondent the hero of their own story


This can be a tremendously powerful conceptual construct to really draw out more thoughtful feedback from respondents. They need to feel that what they are doing is important, has meaning and that you care about what they have to say. What you have to allow them to do is tell their story and give them room to do this by asking questions that place them in control. Rather like in a film you let them enter an imaginary world where you set them challenges to overcome. Like this example below.

Want to learn more?


If you are interested in learning more about how to apply narrative structure to your surveys, I recommend you start out by reading a book that was originally recommended to me by a good friend of mine who is a lecture in film editing. Discussing some of these ideas with him, he told me I must read “The writer’s journey” by Christopher Vogel who is one of Hollywood's most successful script editors. It’s a book that explains in detail the strict narrative structure of films and much of the thinking in this book can be directly applied to survey copy writing. I thoroughly recommend you read this book yourself as the start of a journey to improve you own surveys.


Kategori

Kategori