Numbers and Stories

Devangshu Dutta

November 23, 2009

Just after noon, on a weekday, I bumped into a family acquaintance at one of the more successful shopping malls in the city.

The question, “What are you doing here?” was underlined by a mildly accusatory look and the subtext, “Why are you spending a week-day shopping?”

My response that I was “working” wasn’t enough; the further explanation that I was doing “research” received a dismissive smirk and ended the conversation. The fact is that I was repeating the time-honoured ritual of RBWA (research by walking around), with its seemingly aimless strolling, sidelong glances, and possibly turning over a hundred items in a dozen shops without reaching for the wallet even once. This is a ritual that is not taught in our temples of management learning. In fact, it is one of the many tens of methodologies that seem to be missed out during the course of our formal education. And very often, what we do get taught is so remote and opaque to most people that they will promptly forget it the moment they walk out of the examination hall.

I was reminded of this walk-about incident during a conversation with two members of the faculty of a professional institute on the subject of research. Most of their students, I had observed, had a narrow interpretation of research – focussed only on consumers being interrogated through a questionnaire. The students were working from the guidance they had received during the previous semesters at the institute.

Unfortunately, the students are not alone – this is also how too many people identify research, including many executives in decision-making positions. I have been frequently puzzled by the confident (brash?) statement I have heard many times: “We don’t need research.” It is only when I probe further do I, and they, discover that while they perhaps don’t need consumer surveys, there are large gaps in their decision making toolkit which can only be filled by inputs from various other kinds of research.

Sometimes the roots of that statement lie in the perception of research as an impenetrable jungle in which it is easy to get lost but difficult to find something immediately useful. Researchers, like all other vocations, have their own professional shorthand (also known as “jargon”) which they sometimes use to identify their own kind, and perhaps sometimes to exclude people who are not from the trade. Very often this jungle is created by “research-as-a-foreign-language”, which many executives are just too apprehensive or too busy to tackle.

But before you pick up the axe and start cutting away at the creepers of bi-variate analysis, quota samples, correlation and projective techniques, let me give you my very simple definition of research which I like to keep in mind when I am asked the question: “Do we need research?”

To me, research is the discovery and collation of diverse pieces of information from various sources, so that it can be analysed using multiple tools, to discover relationships, patterns and directions that can be used to draw conclusions and take decisions.

There is a purpose for which we would discover or collate that information. There may be a set of questions that we need to answer. We need to understand what are the various places where that information may lie, the different forms it might take or the different ways in which we might need to look at the information before anything useful emerges.

And, in the business context (as in many other situations), research is meant to come up with something that is applicable and directly beneficial to the business. So once we’ve got most of the answers we were looking for, it is certainly useful to stop and apply the newly gained knowledge rather than try to refine and perfect it to the infinite degree.

If this definition of research frames the context well enough for you, then you’re on the way to doing and using research well.

Despite the wealth of information available today, far too many bad business decisions are being made in the absence of good information, either because the executives have not bothered to carry out research, or have not had the capability or the time to question the research which is being presented to them.

Worse – perhaps because of the abundant data and the ease of access to it – today many business decisions that turn bad are taken on the basis of information that is presented by someone else (“secondary research” in research language), without questioning the validity of the conclusions, the structure of the study, the context in which the data was analysed. It’s almost as if we couldn’t be bothered to think, because someone has apparently already done the thinking for us – especially if it comes from a “reputable source”. (Ok, that might be smart sometimes. So let me give you a more graphic analogy – could you think of an adult bird regurgitating pre-digested food to feed the chicks? Hmm, not so pleasant an image after all, is it?)

Also, research (especially the number-oriented kind) seems too dry for most people to take in. And I think that is one place market researchers could do themselves a huge benefit if they could tell the story – especially a story with a moral at the end. That is, create the picture for the user as to what all of that information means in simple language, and also show the user how to use the information in the context of his situation or problem. Bedtime stories during childhood and good movies in adulthood work well because there is a coherent narrative, a start, a middle that is interesting and an ending that stays in the mind. You can see the relationships between the characters, and the consequences of those relationships. A good research project report could be seen as something very similar.

Having said that, of course, there are also some researchers go far beyond, who would never let boring facts get in the way of a good story! Apparently a letter to the editor of the National Observer (London) as far back as 1891 complained: “there are three kinds of falsehood: the first is a ‘fib,’ the second is a downright lie, and the third and most aggravated is statistics.” (Mark Twain famously paraphrased this in his autobiography as “lies, damned lies and statistics”.)

How many stores can you think of which are located at sites where their chances of success are exactly the same as that of a snowball in hell? How many products or brand launches come to mind, where you wondered, “what is this company thinking?!” Of course, there would have been pre-launch studies which would have showed just how successful these would be, where the stories were possibly based more on imagination than on facts.

For a decision-maker, the only way to tell the difference between bad statistics (lies) and the true story of the market is to make sure that he or she is equipped with multiple sources of information, and various tools with which to analyse them. Also, if you recall my earlier definition of research, the starting point was the definition of the objectives which a research is supposed to fulfil – if the objectives are vague or undefined, so will the research outputs be.

Numbers (quantitative research) and narrative (qualitative research) can tell us many wonderful stories about the market. Some of those stories are highly imaginative “fairy tales” because of a bad study – that shouldn’t lead us to ignore all the others which can direct us to our objectives.

Organic Truth – Facts and Interpretations

Devangshu Dutta

August 18, 2009

Four months ago in this column (“Organic – Hope or Hype?”) I wrote about the need for customers to make themselves aware of the true nature of organic products, and it is time to reopen that discussion.

Food is an emotive subject with us as consumers, food distribution and retail is big business with us as the trade, and agriculture is a sensitive area of governance.

On top of that, studies are seldom exhaustive enough in terms of sampling, duration of the study, establishment of controls etc., and for every study that proves the superiority of organics, you will be able to find counter-studies and opposing arguments.

In recent years brands have tended to make much of their organic certification. Marketers are known for overstatement anyway, and the promotional language used by some implies (or even explicitly states) that these products are superior to other alternatives. Surely, then, the consumer should be willing to pay higher prices for these “better” products?

If only, if only, facts were that straightforward.

In the earlier column I’d written: “We expect organic products to contain more nutrition and be better for our bodies. While this may be true of organic animal products compared to their inorganic counterparts, it has not been demonstrated for plant products, other than anecdotal experience of taste and appearance.” I had also raised the question: if organic foods are no better nutritionally than inorganic and could be as productive for the farmer, are many of the organic brands just skimming the gullible customer while the going is good?

Well, the debate just got messier. Recently a study sponsored by Britain’s Food Standards Agency last month (July 2009) really set the cat among the pigeons. The report was based on review of existing research papers to find out if organic products were nutritionally superior to inorganic products. And their conclusion was that the studies reviewed did not provide enough evidence that organic food is more nutritious.

Well, what the report really said was that on the basis of the limited number of studies that were deemed to be rigorous enough, there was not enough evidence to prove that organic food is more nutritious.

Okay.

Imagine an examiner saying that he does not have enough evidence to prove that a student who has passed did not cheat. Notice, he is not saying that the student actually cheated. But wouldn’t this statement alone raise suspicion in your mind about the student’s integrity?

Unfortunately, newspapers and electronic media sell headlines, and headlines need to be short and snappy. Here are a couple of examples about this study.

  • Organic ‘has no health benefits’ (BBC)
  • The benefits of “bio” in question (Le Figaro)

These clearly raise questions about any benefit at all from organics.

In the noise, the disclaimers by the team that prepared the report seem to have been ignored. For instance, this one: “It should be noted that this conclusion relates to the evidence base currently available on the nutrient content of foodstuffs, which contains limitations in the design and in the comparability of studies.” The report also states: “This review does not address contaminant content (such as herbicide, pesticide and fungicide residues) of organically and conventionally produced foodstuffs, or the environmental impacts of organic and conventional agricultural practices.”

Like any good research report, it admits that “it is important to recognise the potential limitations of the review process”. And the final line in the Conclusion section of the detailed report says: “Examination of this scattered evidence indicates a need for further high-quality research in this field.”

As a reader or TV viewer, how many of us would be motivated to go to the original source and read these disclaimers as well?

Promoters of organic farming, such as Britain’s Soil Association, of course, have trashed the study saying that it is too narrow having excluded most of the available research papers since they did not meet the review standards, and that it ignored the biggest long-term health impact – that of pesticides and other chemicals used in inorganic produce.

Their opponents, in turn have trashed defendants of organic farming by calling them unscientific and narrow-minded in their own right. They point out that high-output inorganic farming is far more useful to serving the exploding human population, than low-intensity organic farming.

One of the readers of the British newspaper Daily Mail was emphatic that she didn’t “eat organic stuff to get extra nutrition”, but was “happy to pay more to be free from additives”. Certainly that is a significant benefit that motivates most people who are well into organic products. In an unusual open letter, the Chief Executive of the Food Standards Agency clarified: “Pesticides were specifically excluded from the scope of this work. This is because our position on the safety of pesticides is already clear: pesticides are rigorously assessed and their residues are closely monitored. Because of this the use of pesticides in either organic or conventional food production does not pose an unacceptable risk to human health and helps to ensure a plentiful supply of food all year round.”

The other motivation for organics is our attitude towards the environment, which can either benefit us over the longer term or, if we are irresponsible, it could accumulate toxins which only show their impact over decades and generations. But, let’s be honest, are most consumers likely to buy products because of some distant benefit to the environment, or products that benefit themselves immediately?

Possibly the answer lies in the organic sector cleaning up its message.

Are consumers any wiser after this study and the debate? I’m not sure. For now, my take on this issue remains: be aware and make up your own mind about what you want to ingest, because this debate isn’t over yet.

Green = Sales?

Devangshu Dutta

April 28, 2009

An article in Convenience Store Decisions wonders “Can Packaging Boost Sales?”

According to the article, in November 2008 McDonald’s reported that 82 percent of its packaging in its nine largest markets is now made from renewable materials. And “convenience store retailers are following Mickey D’s lead, seeking to capture a greater share of takeout sales as well as respect the earth with reliable, environmentally friendly packaging that won’t drive up the cost of takeout meals.”

The question is: how much of a selling point is green packaging at retail? Is the sales lift worth the investment in green packaging?

(At the risk of sounding naive,) I think well-conceived green packaging (starting with reduced packaging) would be a win-win-win: lower cost for the retailer, higher acceptability with the consumer, and better for the planet.

On a different note, we do conveniently ignore the true cost of the excessive throw-away packaging. If the cost of disposing that were added to the price of the product, the switch over to green packing might be faster.

I recall reading about a protest in the UK a couple of years ago by consumers who unwrapped excessive packaging at the cash-till and left it there – imagine that at your local supermarket on a Saturday!

The original article from Convenience Store Decisions is here: Can Packaging Boost Sales?

Organic – Hope or Hype?

Devangshu Dutta

April 15, 2009

The organic movement has touched a variety of products, including clothing, cosmetics and home products. Possibly the most emotive area is organic food, because food products are directly taken into the body while other products have a limited and external contact. 

In a sense, before the appearance of industrial agriculture and the application of synthetic nutrients and pesticides, all farming was organic. In fact, the traditional Sanjeevan system of India dates back several millennia. 

Even the existing organic farming movement has been around since its founding in Europe in the early-1900s. This was initially treated as fad and its proponents were seen as eccentric (at best) or insane. However, as damage to the environment and to human health became a bigger concern, organic farming emerged as the healthier option. 

Organic farming is based on the following fundamental premises: 

  • a farm that uses natural rather than synthetic inputs throughout, from seeding (or insemination in the case of animals) to post-harvest
  • methods that are sustainable rather than exploitative or injurious to the farm and its surroundings, with an emphasis on conservation of soil and water resources

The aim is to drive a more healthy approach all around – for the environment, for people, as well as for the animals and plants. 

The organic trade (all products) is currently estimated at over US$ 40 billion globally, with an annual growth of approximately US$ 5 billion. Organic production is driven today more by demand than by supply – in many cases supply constraints of certified organic produce is more of a concern than the market demand. 

Every year, increasing numbers of consumers consciously buy organic products regularly or occasionally on the basis that it is good for them and good for the planet. Certainly, true organic farms do not use synthetic materials, avoiding damage to the environment and can help to retain the biodiversity. Whether measured by unit area or unit of yield, organic farms are more sustainable over time as they use less energy and produce less waste. 

It is not as if, after decades of individual enthusiasts pushing their ideas from the fringes, consumers have suddenly become more environmentally conscious. This mainstream awareness has possibly been pushed up in recent years by the involvement of large companies which have spotted the tremendous growth of a profitable niche. “Organic” is the new speciality or niche product line that can be priced at a premium due to the greater desirability amongst the target consumer group, with potentially higher profits than inorganic products or uncertified products. Today, at least in the two largest markets (the USA and Europe), large companies have the lion’s share. For instance, statistics from Germany show that in 2007 conventional retail chains sold over 53% of organic produce, while specialist organic food retailers and producers lost share during the year. Similarly in the US, after the development of the USDA National Organic Standard in 1997, significant merger and acquisition activity has been visible.

However, as the interest in organic products has grown, so have the noise levels in the market. With that the potential for confusion in customers’ minds has also grown.

In day-to-day conversations, we tend to treat organic as superior to inorganic. But the reality is a little bit more complex.

For instance, we expect organic products to contain more nutrition and be better for our bodies. While this may be true of organic animal products compared to their inorganic counterparts, it has not been demonstrated for plant products, other than anecdotal experience of taste and appearance.

There are studies that suggest that inorganic farming can produce more crop per acre and more meat per animal, and is, therefore, the better option for a planet bursting with overpopulation. (Some proponents extend that argument to genetically modified foods as well, but let’s stay away from that for the moment.) 

However, there are also other studies that counter this argument by suggesting that the organic farms can end up being more efficient and productive in direct costs, yield and long-term sustainability. 

Then, the big question is: if organic foods are no better nutritionally than inorganic and could be as productive for the farmer, are organic brands just skimming the gullible customer while the going is good?

We might expect certification and regulation to clear the air, but in many instances these leave out as many things as they include. Labelling is yet another concern. Countries where labelling is more stringently monitored allow logos such as “100% organic”, “organic” (more than 95% organic ingredients) and “made with organic ingredients” (over 70% organic ingredients). In other countries logos and where labelling may be less strictly monitored, the use of the term organic is far looser and even more confusing. What’s more, the usage of terms such as “Bio” or “Eco” can also mislead consumers into believing that there is something distinctly superior about the product they are about to buy when, in reality, it is often only a marketing gimmick.

Further, just because something is certified as organic does not mean it is a higher grade of product. Organic produce may end up having a shorter shelf-life, or may also be otherwise inferior to inorganic produce in the store. In fact, as the KRAV (Sweden) website states: “The KRAV logo is a clear signal that the product is organically produced but does not say anything about the quality. That must be guaranteed by the producer, i.e. yourself”. This is similar to saying that the fact that someone has a management certification from a certain institute means that he or she passed the tests of that institute in a particular year, but that does not automatically make him or her a good businessperson.

Countries and regions that have a poor record of environmental consciousness, poor transparency norms, are also not seen as the best source for organic produce even if it is apparently from a certified producer. In some cases, certification may be carried out second-hand and unverified, leading to instances such as the one in 2008 where the US retailer Whole Foods pulled out pesticides-laden “organic-certified” ginger that was shipped from China. The mixing of inorganic ingredients of uncertain origin, especially in blended products such as juices or snacks, can also make a mockery of the organic labelling.

Another visible concern today is the carbon footprint, and some people raise the question whether buying local (whether inorganic or organic) may be less environmentally damaging than importing produce from distant countries. In such instances, the evidence of lax certification, such as the Chinese case mentioned earlier, takes support away from the cause of organic imports.

Arguments have also been raised about whether the larger “organic” factory farms merely follow the letter of the law rather than the principles behind the organic movement? Small organic farmers allege that large organic-certified factory farms – especially those selling animal products – do not really follow the core principles of “natural” growth, and confine their animals in unnatural surroundings. 

With all these arguments and counter-arguments flying about, some organic (or nearly organic) producers elect not to be certified, letting their customers vote with their wallets. Some of these smaller farmers may be driven by economic necessity since certification could be costly and cumbersome, while others may just find it more feasible to stick with a local sales strategy where the customers are able to physically see the organic nature of the farm. 

It’s clear that all of these questions will take years to sort out – through debate, research, legislation, as well as social and commercial pressure. Meanwhile, most conscientious retailers and concerned consumers will need to do their own studies to educate themselves, and will need to examine each product for genuineness of the organic promise.

And, if you are not quite that savvy, the final message would be: “caveat emptor” (“let the buyer beware”).

Thoughts from the Recession

Devangshu Dutta

April 11, 2009

RetailWire’s Al McLain has asked, “What changes in consumer spending habits do you see as providing retailers and manufacturers with the most opportunity? Which habits do you think will stick around once the economy improves, and which won’t?”

Well, “the only thing certain (and permanent) in life is death…”

Economic changes – including recessions – are not permanent (unless the society itself collapses), so the market mood will shift towards spending again.

Consumer sentiment may not lead the recovery but is likely to follow it. Given that, value-consciousness will stick, even after the market turns upwards. So my reading is that private label will continue to grow, people will continue to think harder about spending on big-ticket items, deals & coupons will continue to work.

Carol Spieckerman, a RetailWire panelist, made a comment about consumer spending not returning to where it was. To that I would add this thought and question: even in these recessionary days, the average American and European household consumes more (and is more wasteful) than even the wealthier households in the so-called developing or less developed economies. What if the average American consumer begins to find out that s/he can cut back even more than s/he already has? What would that do to the traditional business and economic model?

And once that consumer role model is demolished, what would that mean for the world at large and the developing economies that have been following the “consumption-led growth model”?

Obviously, this is not a foregone conclusion, but it’s a scenario worth pondering and preparing for. And some might say, perhaps a scenario even worth encouraging.

(Here are more thoughts and commentary from the RetailWire Braintrust and others readers on Lessons from the IRI Retail-CPG Summit.)