Categories
Content Effectiveness

Predicting Content Attention and Behavior

Audiences, at times, seem inscrutable. We want to know how audiences will respond to content, but audiences don’t behave consistently.  Sometimes they skim content; sometimes they read it closely.  Even if we wish it were otherwise, we can’t escape the messy reality that audiences in many respects don’t behave in a single consistent way.  But do they behave predictably?  Can we predict want kind of content will engage online audiences, if we could account for known variables? To date, progress untangling this problem has been limited.  But we have reason to be optimistic it won’t always be this way.  A more data-centric approach to content strategy could help us understand what variables influence audience behavior.  

The biggest weakness in content strategy today is that it lacks predictive explanatory power.   Whenever someone advances a proposition about what audiences want or will do, it is easy to find counter examples of when that doesn’t hold.  Nearly all categorical assertions about what people want from content don’t survive even minimal scrutiny.  Do audiences want more or less content?  Do they want simple or detailed explanations?  Do they want to engage with the content, or get the content in the most digestible form possible? Such binary questions seem reasonable to ask, and call for reasonable  answers in return.  But such questions too often prompt simplistic answers that promise a false sense of certainty.  Content behavior is complex — just like human behavior in general.  Yet that doesn’t mean it is not possible to learn some deeper truths — truths that may not be complete and exhaustive, but are nonetheless accurate and robust.  What we need is better data that can explain complexity.  

To provide predictive explanatory power, content strategy guidelines should be based on empirical data that can be reproduced by others.  Guidelines should be based on data that covers a breadth of situations, and has a depth of description.  That’s why I was so excited to read the new study presented last week at 2018 World Wide Web Conference by Nir Grinberg of Northeastern University, entitled “Identifying Modes of User Engagement with Online News and Their Relationship to Information Gain in Text.”  The research provides a rare large scale empirical analysis of content, which reveals many hidden dimensions that will be useful to apply and build on.  I encourage you to read the study, though I caution that the study at times can be dense, filled with academic and statistical terminology.  I will summarize some of its highlights, and how they can be useful to content strategy practitioners.  

Grinbert’s study looked at “a large, client-side log dataset of over 7.7 million page views (including both mobile and non-mobile devices) of 66,821 news articles from seven popular news publishers.”   By looking at content on such a large scale (nearly 8 million page views), we can transcend the quirks of the content we deal with in our own projects.  We want  to understand if the features of our content are typical of content generally, or are characteristics that apply to only some kinds of content.

The study focused content from news websites that specialize in different topics.  It does not represent the full spectrum of content that professionals in content strategy address, but it does cover a range of genres than are commonly discussed.  The study covered seven distinct genres:

  • Financial news
  • Technology
  • How To
  • Science
  • Women
  • Sports
  • Magazine features

Grinbert was motivated by a desire to improve the value of content.  “Post-hoc examination of the extent to which readers engaged with articles can enable editors to better understand their audience interests, and inform both the coverage and writing style of future articles.”

Why do analytics matter? Content that audiences use is content that audiences value.  The question is how to measure the audience use of content, after they click on a link.  Page views are not a meaningful metric, since many views “bounce”.  Other metrics draw controversy.  Is a long time on a page desirable or not desirable?  With simple metrics, the metric can become hostage to one’s own ideological worldview about what’s best for users, instead being a resource to learn what users are really trying to accomplish.

First, how can we measure attention?  The study considered six metrics available in analytics relating to attention:

  1. Depth — how far scrolled in an article, a proxy for how much of the content was viewed or read
  2. Dwell time — total user time on a page (good for non-reading engagement such as watching a video)
  3. Engagement — how much interaction happens on a page (for example, cursor movements, highlighting)
  4. Relative depth — how much of an article was visible on a user’s screen
  5. Speed — speed of scrolling,  a proxy of how quickly the readers “read” the content
  6. Normalized engagement — engagement relative to article length

The metrics that are “relative” and “normalized” attempt to control for differences between the absolute values of shorter and longer content.  

Next, what might these metrics say about audience behavior?  Through a cluster analysis, the study found these indicators interact to form five content engagement patterns:

  • Shallow  (not getting far in an article)
  • Idle (short period of activity followed by period of inactivity, followed by more activity)
  • Scan (skimming an article quickly)
  • Read (reading the article for comprehension)
  • Long read (engaging with supplementary materials such as comments)

So how do specific behaviors relate to engagement patterns?  The study showed that the indictors were associated with specific engagement patterns.

Depth  (ranked from low to high depth of scrolling)

  1. Shallow
  2. Idle
  3. Scan
  4. Read
  5. Long read

Dwell time (ranked from short to long dwell time)

  1. Scan
  2. Read 
  3. Long read 
  4. Ide
  5. Shallow

Engagement (ranked to low to high engagement)

  1. Shallow
  2. Scan
  3. Idle
  4. Read
  5. Long read

Relative depth (ranked for short to long relative depth)

  1. Shallow
  2. Idle
  3. Scan
  4. Read
  5. Long read

Speed (ranked from fast to slow)

  1. Scan
  2. Read
  3. Long read
  4. Idle
  5. Shallow

Normalized engagement (ranked from low to high)

  1. Shallow
  2. Idle
  3. Scan
  4. Read
  5. Long read

So what does this mean for different kinds of content? “We found substantially more scanning in Sports, more idling in “How To”, and more extensive reading for long-form magazine content.”  That may not sound like a profound conclusion, but it feels valid, and it’s backed by real world data. This gives us markers to plan with.  We have patterns to compare. Is your content more like sports, a how-to, or a feature?   

For sports, readers scan, often just check scores or other highlights, rather than read the full text.  They are looking for some specific information, rather than a complete explanation.  Sports is a genre is closely associated with scanning.  When sports is presented in long form, such as done on the now defunct Grantland website, it only appeals to a niche.  ESPN found Grantland unprofitable.  Grantland violated the expectations of the genre.  

Magazines were most likely to be read shallowly, where only the first few sentences are read, as well as the most likely to be read thoroughly, where even comments are read.  This shows that the reader makes investment decision about whether the content looks sufficiently interesting to read in depth.  They may leave a tab open, hoping to get back to the article, but never doing so.  But sometimes, a preview summary such as an abstract can provide sufficient detail for most people, and only some will want to read the entire text.   

The study found  a “relatively high percent of Idle engagements in How To articles. The few articles we examined from this site gave instructions for fixing, making, or doing something in the physical world. It is therefore plausible that people disengage from their digital devices to follow instructions in the physical world.”  

How the Study Advances our Practice

The study considers how reading characteristics converge into common reading patterns, and how different genres are related to distinct reading patterns.  

The study brings more a sophisticated use of metrics to infer content attention.  It shows how features of content influence attention and behavior.  For example “total dwell time on a page is associated with longer articles, having more images and videos.”   Not all content is text.  How to measure use of video or images, or exploring data, are important considerations.

We have concrete parameters to define engagement patterns.  We may casually talk about skimming, but what does that mean exactly?  Once we define it and have a way to measure it, we can test whether content is skim-able, and compare it to less skim-able content.  

Solid detailed data helps us separate what is happening from why it may be happening.  Slow reading speed is necessarily not an indication that they material is difficult to read.  Fast reading speed doesn’t necessarily indicate the topic is boring. Readers may be involved with other activities.  They may have different knowledge already that allows them to skim.  Instead of debating what is happening, we can focus on the more interesting topic of why it might be happening, and how to address it.   And with benchmark data, teams can test alternative content designs and see how the performance changes.  

How Content Strategy can build on the study

The study shows that more robust analytics can allow us to directly compare utilization characteristics of content from different sources, and compare the utilization characteristics of different genres and formats of content.  Standardized data allows for comparisons.

The study suggests more sophisticated ways to measure attention, and suggests that attention patterns can depend on the genre of content.  It also identified six content behaviors that could be useful for classifying content utilization.  These elements could contribute to a more rigorous approach to using analytics to assess audience content needs.

A framework using detail metrics and patterns can help use baseline what’s actually happening, and compare it with what might be desirable.

For example, what kinds of content elicit shallow engagement?  Is shallow engagement ever a good, or at least an opportunity?  Perhaps people start then abandon an article because it is the wrong time for them to view it. Maybe they’d benefit from a “save for later” feature.  Or alternatively, maybe the topic is valuable, but the content is uninviting, which grinds the engagement to a halt.  With more a sophisticated ability to describe content behavior, we can consider alternative explanations and scenarios.  

The study also opens up the issue of whether content should conform to typical behavior, or whether content should try to encourage a more efficient behavior.  If How To content involves idle periods, should the content be designed so that people can start and stop reading it easily?  Or should the content be designed so that the viewer knows everything they need to do before they begin (perhaps by watching a video that drills how to do the critical steps), so they can complete the task without interruption?   I’m sure many people already have opinions about this issue.   More precise analytics can allow those opinions to become testable hypotheses.

The big opportunity is the ability to compare data between content professionals, something that’s not possible with qualitative feedback.    Today, we have conferences where different people present case studies.  But it is hard to compare the learnings of these case studies because there are no common metrics to compare.  Cases studies can also be hard to generalize, because they tend to focus on process rather than focus on common features of content.  Two people can follow the same process, but have different outcomes, if the features of their content are different.  

Like the field of usability, content strategy has the opportunity to build a set of evidence-based best practices.  For example, how does having a summary paragraph at the start of an article influence whether the entire article is read?  Different content professionals, looking at different content topics, could each test such a question and compare their results.  That could lead to evidence-backed advice concerning how audiences will likely react to a summary.  

The first step toward realizing this vision is having standard protocols for common analytics tools like Google Analytics, so that different website data are comparable.  It’s a fascinating opportunity for someone in the content strategy community to move forward with.  I’m too deep in the field of metadata to be able to work on it myself, but I hope others will become interested in development of a common analytics framework .

— Michael Andrews

Categories
Content Marketing

Sincerity in Content Marketing

Content marketing is the new advertising.  It is ubiquitous and often unloved — despite the desperate efforts of marketers to make people “love” their content.  Everywhere we see signs of public fatigue with content marketing.  Striving for the next hit, content marketing has become ever more insincere.

Sincerity is an old-fashioned concept that’s not discussed much anymore.    The Stanford Encyclopedia of Philosophy notes how sincerity has become so unfamiliar to us:

“The older concept of sincerity, referring to being truthful in order to be honest in one’s dealings with others, comes to be replaced by a relatively new concept of authenticity, understood as being true to oneself for one’s own benefit”.

In other words, sincerity has largely been replaced by “authenticity” — which translated into jargon of marketing, is branding.  No need to worry about the truth as others see it — just worry about what’s true as you define it yourself.

Branding is a game of association.  Companies try to establish a brand image.  They offer to convey that image to customers who are willing to buy their brand.  Content has become major prop in communicating a brand image.

Stories Marketers tell themselves

When content involves stories, sincerity is considered negotiable.  Seth Godin, the marketing personality, wrote a book with the title “all marketers are liars storytellers”.  The implication is that people don’t care how truthful content is, as long as they like it.  For some reason, stories seem immune to “black hat” manipulation.  It’s just a story after all.

Some of the earliest, most pervasive, and most successful examples of content marketing comes from the cigarette industry.  For some reason these examples have never make it into the Hall of Fame of content marketing.  Tobacco companies are exactly the kind of company that would want to hide their involvement with the content.   You had an undesirable product, cigarettes, attempting to become associated with desirable activities, such cricket, wine, food, art or horse racing.

  • Do you like art? Read the Benson and Hedges exhibition catalogue of the exhibit at London’s Royal Academy.
  • Do you like music?  You can read the Benson and Hedges concert program for the Royal Philharmonic Orchestra.
  • Like theater? You can read the program for a production by Andrew Lloyd Webber, courtesy of Benson & Hedges.
  • Like cooking?  Read Benson & Hedges 100’s Presents 100 of the World’s Greatest Recipes by noted chef James Beard.

 

Cigarettes make you sporty.

 

It’s laughable to imagine that a cigarette maker would have a genuine interest in such a wide range of high culture.  But we see many examples of firms producing branded content that is far removed from their core business.  Demographic driven content gives us things such as carbonated beverage manufacturers producing content about extreme sports, and toothbrush manufacturers dispensing parenting advice.

Who is the Hero?

A good deal of content marketing trades on the concept of the hero’s journey.  Make the customer the hero in your stories, the advice says.  I encounter unsophisticated hero-centered marketing each day, in the form of an email announcing various online certificates I can enroll in for a fee.  The sender promises to make me a rock star or ninja in some career that’s red hot.

Mara Einstein writes in her book Black Ops Advertising that much content marketing “plays on what academics call ‘hope labor’ or ‘aspirational labor’ the expectation that we might be able to earn a living by participating in activities like this.”  They promote hope, rather than discuss reality.

When content marketing appeals to hero’s journey, it promises to re-brand the buyer to become a better version of themselves.

Einstein says “content marketing is often about creating stories that present the customer as the hero not the product even to the point of taking the brand out of the story altogether.”   This is why carbonated drinks manufacturers sponsors content about extreme sports.  It is hard to make the product the hero.  So they change the subject to imply consumers of the product can be heroes through their interaction with the product.

The hero’s journey in content marketing does not always involve pretending the customer is a rock star.  Sometimes the pitch is to make you a hero by showing that you are a good person.  This is the premise of  “cause based marketing”.  This form of marketing is especially difficult to untangle.  It can be unclear who is meant to benefit, the consumer, the marketing organization, or the cause that is the subject of the marketing.

The hero. of the story.  Image: By Greudin – Own work, Public Domain

 

Imagine you become concerned about an issue such as the plight of donkeys.  You’ve learned from a charity’s content marketing  that donkeys are very sweet animals but they’re often mistreated.  The charity producing the content is dedicated to helping donkeys.  You like the organization but you want to do more than simply give them money.  So instead of converting on their call to action, where they ask you give the money,  you decide to help donkeys directly.  You discover another charity that allows you to volunteer your time at a sanctuary overseas that also helps donkeys.   The original charity that raised your awareness of the plight of donkeys doesn’t have volunteer opportunities.  Does it have a right to be upset that you did not give it money?  You supported their cause and broader mission.  But you have not acted on their called the action or supported their organization financially.   From the reader’s perspective, is the point of the content to help donkeys or to help an organization?

A cause can sound good, but it isn’t always what’s most important to act on. Content marketing is very good at optimizing how compelling a cause seems. But it has nothing to say about whether the cause is important to begin with.  The people who give money to donkey charities typically live in countries like the UK where working donkeys are few in number, and are well treated compared to poor countries.  As one news commentary noted, donkey causes are “one of those charities which raises money easily and out of all proportion to the relative urgency of its good works.”

Cause marketers may be authentic, in the sense of “being true to oneself for one’s own benefit.”  But they aren’t always sincere, in the sense of putting their own self-interest to the side.  They produce content too focused on the question of what inspires an individual, instead of what’s worthy of being inspiring.

Emotions and Disinterest

Content marketing talks in lofty terms about informing and educating audiences, attracting and delighting them.   It all sounds lovely, even altruistic.  The brand wants to be our friend.  But friendship is a ridiculous concept for a brand to promise.  Brands are organizations, not people, and are incapable of friendship.  They can be liked by individuals, but they can’t return that emotion to individuals.  Pretending to be friends with individuals strains credibility.  And credibility is exactly what brands need in order to be considered sincere.

Organizations have measurable financial goals.  They expect content to support those goals.  In the past, content was often produced without clear goals.  Organizations have become better defining goals for their content.  These goals are not always the same goals that audiences have.  So the organization may try to change the audience’s goals.

Organizations use content marketing to change how customers feel in order to get them to take action.  The more that content marketing tugs at emotions, the more likely the content will  become confused about whose interests are being served.

When marketing content makes promises or implies outcomes, it needs to be sincere if it expects the appeal to be sustainable over time.  The firms that have built the strongest customer reputations over time are the ones that have remained true to serving their customer’s interests, and not just their own.  Sincerity can be good for business.

Sincerity may seem like waffly concept.  But it’s an idea that has been debated for millennia.  Two famous ancient thinkers give us some guideposts to think about the concept.

Cicero believed that the right ethos (character) is necessary for audiences to

  • Be receptive
  • Be attentive
  • Like and trust you

One’s ethos (internally generated) is not the same as one’s brand (externally projected).  It’s about inside-out driven, rather than outside-in driven.  It is not about how one wants to be seen.  It is about one’s values.

Aristotle defined how ethos affected credibility according to three dimensions:

  • Virtue — having the same values as the audience
  • Craft  — the confidence that the speaker knows what they are doing
  • Disinterest — the speaker has no bias, is caring.

The concept of disinterest is especially important.  Everyone knows that marketing content exists to generate revenue.  How can brands demonstrate that they really care about the customer, instead of just wanting their money?  It requires  transparency.

The enduring wisdom of ancient philosophers tells us that character matters.  That credibility rests on sincerity.  To focus on values, rather than optics.

How can publishers be sincere?  Is it in their self-interest to do so?

In the short term, brands face pressures to make customers feel powerful and worthy, even if nothing about them has changed.  For companies selling fast moving consumer goods to adolescents, marketers expect a fresh cohort of their target market will arrive to replace any cynicism that could accumulate from the current cohort.   Reality sometimes catches up, and the next cohort of prospective customers decides the brand is toxic.  This happened to the feel-good branding of Nike’s “Just Do It!”, which got flipped when customers became concerned about their labor practices.  The risk of making the customer the hero of your brand is that they feel personally liable for any shoddy behavior you may do.

When companies need to maintain a relationship with customers, the appeal of heroism is not sustainable.  The long time customer realizes their life hasn’t been transformed, despite what’s implied in the marketing.  Even Apple is finding that such a pretense is hard to keep up.  Tens of millions of customers haven’t suddenly become creative by buying Apple products.

Making Content Sincere

The path to sincerity involves clarifying what the customer wants.  Too often brands assume customers will share the same outlook that they are promoting.  The goals of building an audience for a brand can get warped into making the audience into the brand.

Don’t confuse your brand with branding the customer. Individual people have their own identities, which are rarely identical to any company’s or nonprofit’s.  Even religious organizations can’t push too hard telling people who they are and how they should feel.  Those that try to do this are considered cults.  Companies have also been accused of doing this as well.

Brands should talk about their values, and what they are doing to make those values a reality.  Very few customers know what a firm’s corporate mission is, because it is vague and hidden.  A mission doesn’t need to be original, but it needs to matter to consumers.  And it needs to be simple, stressing one key idea, such as value, access, quality, or helpfulness.  Avoid the “we are going to change the world” nonsense of some branding.

Sincere content avoids phony self-deprecation.  It doesn’t say: “Because of you, we’re committed to…” or “You make what we do possible.”  Sincere content articulates the organization’s own identity.  It reveals the firm’s goals, and actions.  Let customers choose if your values are their values.

Patagonia provides a counter example to hero-narrative cause marketing.  They promote environmental causes because their management is committed to these causes.  They suggest they aren’t motivated by self interest, to the point of discouraging people from buying their products unnecessarily.  One can debate the merits of Patagonia’s strategy.  But it is a refreshing change from the stealth marketing of other companies that attach themselves to causes or mine the insecurities of their customers.  It is not typical lifestyle branding that implies people can confirm their identity by giving money to an organization.

Let people support a philosophy, rather than ask them to adopt one.  Organizations should not use content marketing to promote themselves as gurus seeking followers.

Don’t confuse the hero’s journey with the user’s journey.  Unfortunately, these two concepts get conflated.  The user journey looks at what real people do.  The hero’s journey is about what imaginary people ideally might do.  The user journey is based on actual customer scenarios.  The hero’s journey is based on escapism.

If organizations what to empower people, they should use content to help them practically.

Talk about what you can do for people.  Don’t hide behind stories to imply you offer something that you don’t.  Is that testimonial a commitment of what your brand can do for anyone, or is it a micro-celebrity endorsement?

Publishers should help people understand all options they have.   Start with an issue and then present the options available.  Help customers narrow down what’s best for them. Customers can DIY or do nothing.  They can choose to use an option from a competitor.  Or they can use to give money to a sincere organization that shows them what’s better about what they offer compared to the alternatives.  Transparency brings valuable credibility to a brand.

Products don’t make people successful.  Products merely solve specific problems.  Content needs to focus on how the products help solve those specific problems, instead of promising to transform a life situation. That is real empowerment.

— Michael Andrews