Categories
Personalization

Putting choice into personalization

In previous posts, I noted that the deluge of content makes personalization a necessity for individuals, but that big data approaches that aggregate segment data can’t deliver personalization successfully.  People are moving away from hunting for content, to expecting it to be delivered to them through a feed.  Brands need to offer content that reflects the actual interests of individuals.

Fortunately, there is growing evidence that some content providers are considering individual needs, not just averaged needs.  Most content providers continue to assume they know what individuals want more than individuals themselves.  But some recent services are giving individuals a chance to express their interests directly, instead of hoping that big data will be smart enough to do that on its own.  The paradigm emerging will involve computers responding to your needs, so you can train the provider to give you what you really want.

Why precision matters again

For content to have value, it can’t be treated as a commodity.

Accessing content through a service such as DIALOG could cost $200 an hour when I started working professionally with online content in the 1980s.  Due to the cost, precision was important.  One would create an SDI (selective dissemination of information) query profile to deliver content on topics that one was specifically interested in, without having to spend much time online.  SDI was effective for someone familiar with how to construct complex Boolean queries, but was not a viable option for untrained users.

When the Worldwide Web made information free, content publishers focused on getting the most traffic, either through search engine rankings, or later, social media.  The needs of specific individuals became secondary to the rankings of traffic.  If a person didn’t find what she wanted, she could spend more time “surfing” for it.  Over time surfing lost its luster, as most individuals would only look at content results that were most easily accessible.  Content providers correctly noted that individuals didn’t want to spend effort trying to “pull” content, so they offered more channels that “push” content to people, based on big data.  But the move to pushing content has not reduced the effort for individuals, because they still find themselves having to filter through extraneous content.  The cost to individuals of “free” content is that their attention is depleted and time wasted.

Now more genuine personalization is becoming a reality, thanks to the rise of mobile and tablet apps that are centered on personal usage, and cloud-based data management.

The rise of personal curation

In recent years, content services and applications have appeared that enable individuals to curate content themselves, so that their feed of content matches their specific interests.  The Pandora music service was one of the first major examples.  Tim Westergreen of Pandora told the late Bill Moggeridge: “We learned that because of Pandora’s personalization capabilities, it causes people to interact with it a lot.  You get rewarded for going in and thumbing songs, engaging with the listening.  And as a result people come back steadily, about six times an hour, to do something: whether it’s to create a new station, thumb a song, skip a song, add a new artist, or find out about an artist they’ve heard but don’t know.” (Moggeridge, Designing Media, p. 145)  Pandora’s thumbs up or down approach has been used 35 billion times, which provides a lot of feedback.

A notable approach to personalization comes from Trapit, a consumer content discovery iPad app that was briefly available before it shut down earlier this month.  “Trapit’s AI-driven approach goes completely counter to the dominant trend in news curation today, which emphasizes the power of social networking and collaborative filtering” one news story explained. “You can also train Trapit manually by clicking on the thumbs-up or thumbs-down buttons—and the more you do this, the faster the software will learn your preferences.”  Commenting on the end of consumer service, Trapit’s CEO noted “We challenged this belief — our mantra: ‘You are not the crowd.’ We are all individuals with our own beliefs, tastes, and principles.”

Most recently, National Public Radio (NPR), a leader in content innovation, is preparing a new personalization app.  NPR hopes to present its content “to people in different ways so people can pick and choose based on what they’re doing.”  An innovation will be a DVR-like feature to enable time shifting, so that the stream of content can be paused and picked up when the individual wants to use it.

While these examples differ in their specifics, they are part of a growing wave of personalization efforts that give individuals genuine choice over what content they receive.

Feedback is the basis of choice

Content providers that tout the powers of big data presume to know the best interests of the audience.  To some ordinary individuals, this presumption may feel like a rationalization for collecting all the data involved.  Many platforms have business drivers that involve getting users to make recommendations or expand their range of activity, and as a result, they promote doing these things in the name of the self interest of the users.

Even if big data is not as magical as it is presented, it has a role in personalization provided it is coupled with data on the choices made by individuals.  But among big data’s promoters, the concept of soliciting individual input to shape content personalization is widely resisted.  I have seen a range of objections, most of which are unconvincing.  I’ll paraphrase some objections I’ve seen content providers make:

  • viewers don’t know what they really want, and they say they want more than they use
  • viewers don’t want the burden of having to articulate what they want
  • providing feedback is kludgy and ruins the user experience
  • viewer preferences aren’t reliable indicators of what they actually use
  • machine learning can tell people things they don’t realize they would like
  • viewer feedback is unnecessary, because social recommendations provide the same data

Objections like these treat the viewer as lazy and lacking self-awareness, and the data-rich content provider as wise and concerned.   I don’t want to underplay the limitations of individuals to state unambiguously what they want.  We are human, after all.  But the bigger risk here is of devaluing individuals by not asking them to express their choices.  And some of the problems cited reflect old or poorly done implementations of content choice, not current best practices.

In general, intelligent data should make it easier for people to express their interests, and be aware of what they want.  Even the basic act of declaring topics of interest is made easier through linked data, such as used in Google’s knowledge graph, and as a result, people don’t need to be as precise or complete in saying what they want.

The range of individual signals of content preferences available now to content providers is unprecedented, thanks to the app economy.  There are three main areas an individual can express what the want to see:

  1. the specific interests they declare
  2. feedback on what they see
  3. how they manage defaults, such as links to other services

Many content apps now let individuals choose what topics or themes they’d like to follow.  It may involve creating your own magazine or radio station, then indicating a mix of topics, artists, or sources of interest.  These can be changed at any point if they aren’t serving the individual’s needs.  But selections become richer by the micro feedback on specific content items.  Examples of such micro feedback include:

  • mute or skip
  • reorder prioritization of content streams
  • likes /  dislikes ( or more like this / less like this)
  • now /  later prioritization (viewed now verses read later)
  • most saved articles or videos

These user signals, by themselves, aren’t sufficient to find all pertinent content, and need to be combined with convential secondary data found through social, segment and collective usage.    Incorporating user signals fine-tunes the individual relevance of the content.  Sometimes the relevance to individuals can be about the qualities of the content, rather than whether the content is on-topic.  People interested in the same topic can differ about tastes, such as the content’s style (way content is presented), point of view a topic, and specific themes addressed.  These subtle dimensions are hard for individuals to articulate, but easy for individuals to notice and to react to.  By listening to what individuals say about these dimensions, brands can learn much about their emotional preferences.

How brands can benefit

In the early days of the Web, the concept of “intelligent agents” was a popular approach researchers hoped would help individuals find what they wanted.  In a representative article called “How to Personalize the Web,”  IBM researchers expressed optimism that “agents can personalize otherwise impersonal computational systems.”    Interest in agents faded because most users at the time were anonymous, and no one could figure out how to profit from agents when content was treated as a disposable commodity. Today content is king, and individuals consume their media on their personal devices.

The rise of streaming content, and the desire to control the fire hose it offers, has renewed attention to the need for reader-defined discovery and filtering of content.  Brands can capitalize on this.

Agents are making a stealth reemergence in the form of content personal aggregation apps.  As people aggregate content based on their own interests, they make statements about their preferences that can be used to offer content that matches their preferences.  Brands are also aggregating content through curation.  Such content curation can be an effective approach for connecting with audiences, but it is often based on hunches and crude analytics.  Insights into the actual interest of individuals, what they feel about content as expressed through their micro feedback, would be more effective.

The other promising area for micro feedback is in the area of discovery.  Content providers and consumers both recognize the discovering new content that one wasn’t consciously seeking is difficult to do well.  Big data can potentially offer some insights, but people want to feel they, not the machine, are driving the discovery.  Showing new things to people who have not shown prior interest in something is risky, and involves a lot of trial and error that looks clumsy to people.  People may push back on being typecast, or feel that such content is reflecting the provider’s interests, rather than their own.  It violates the idea that the individual has control over the content they view.  So brands that present discovery well, by introducing serendipity in a measured way that doesn’t seem forced, will earn credibility with audiences.  Individuals want the same choice and control.  Providing opportunities for micro feedback on suggestions is doubly important.

The convergence of curation, discovery and personalization presents many opportunities for brands.  An obvious opportunity would be to offer apps that focus on specific topics of interest to customers, and enable individuals to curate content from different sources, including the brand’s.  Such deep knowledge of a person’s interests is highly valuable for brands.  They can learn much about their customers at the same time they make their customers feel valued as individuals.  By putting choice at the center of the experience, the brand makes their customer the hero.

— Michael Andrews

Categories
Personalization

The urgency of genuine personalization

Personalization may be the most misused phrase relating to content.  It’s not hard to understand why people want to talk about personalization: it’s appealing to think you’ll see exactly what you want, especially has we get deluged with content.  But paradoxically most techniques of personalization actually involve tailoring content based on what other people do, rather than your own interests.  As a result, people miss out on content they might most want to view.

To get a sense of why personalization is so urgent, and so troublesome, consider the situation of Facebook.

Mark Zuckerberg said last year that Facebook wants to be “the best personalized newspaper in the world.”  Notwithstanding Facebook’s popularity, its users complain about the lack of relevancy for much of the content they see.  Facebook is optimized for promotion of content sharing, not for filtering of content based on individual preferences.  Those two goals to a large extent are in conflict with each other.  Facebook has chosen to fund its revenues through advertising and related services, which  accounts for about 90% of total revenues.  Brands want their content viewed and shared and their ads seen, so keeping them happy is a huge priority.   These various pressures come to a head with Facebook’s News Feed.  On average, a person may have 1500 potential messages Facebook considers relevant to them, and Facebook needs to prioritize these into a manageable quantity (they’ve decided that’s about 300).  “The News Feed algorithm responds to signals from you” Facebook explains.  But many signals seem to have little to do with the individual, and more to do with other parties: the interests of friends, strangers, and advertisers.   Factors influencing ranking include “number of comments, who posted the story, and what type of post it is (ex: photo, video, status update, etc.)” and “promoted posts.”  Facebook routinely revises its algorithm based on what tests show people in general like best.  But the options for the individual to choose what he or she wants specifically are few.  Facebook decides what types of content, and items of content, are most relevant, and individuals don’t get much choice in the matter.

What do we mean by personalization?

In the digital content arena, personalization lacks any widely agreed definition. As Aria Haghighi of Prismatic notes: “personalization is really young. I still think we don’t all agree necessarily on what personalization means.”   Part of the lack of agreement involves how to implement personalization on a technical level, but also it reflects a lack of common vision from providers about what they want personalization to offer.

Digital marketers generally refer to personalization as behavioral targeting, and often use the terms interchangeably.  Big data researchers typically see personalization as adapting content results on the basis of machine learning.  Curiously, the protagonist of the story, the person seeking content, is missing from the personalization discussion.  Instead, the discussion is centered on how to improve click through rates.

Serving people better should be the core reason for personalization, and it’s important to build a commonsense definition, rather than a mathematical one.  Merrium Webster defines personalize as “to mark (something) in a way that shows it belongs to a particular person.”  The key elements are that it is individual to a person, that the person owns that something.  Ownership implies having control.

My definition of personalization is when a person gets unique content that reflects their individual preferences.  Targeting, in contrast, is when a person gets non-unique content based on characteristics they share with others.  In both cases, the content provider prioritizes what content is delivered, but in the first case it is based on first-hand knowledge of what an individual is interested in, where in the second case, it is based on second-hand assumptions about what seems relevant to the individual.

Personalization is based on explicit individual preferences, not assumptions

To understand personalization, we need to separate two dimensions:

  • whether the “signal” is about the individual himself, or about the interests of a crowd who are assumed to be similar to the individual
  • whether the “signal” is an explicit expression of interest, or an implicit assumptions based on prior behaviors

The following table shows how different signals can be aligned with either individual or crowd, and can be either explicit or implicit:

Table showing how different kinds of explicit and implicit preferences and behaviors can influence content delivery
Table showing how different kinds of explicit and implicit preferences and behaviors can influence content delivery

I’ve simplified the classic approaches of Facebook, Amazon, and Google to highlight elements that are most salient in their respective approaches.  In practice, each uses a mixture of signals to rank and filter content, crunching hundreds of different largely behavioral signals.  These high volume content providers, and others who are far smaller,  offer individuals the impression that the results are personalized (described as being “for you”) when they are primarily based on the aggregation of data across users, rather than individual feedback.  While these aggregation techniques improve general relevance (fewer inappropriate items), I don’t believe these behavior-driven approaches are sufficient to give individuals what’s most relevant to them personally.

How to implement personalization

Personalization matters because it is the only way individuals will be able to cope with the volume of content they face now and in the future.  Too much information is the problem, and genuine personalization needs to be the solution.  Brands need to help individuals connect with the content they most want, and not simply content that’s an adequate fit.  To do that, they need to ask questions, and not just make assumptions.

Lots of content providers talk about offering personalization, but the techniques they rely on have big weaknesses.  In future posts, I will discuss why big data approaches can’t solve personalization, and why small data using individual feedback is essential.

—Michael Andrews