Personality, social media and marketing: A plan to assess people’s personal characteristics from their Twitter-streams

Personality, social media and marketing: A plan to assess people’s personal characteristics from their Twitter-streams

May 25th 2013 |From the print edition

IN AMERICA alone, people spent $170 billion on “direct marketing”—junk mail of both the physical and electronic varieties—last year. Yet of those who received unsolicited adverts through the post, only 3% bought anything as a result. If the bumf arrived electronically, the take-up rate was 0.1%. And for online adverts the “conversion” into sales was a minuscule 0.01%. That means about $165 billion was spent not on drumming up business, but on annoying people, creating landfill and cluttering spam filters.

Which might, in the modern, privacy-free world of sliced and diced web-browsing analysis, come as something of a surprise. Marketing departments gather terabytes of data on potential customers, spend fortunes on software to analyse their spending habits and painstakingly “segment” the data to calibrate their campaigns to appeal to specific groups. And still they get it almost completely wrong.A group of researchers at IBM’s Almaden Research Centre in San Jose, California, however, is here to help. According to Eben Haber, the group’s leader, the problem is that firms are trying to understand their customers by studying their “demographics” (age, sex, marital status, dwelling place, income and so on) and their existing buying habits. That approach, he believes, is flawed. What they really need is a way to discover the “deep psychological profiles” of their customers, including their personalities, values and needs. And he and his team think they can provide it.

Modern psychology recognises five dimensions of personality: extroversion, agreeableness, conscientiousness, neuroticism and openness to experience. Previous research has shown that people’s scores on these traits can, indeed, predict what they purchase. Extroverts are more likely to respond to an advert for a mobile phone that promises excitement than one that promises convenience or security. They also prefer Coca-Cola to Pepsi and Maybelline cosmetics to Max Factor. Agreeable people, though, tend to prefer Pepsi, and those open to experience prefer Max Factor.

People are, of course, unlikely to want to take personality tests so that marketing departments around the world can intrude even more on their lives than happens already. But Dr Haber thinks he can get around that—at least for users of Twitter. He and his team have developed software that takes streams of “tweets” from this social medium and searches them for words that indicate a tweeter’s personality, values and needs.

The personality-profiling part of the software is based on a study published in 2010 by Tal Yarkoni of the University of Colorado, Boulder. Dr Yarkoni recruited a group of bloggers and correlated the frequencies of certain words and categories of word that they used in their blogs with their personality traits, as established by questionnaire.

Some of the relations he found were commonsensical. Extroversion correlated with “bar”, “restaurant” and “crowd”. Neuroticism correlated with “awful”, “lazy” and “depressing”. But there were also unforeseen patterns. Trust (an important component of agreeableness), for example, correlated with “summer”, and co-operativeness (another element of agreeableness) with “unusual”.

Inspired by Dr Yarkoni’s findings, Dr Haber and his team are conducting research of their own, matching word use with two sets of traits not directly related to personality. These are people’s values (things they deem to be good, beneficial and important, such as loyalty, accuracy and self-enhancement) and their needs (things they feel they cannot live without, such as excitement, control or acceptance).

In a test of the new system, Dr Haber analysed three months’ worth of data from 90m users of Twitter. His software was able to parse someone’s presumptive personality reasonably well from just 50 tweets, and very well indeed from 200.

At the moment the system is being tested by a financial-services company. If all goes well, Dr Haber hopes to launch it commercially by the end of the year. He says the new software has the potential to serve people as individuals rather than “vague demographic blurs”. Whether they will actually wish to be “served” in this way, when the price of such service is having strangers build up intimate psychological profiles of them, remains to be seen.

About bambooinnovator
Kee Koon Boon (“KB”) is the co-founder and director of HERO Investment Management which provides specialized fund management and investment advisory services to the ARCHEA Asia HERO Innovators Fund (, the only Asian SMID-cap tech-focused fund in the industry. KB is an internationally featured investor rooted in the principles of value investing for over a decade as a fund manager and analyst in the Asian capital markets who started his career at a boutique hedge fund in Singapore where he was with the firm since 2002 and was also part of the core investment committee in significantly outperforming the index in the 10-year-plus-old flagship Asian fund. He was also the portfolio manager for Asia-Pacific equities at Korea’s largest mutual fund company. Prior to setting up the H.E.R.O. Innovators Fund, KB was the Chief Investment Officer & CEO of a Singapore Registered Fund Management Company (RFMC) where he is responsible for listed Asian equity investments. KB had taught accounting at the Singapore Management University (SMU) as a faculty member and also pioneered the 15-week course on Accounting Fraud in Asia as an official module at SMU. KB remains grateful and honored to be invited by Singapore’s financial regulator Monetary Authority of Singapore (MAS) to present to their top management team about implementing a world’s first fact-based forward-looking fraud detection framework to bring about benefits for the capital markets in Singapore and for the public and investment community. KB also served the community in sharing his insights in writing articles about value investing and corporate governance in the media that include Business Times, Straits Times, Jakarta Post, Manual of Ideas, Investopedia, TedXWallStreet. He had also presented in top investment, banking and finance conferences in America, Italy, Sydney, Cape Town, HK, China. He has trained CEOs, entrepreneurs, CFOs, management executives in business strategy & business model innovation in Singapore, HK and China.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: