The key to unlocking big data’s true value: human beings

The key to unlocking big data’s true value: human beings

Intel has served as underwriter for a series of Quartz roundtable discussions with leaders from the financial sector on the impact of big data on their businesses. This BULLETIN is inspired by those discussions.

A BNY Mellon strategy paper lays out “the transformational influence of big data on the 21st century global finance system” as the bank seeks to use rebuilt processes to “store, crunch, use, and deliver data” in new ways. Its CIO employs a staff of 13,000 technologists and is looking for a managing director of big data architecture. Other financial institutions are on similar missions to keep pace, at the very least.

As the financial sector and other industries are keenly aware of big data’s promise and search for optimal ways to unlock its value, a surprising insight emerges from the current dialog: the critical factor in gaining value from powerful new technologies for making business decisions based on troves of data may be found in a much older tool: human analysis.

Many sources, new possibilities

Big Data promises enormous value for the finance and investing spheres, as it does for other sectors. Big Data in finance even has the potential to help make a more stable world for everyone. Fertile areas for Big Data analysis range from capturing new data streams to finding better ways to look at existing data.

In the newer realm is social media, which through big data methods can allow businesses to hear the voice of consumers in ways that can be quantified. Nimble startups have introduced products for organizations that mine the social web. In an early move that implicitly legitimized the value of data from social networks for investors, securities regulator FINRA in 2010 gave guidance to investment firms on appropriate social media rules and disclosures.

However, some big data practitioners say, businesses still must filter that voice. The potential for conclusions to be affected by inaccurate, delayed, or misunderstood consumer data is real. Without expert human guidance and interpretation, the data may be little more than empty bits.

From news feeds to weather, using new tools to interpret more established data sets can also unlock business potential. Geospatial data can reveal occupancy rates in parking lots of big box retailers, helping businesses grasp consumer spending trends in advance of Commerce Department releases. With the expansion of the Internet of Things, geospatial data will become more valuable, delivering information from as many as 50 billion interconnected devices by 2020.

Still, in this example and others, the sheer scope of data can overwhelm the ability to fully analyze it. If a search isn’t narrowed in advance by human identification of the desired information, it will either skim too shallowly or reach only a small corner of a large field of data.

Don’t just ‘worship the black box’

Businesses can’t throw money at big data technology alone and expect miracles. As with any new technology, even transformative ones, the path to real value isn’t a cakewalk. Clearly, for optimal deployment of big data solutions, human experts with subject-matter expertise are needed to ensure the quality of the questions asked and hypotheses tested, and to use well-honed judgment to help filter out noise–not to mention applying sensitivity to social, legal, and policy issues.

The more information organizations reap, the more analysis they’ll require. Without the crucial collaboration between the mechanics of the tools and the judgment of humans, the data is just a bunch of useless terabytes and petabytes. That equation is simple enough. The calculations fall to a more complicated mix of bots and bipeds. The demands and rewards for the right balance will also be big


About bambooinnovator
Kee Koon Boon (“KB”) is the co-founder and director of HERO Investment Management which provides specialized fund management and investment advisory services to the ARCHEA Asia HERO Innovators Fund (, the only Asian SMID-cap tech-focused fund in the industry. KB is an internationally featured investor rooted in the principles of value investing for over a decade as a fund manager and analyst in the Asian capital markets who started his career at a boutique hedge fund in Singapore where he was with the firm since 2002 and was also part of the core investment committee in significantly outperforming the index in the 10-year-plus-old flagship Asian fund. He was also the portfolio manager for Asia-Pacific equities at Korea’s largest mutual fund company. Prior to setting up the H.E.R.O. Innovators Fund, KB was the Chief Investment Officer & CEO of a Singapore Registered Fund Management Company (RFMC) where he is responsible for listed Asian equity investments. KB had taught accounting at the Singapore Management University (SMU) as a faculty member and also pioneered the 15-week course on Accounting Fraud in Asia as an official module at SMU. KB remains grateful and honored to be invited by Singapore’s financial regulator Monetary Authority of Singapore (MAS) to present to their top management team about implementing a world’s first fact-based forward-looking fraud detection framework to bring about benefits for the capital markets in Singapore and for the public and investment community. KB also served the community in sharing his insights in writing articles about value investing and corporate governance in the media that include Business Times, Straits Times, Jakarta Post, Manual of Ideas, Investopedia, TedXWallStreet. He had also presented in top investment, banking and finance conferences in America, Italy, Sydney, Cape Town, HK, China. He has trained CEOs, entrepreneurs, CFOs, management executives in business strategy & business model innovation in Singapore, HK and China.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: