Hadoop Adoption Poised For Growth: Survey - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Cloud // Cloud Storage

Hadoop Adoption Poised For Growth: Survey

More than three quarters of respondents to a recent AtScale survey said they plan to do more with Hadoop in the next three months. Learn how they intend to derive business value from these efforts.

7 Worst Cloud Compliance Nightmares
7 Worst Cloud Compliance Nightmares
(Click image for larger view and slideshow.)

Hadoop adoption is past the "kicking the tires" stage and is likely to see enterprise adoption accelerate, according to a survey of more than 2,100 business, IT and C-suite executives from 1,300 companies worldwide.

The survey was conducted by AtScale, a vendor whose products and services aim to help business users visualize the data in Hadoop platforms. The firm partnered with MapR, Tableau, and Cloudera to survey those companies' customers about their Hadoop use. The survey included responses from CIOs and CEOs working at the same companies.

According to AtScale, this is one of the larger Hadoop surveys to date. One was a Barclay's Equity Research Unit forecast that painted a very bullish outlook for Hadoop adoption, Aziza said. The other was a Gartner study from earlier this year that received 125 responses from a group of 284 and offered a relatively muted outlook for Hadoop adoption.

[ Test your container know-how. Read Containers 101: 10 Terms To Know. ]

More than three quarters of respondents (76%) said they plan to do more with Hadoop in the next three months. "We've entered a second phase where people connect Hadoop with business users," said Bruno Aziza, CMO of AtScale. About 77% of respondents are not tire kickers. They are already operating between 10 and 500 Hadoop nodes. And many of them believe they will reap strategic advantage.

In fact, nearly half of respondents (49%) said they obtained some "tangible value" from using Hadoop. Another 45% said they hope they will, while the remaining 6% were pessimistic.

Hadoop adoption is not a slam-dunk guarantee of success. Companies are more likely to reap value from a Hadoop implementation if they are operating more nodes. Among respondents whose companies operate 500 nodes or more, 76% reported getting "some value" out of Hadoop. Conversely, only 33% of respondents whose organizations operate 10 nodes or less said they got "some value" out of their Hadoop installation.

(Image: Janka Dharmasena/iStockphoto)

(Image: Janka Dharmasena/iStockphoto)

Value is more easily attained if self-service access (SSA) is part of the implementation. Respondents from companies using SSA were 50% more likely to extract value from their Hadoop implementation than those who were not, according to the report.

A lack of skill sets among IT professionals may be the biggest stumbling block facing Hadoop adoption. The one bottleneck identified by the survey is the need for professionals with the skills that enable them to manage a Hadoop implementation. Two thirds of respondents (66%) identified this as their top challenge. Aziza cited a McKinsey & Co. study that showed the need for 140,000 to 190,000 skilled analysts to fill this gap.

Challenges notwithstanding, about half of those surveyed said they are committed to making greater use of Hadoop in the next 12 months, Aziza said. "You've got a year to figure it out. In a year, everybody is going to be on board."

ETL is one bridge leading organizations towards greater Hadoop adoption. ETL, which means extract, transform and load, involves people "taking data from the traditional data source and dumping it into Hadoop," Aziza said. Survey results showed 74% of respondents using Hadoop for ETL.

The next step in the transition takes Hadoop from the realm of data scientists to business users. Data scientists "focus on fewer and more complicated problems the enterprise sees," Aziza noted. The challenge is getting the data in front of business users and analysts.

Self-Serving Access (SSA) is what does this. Nearly two thirds (61%) of respondents believe SSA will allow them to obtain value from a Hadoop implementation. Here, "obtaining value" does not mean cost cutting. Rather, it's about achieving increases in revenue because the business side is making better decisions with the data they have.

Finding the insight that yields the gain is like finding a needle in a haystack. But in the world of big data, making a bigger haystack works to the user's advantage. "More data means better algorithms," Aziza said. "The more data I can capture, the better the correlations will be."

Ultimately, all paths lead toward achieving business results for the enterprise. In the end, sales and marketing people need to know they are spending their dollars wisely to spur sales. Using Hadoop to get there appears to be gaining traction.

William Terdoslavich is an experienced writer with a working understanding of business, information technology, airlines, politics, government, and history, having worked at Mobile Computing & Communications, Computer Reseller News, Tour and Travel News, and Computer Systems ... View Full Bio

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Comment  | 
Print  | 
More Insights
Newest First  |  Oldest First  |  Threaded View
User Rank: Ninja
9/18/2015 | 2:33:03 PM
Adoption will only grow once those skillsets become more available too
I'm a huge fan of Hadoop and what it can do when it comes to analytics, and this article nailed it with one of the reasons I am seeing slower than expected growth...skillsets.  It took us awhile before we saw enough IT folks with the skills to build these types of environments to support next-generation analytics, but we're still not there when it comes to having a steady pool of folks who know what to do with the data once it's captured.  It'll come, but we just need more education and support to get more folks trained on these technologies.  That's when we'll see the growth really take off!
11 Ways DevOps Is Evolving
Lisa Morgan, Freelance Writer,  2/18/2021
Graph-Based AI Enters the Enterprise Mainstream
James Kobielus, Tech Analyst, Consultant and Author,  2/16/2021
What Comes Next for AWS with Jassy to Become Amazon CEO
Joao-Pierre S. Ruth, Senior Writer,  2/4/2021
White Papers
Register for InformationWeek Newsletters
Current Issue
2021 Top Enterprise IT Trends
We've identified the key trends that are poised to impact the IT landscape in 2021. Find out why they're important and how they will affect you.
Flash Poll