Wanted: Big Data and Big Data Experts
-
Wanted: Big Data and Big Data Experts
The majority of companies surveyed are initiating big data projects, but many are finding it hard to find professionals with big data expertise. -
Companies Having or Planning to Have a Big Data Project
Have been using big data for some time: 38%. Have just started a big data project: 38%. Plan to have big data projects in the future: 20%. Big data doesn't make sense for the business: 4%. -
Demand for Big Data Analysis Grows
Asked how the demand for big data analysis is changing, 93% of the survey respondents said that the demand for analysis is growing. -
Stages of Big Data Adoption
In the early stages: 88%. Running a couple of projects: 32%. Running pilot projects: 30%. New to big data: 26%. Have numerous projects: 12%. -
Measuring Rate of Big Data Maturity
In process, but have a lot to learn: 35%. Need to scale and optimize processes: 28%. Still figuring this out: 22%. Have mature processes that provide tools and access: 8%. Have proven processes, but can't meet business demand: 7% -
Top Big Data Challenges
Ensuring data quality: 48%. Keeping costs contained: 46%. Satisfying business needs and expectations: 45%. Quantifying the value of big data projects: 40%. Finding people with required expertise: 36% -
What the Data Team Is Working to Improve
Performance: 56%. Data quality: 54%. Automation: 52%. Reliability: 45%. -
Self-Service
65% of the respondents said they are moving to a big data self-service analytics model to enable data professionals. -
Cloud Resources
58% said they perform some or all of their big data processing in the cloud, and 30% said it is an option for the future. -
Lack of Big Data Expertise
83% of the survey respondents said their data teams are growing, and 35% are having trouble finding professionals with big data expertise. -
Dearth of Technical Resources
31% said there are not enough technical resources to run big data operations effectively.
Big data initiatives are in vogue, but adoption and deployment are in the early stages, according to a new study. Less than one in 10 companies surveyed has mature big data processes and infrastructures in place, according to "The State of Data Ops," a report sponsored by Qubole and conducted by Dimensional Research. "While participants reported strong confidence in meeting their business' big data analysis needs, they also listed numerous challenges and technology chasms," the report said. The study also found that fear of the cloud is subsiding, and most companies will leverage cloud resources for their big data projects. Eighty-three percent of respondents said their data teams are growing, but 36 percent are having difficulty finding big data experts. The 406 respondents included IT staff implementing and operating data infrastructure (30 percent), IT managers responsible for delivering data projects (30 percent), IT executives with data initiatives (21 percent), data platform team members (8 percent) and analytics team members (4 percent). The remaining respondents were business stakeholders or data science professionals. More report highlights follow.