Talend, a global open source software leader, today announced the results of its Big Data Adoption Survey, indicating that big data has moved past an early adopter stage, with 41%of organizations having a big data strategy in place. The Talend survey polled 231 professionals involved in the delivery of data solutions for their company to gain an understanding of big data adoption challenges, business objectives and benefits, as well as big data technologies being used.
The results reveal that 68% of respondents report that the number one business driver for big data is increasing the accuracy and depth of predictive analysis – or the ability to analyze current and historical data to make future predictions. Revenue optimization (51%) and new revenue generation (48%) were the second and third highest responses, respectively, as companies seek to do more in-depth analysis to maximize market and wallet share.
Additional common big data use cases include marketing campaign analysis, recommendation engines, sentiment analysis, risk management and fraud detection. IT is integrating existing data warehouses and business intelligence systems with diverse sets of structured and unstructured data for more in-depth analysis. The survey shows that the most common applications being integrated were financial transactions (48.2%) and social media and Internet text (48.2%), followed by web logs (35.8%) and call detail records (28.4 percent).
According to 39% of respondents, big data initiatives that are driven by IT for a bottom-up approach tend to be more efficient in collecting and analyzing large data sets. However, 48% of big data strategies are driven by lines of business or executives, demonstrating compelling business reasons for big data adoption, including increased revenue, improved customer satisfaction and faster time-to-market.
Among the key findings:
- 75% have achieved big data business benefits with the primary benefit being business process optimization (28%) and improvements in marketing and sales (24%).
- However, 24 companies reported not receiving a business benefit, which may indicate the need for improved big data skillsets, governance and management.
- The chief type of big data that is being used today is web and social media-based (57%), followed by sales data (54%).
- 61% replied that their primary big data challenge was allocating sufficient time, budget and resources, with just over half (52%) reporting a lack of big data in-house expertise.
- More than a quarter of big data deployments rely on the native Apache Hadoop distribution; however, other leading technologies and Hadoop distributions are being selected as well, suggesting a fragmented market.
- For those without a big data strategy (76%), the main reason is that big data is actually part of their overall corporate or total data management strategy.
“Our survey shows that organizations are handling more data in more formats than ever before,” said Fabrice Bonan, Talend’s co-founder and chief technical officer. “As this tidal wave of data continues, traditional approaches to storing and managing data are being challenged. The combination of predictive analytics and big data should create new opportunities for more specific, future-oriented analysis of large amounts of data which, in turn, can lead to more actionable insight.”