While data is the new currency in today’s digital economy, it’s still a struggle to keep pace with the changes in enterprise data and the growing business demands for information. That’s why companies are liberating data from legacy infrastructures by moving over to the cloud to scale data-driven decision making. This ensures that their precious resource— data — is governed, trusted, managed and accessible. While businesses can agree that cloud-based technologies are key to...

Introduction Thanks for continuing to read all of our streaming data use cases during my exploration of Talend Data Streams. For the last article of this series, I wanted to walk you through a complete IoT integration scenario using a low consumption device and leveraging only cloud services. In my previous posts, I’ve used a Raspberry Pi and some sensors as my main devices. This sing...

In our last blog, we talked about developing data processing jobs using Apache Beam. This time we are going to talk about one of the most demanded things in modern Big Data world nowadays – processing of Streaming data. The principal difference between Batch ...

In the last few years, Python has become the go-to programming language for Data Scientists. In a way, this is kind of surprising. Python was not originally developed to do analytical tasks or data science, but it has evolved to become the ‘Swiss-army’ tool in the Data Scientist toolbox. The reason for this comes from a large number of third-party packages available for Data S...

This post is co-authored by Jorge Villamariona and Anselmo Barrero at Qubole. A popular term emerging from the software industry over the last few years is serverless computing, more commonly referred to as just “...

Introduction This month, Talend released a new product called Talend Data Streams. Talend Data Streams was designed for data scientists, analysts and engineers to make streaming data integration faster, easier and more accessible.  I was incredibly excited when it finally released on the AWS marketplace and have been testing out a...

I am very excited to introduce Talend Data Streams, a brand new, cloud-native application that enables you to get streaming data integrations up and running in minutes all while providing unparalleled portability powered by Apache Beam. <<Download Talend Data Streams for AWS Now>> Why Talend Data Streams? One of the biggest challenges that businesses face toda...

In the past few years, there has been a shift in the data industry, leading to the emergence of a new category of data citizens: the ‘ad hoc’ or ‘citizen’ integrators. With these new personas adding to the (already long) list of data workers having access to corporate information, companies are needing to re-think the way they approach their data security and data governance strategies. Unlike data engineers, this new class of ‘citizens’ or personas, don’t necessarily utilize da...

In my previous blog, “Talend & Apache Spark: A Technical Primer” I walked you through how Talend Spark jobs equate to Spark Submit. In this blog post, I want to continue evaluating Talend Spark confiurations with Apache Spark Submit. First, we are going to look at how you can map the options in the Apache Spark Configuration tab in the Talend Spark Job, to what you can pass as arguments to Spark Submi...

Many businesses today are scrutinizing their operations to figure out how to join the digital transformation revolution. They understand that to become more competitive and customer-centric, they need processes that are flexible, integrated, insightful and scalable. They understand harnessing data and infusing business processes with it is the key to success. Unfortunately, poor data practices,...