In the previous blog, we walked through the installation and set-up of Talend Open Studio and briefly demonstrated key features to familiarize you with the Studio interface. In this blog, we will build a simple job to load data from a local file into Snowflake, a cloud data warehouse technology. More specifically, we will build a new...

At Talend one of my “Shadow IT” jobs is reporting on the component usage. If you have ever used Talend Studio (either the open source Talend Open Studio or the commercial version you most likely know the component tMap.  It is the most used component by a long ...

With millions of downloads, Talend Open Studio is the leading open source data integration solution. Talend makes it easy to design and deploy integration jobs quickly with graphical tools, native code generation, and hundreds of pre-built components and connectors. Sometimes people like to get some more resources they can use to get started with Talend Open Studio, so we have put some of them together in this blog and in a...

Recently, there has been a surge in our customers who want to move away from legacy data integration platforms to adopting Talend as their one-stop shop for all their integration needs. Some of the organizations have thousands of legacy ETL jobs to convert to Talend before they are fully operational. The big question that lurks in everyone’s mind is how to get past this hurdle. Defining Your Conversion Strategy...

This post is co-authored by Jorge Villamariona and Anselmo Barrero at Qubole. A popular term emerging from the software industry over the last few years is serverless computing, more commonly referred to as just “...

A common practice in any development team is to conduct code reviews, or at least it should be.  This is a process where multiple developers inspect written code and discuss its design, implementation, and structure to increase quality and accuracy.  Whether you subscribe to the notion of formal reviews or a more lightweight method (such a...

Let’s continue our conversation about Job Design Patterns with Talend.  In my last blog, Successful Methodologies with Talend, I discussed the importance of a well-balanced approach: Having a clearly defined ‘Use Case’, Incorporating the proper ‘Technology’ Defining the way everyone works together with a ‘Methodology’ of choice (Waterfall, Agile, JEP...

Like many other sectors, the future of fitness is customized and partially online - though to get results, one will still have to monitor their diet and exercise in real life. With 23 million customers, Beachbody is a worldwide leader in health and fitness. With over 5 million monthly unique visitors, Beachbody started to face some real-time big data challenges. Beachbody was running a conventional on-premises Oracle data warehouse to store i...

Whether it’s CRM data used for a marketing campaign or sales figures compiled for the quarterly financial reporting, every company knows that data quality is the cornerstone to accurate and efficient work. Today, only 3% of companies’ data meets basic quality standards. But, there is hope as simple solution exists to prepare data and improve data quality: Talend Dat...

For those who are familiar with my previous Talend blogs perhaps you’ve noticed that I like to talk about building better solutions through design patterns and best practices.  My blogs also tend to be a bit long.  Yet you read them; many thanks for that!  This blog is going to focus on methodologies as they apply to Talend solutions.  My hope is that at the end of it we...