Recently, there has been a surge in our customers who want to move away from legacy data integration platforms to adopting Talend as their one-stop shop for all their integration needs. Some of the organizations have thousands of legacy ETL jobs to convert to Talend before they are fully operational. The big question that lurks in everyone’s mind is how to get past this hurdle. Defining Your Conversion Strategy...

Log management solutions play a crucial role in an enterprise's layered security framework— without them, firms have little visibility into the actions and events occurring inside their infrastructures that could either lead to data breaches or signify a security compromise in progress. Splunk is the “Google for log files” heavyset enterprise tool that was the first log analysis software and has been the market leader ever since. So lots of customers will be interested in seeing...

A common practice in any development team is to conduct code reviews, or at least it should be.  This is a process where multiple developers inspect written code and discuss its design, implementation, and structure to increase quality and accuracy.  Whether you subscribe to the notion of formal reviews or a more lightweight method (such a...

Let’s continue our conversation about Job Design Patterns with Talend.  In my last blog, Successful Methodologies with Talend, I discussed the importance of a well-balanced approach: Having a clearly defined ‘Use Case’, Incorporating the proper ‘Technology’ Defining the way everyone works together with a ‘Methodology’ of choice (Waterfall, Agile, JEP...

The concept of cloud computing has been around for years, but cloud services truly became democratized with the advent of virtual machines and the launch of Amazon Elastic Compute in 2006. Following Amazon, Google launched Google App Engine in 2008, and then Microsoft launched Azure in 2010. At first, cloud computing offerings were not all that different from each other. But as with nearly every other market, segmentation quickly followed growth. In recent years, the c...

Whether it’s CRM data used for a marketing campaign or sales figures compiled for the quarterly financial reporting, every company knows that data quality is the cornerstone to accurate and efficient work. Today, only 3% of companies’ data meets basic quality standards. But, there is hope as simple solution exists to prepare data and improve data quality: Talend Dat...

For those who are familiar with my previous Talend blogs perhaps you’ve noticed that I like to talk about building better solutions through design patterns and best practices.  My blogs also tend to be a bit long.  Yet you read them; many thanks for that!  This blog is going to focus on methodologies as they apply to Talend solutions.  My hope is that at the end of it we...

Thanks to all our readers for a very positive response to my previous blog on “Informatica PowerCenter Developers Guide to Talend”. The first part of the series provided an overview of the architectural differences between PowerCenter and Talend. It also provided a primer on Talend Studio – our unified development environment – for developers transitioning over fr...

If you didn’t catch it, the 2017 Gartner Magic Quadrant for Data Integration Tools published in early August and what was most notable about this year’s report is that many of the legacy vendors in the Leaders’ Quadrant moved down and back, causing the entire competitive landscape to shift. Download the 2017 Gartner Magic...

In this example, I have been asked to check if the corporate standard for naming employee documents has been adhered to. If not, I then want to know how many deviations are in the dataset. You have in your database a table of employees, employee documents (contracts of employment, performance reviews etc.), and a table of document types. Let's begin by utilizing those data sets and see what we come up with....