In a typical/traditional data warehouse solution, the data is read into ETL memory, processed/transformed in the memory before loading into the target database. With the growing data, the cost of compute is also increasing and hence it becomes vital to look for alternate design. Welcome to pushdown …
Read Article
Talend 7.1 brings in many new features, one such feature which needs a special discussion is containerization, which opens the doors to design and implement new Architectures namely Microservices. With a Maven plugin the Studio is now able to Build and Publish standard Jobs as Docker images …
Read Article
Data integration is one of the hardest things developers have to do, but the talented members of the Talend User Group have lots of ideas on how to make it easier. Stitch, now part of Talend, recently hosted the inaugural meeting of the Philadelphia Talend User Group …
Read Article
Introduction Talend Data Catalog provides intelligent data discovery that delivers a single source of trusted data into a centralized data catalog. Talend Data Catalog provides the capability for doing impact analysis and/or tracing lineage by harvesting Talend data integration Jobs. For example, you can find the use of a specific attribute or column from the source to the …
Read Article
Let me start by thanking all those who read the first part of our blog series on converting legacy ETL to modern ETL! Before I begin the second part of this three-blog series, let’s recap the three key aspects under consideration for converting from legacy ETL to …
Read Article
Last night it occurred to me that everything in the last three parts of this blog series ( Part 1 / Part 2 / Part 3 ) had been oriented towards the Talend on-premise solution. Many developers I have worked with over the years are moving to …
Read Article
Hello and welcome to Part 3 of my best practices guide on context variables! Before I get started, I just want to inform you that this blog builds on concepts discussed in Part 1 and Part 2. Read those before you get started. Let’s say that we …
Read Article
First off, a big thank you to all those who have read the first part of this blog series! If you haven’t read it, I invite you to read it now before continuing, as ~Part 2 will build upon it and dive a bit deeper. Ready to …
Read Article
A question I was regularly asked when working on different customer sites and answering questions on forums was “What is the best practice when using context variables?” My years of working with Talend have led me to work with context variables in a way that minimizes the …
Read Article
In our previous blog, we walked through a simple job moving data from a CSV file into a Snowflake data warehouse. In this blog, we will explore some of the more advanced features of the tMap component. Similar to the last blog, you will be working with …
Read Article