…and how to fix them! We’ve asked our team of Talend experts to compile this top ten list of their biggest bugbears when it comes to jobs they see in the wild – and here it is! 10. Size does matter Kicking off our list is a common problem – the size of individual Talend jobs. Whilst it is often convenient to contain all similar logic and data in a single job, you can soon run into problems when building or deploying a huge job, not to mention trying to debu...

Hello Talend Superheroes!!! Hope all of you are enjoying your time in Talend realm playing with different types of data. Many of you are old-timers of Talend, but everyday new developers are happily joining the band to learn about various superpowers related to data. Like any superhero movie, there is a learning curve to understand and manage the newly acquired capabilities the right way. As Uncle Ben said, “With great power come great responsibility.” Being an Avenger fan, the first thi...

Sales and marketing analytics is one of the most high-profile focus areas for organizations today, and for good reason – it’s the place to look to boost revenues. Savvy executives are already on board with the impact – in a survey of senior sales and marketing executives, McKinsey finds that “extensive users of customer anal...

When I was in my mid-twenties, I thought I had it all. I had just recently graduated from a top law school, passed the California Bar Exam, and was working as a junior associate at a prestigious San Francisco law firm. Three short years later, I had turned my back on l...

Starting last September, The Talend Blog Team started sharing fruitful tips to securely kick off your data project in the cloud at speed.  This week, we’re concluding the series with the fifth and last capability: Accelerate data delivery to third party applications and teams through APIs.   Billions of times each day, application programming interfaces (APIs) facilitate t...

Today, enterprises need to collect and analyze more and more data to drive greater business insight and improve customer experiences. To process this data, technology stacks have evolved to include cloud data warehouses and data lakes, big data processing, serverless computing, containers, machine learning, and more. Increasingly, layered across this network of systems, is a new architectural model – “data pipelines” tha...

Starting September, The Talend Blog Team started to share fruitful tips & to securely kick off your data project in the cloud at speed.  This week, we’ll start with the fourth speed capability: perform faster root cause analysis thanks to data lineage.   Like any supply chain that aspires to be lean and frictionless, data chains need transparency and traceability. There is a need for automated data lineage to understand where data comes from, where does i...

Well, let’s be specific here. Birds migrate either north or south. Data warehouses are only going in one direction. Up, to the cloud. It’s a common trend we’re seeing across every vertical and across every region. Companies are moving their existing data warehouses to cloud environments like Amazon Redshift. And more often than not –unlike their feather counterpart...

"How can I migrate data from all tables from one database to another with one generic Talend Job......with transformations as well?", is a question I get again and again on Talend Community. As an integration developer with over 15 years of honing my skills, this question used to get me banging my head against my desk. I now sit at a desk with a subtle but definitely present dent, which is slightly discoloured from classic pine to pine with a rosé tinge. My attitude was alwa...

In a typical/traditional data warehouse solution, the data is read into ETL memory, processed/transformed in the memory before loading into the target database. With the growing data, the cost of compute is also increasing and hence it becomes vital to look for alternate design. Welcome to pushdown query processing. The basic idea of pushdown is that certain parts of SQL queries or the transformation logic can be “Pushed” to where the data resides in the form of generated SQL statements....