Starting last September, The Talend Blog Team started sharing fruitful tips to securely kick off your data project in the cloud at speed.  This week, we’re concluding the series with the fifth and last capability: Accelerate data delivery to third party applications and teams through APIs.   Billions of times each day, application programming interfaces (APIs) facilitate t...

Today, enterprises need to collect and analyze more and more data to drive greater business insight and improve customer experiences. To process this data, technology stacks have evolved to include cloud data warehouses and data lakes, big data processing, serverless computing, containers, machine learning, and more. Increasingly, layered across this network of systems, is a new architectural model – “data pipelines” tha...

Starting September, The Talend Blog Team started to share fruitful tips & to securely kick off your data project in the cloud at speed.  This week, we’ll start with the fourth speed capability: perform faster root cause analysis thanks to data lineage.   Like any supply chain that aspires to be lean and frictionless, data chains need transparency and traceability. There is a need for automated data lineage to understand where data comes from, where does i...

Well, let’s be specific here. Birds migrate either north or south. Data warehouses are only going in one direction. Up, to the cloud. It’s a common trend we’re seeing across every vertical and across every region. Companies are moving their existing data warehouses to cloud environments like Amazon Redshift. And more often than not –unlike their feather counterpart...

"How can I migrate data from all tables from one database to another with one generic Talend Job......with transformations as well?", is a question I get again and again on Talend Community. As an integration developer with over 15 years of honing my skills, this question used to get me banging my head against my desk. I now sit at a desk with a subtle but definitely present dent, which is slightly discoloured from classic pine to pine with a rosé tinge. My attitude was alwa...

In a typical/traditional data warehouse solution, the data is read into ETL memory, processed/transformed in the memory before loading into the target database. With the growing data, the cost of compute is also increasing and hence it becomes vital to look for alternate design. Welcome to pushdown query processing. The basic idea of pushdown is that certain parts of SQL queries or the transformation logic can be “Pushed” to where the data resides in the form of generated SQL statements....

Starting September, The Talend Blog Team will relay to share fruitful tips & to securely kick off your data project in the cloud at speed. This week, we’ll start with the third capability: enable access to and use of self-service applications.   Data professionals face an efficiency gap; they spend too much time to get access to the data they need and then put it into the appropriate business context. The capacity of delivering trusted data to business expe...

It’s no secret that the cloud data warehouse space is exploding. Driven by the need for on-demand, performant data warehousing solutions, businesses are turning to public cloud providers to modernize their analytics infrastructure and help them make better business decisions. Among the leading data warehouse options from the public cloud providers is Amazon Redshift. Redshift offers a petabyte-scale, fully managed data warehouse service...

As a Microsoft partner, we’re excited by the announcement of the Azure Synapse Analytics platform. Why? Because it furthers the ability of businesses to leverage data-driven insights and decision making at all levels in an organization. (And we love that!) Together, our joint customers are already leveraging data in amazing ways to tackle everything from crea...

While the impetus for transforming to a data-driven culture needs to come from the top of the organisation, all levels of the business should participate in learning new data skills.  Assuring data availability and integrity must be a team sport in modern data-centric bu...