This blog post is part 1 of a series of blog posts on Apache Beam. Are you familiar with Apache Beam? If not, don’t be ashamed, as one of the latest projects developed by the Apache Software Foundation and first released in June 2016, Apache Beam is still relatively new in the data processing world. As a matter of fact, it wasn’t until recently when I started to work closely with Apache Beam, that I loved to learn and...

Open source software (OSS) just celebrated its 20th anniversary and not only does the community have a lot of milestones to celebrate, but also a lot to which they can look forward! OSS continues to disrupt the status quo in groundbreaking ways, but it’s also becoming increasingly mainstream. Thus, if you’re an IT leader of any-sized organization, you should be thinking about and planning for how to incorporate OSS into your infrastructure. Among the hundreds of popular open so...

In 1998, Netscape decided to release their source code in an effort to attract new users to their product and new developers who could easily integrate applications with the browser.  At the same time, there seemed to be a groundswell around a culture of open and collaborative development, with legacy software companies beginning to ack...

Cloud computing in the form we understand today started around 10 years ago, with the launch of Amazon Web Services (AWS). This was the first commercially viable option for businesses to store data in the cloud rather than on-premise and acted as a shared service for anyone connecting to the platform. Early stage cloud computing was certainly more technical than it is now. However, no more than managing a data center – something that IT departments at the time were well used to. Any...

Recently, I've seen a lot of articles and conversation around DevOps. DevOps is a set of practices that automates the processes between software development and IT teams, in order to enable be shorter development cycles, increased deployment frequency, and more dependable releases all in conjunction with business needs. Companies are increasingly adopting DevOps practices utilizing agile methodologies along with automat...

When it comes to solutions for the big data sector, there is a clear split between the legacy and next-generation approaches to software development.  Legacy vendors in this space generally have their own large internal development organizations, dedicated to building proprietary, bespoke software. It’s an approach that has worked well over the years. However, the big data market has always moved at lightning speed, a...

This blog was originally published by Anand Iyer & Jean-Baptiste Onofré [@jbonofre] on the Apache Beam blog...

At Talend, we like to be first. Back in 2014, we made a bet on Apache Spark for our Talend Data Fabric platform which paid off beyond our expectations. Since then, most of our competitors tried to catch-up… Last year we announced that we were joining efforts with Google, Paypal, DataTorrent, dataArtisans and Cloudera to work on Apache Beam which si...

If you are Captain Kirk or Mr. Spock and you need to get somewhere in a hurry, then you “beam” there, it’s just what you do. If you are a company and you want to become more data driven, then as surprising as it may sound, the answer there could be beam as well, Apache® Beam™. This week, the Apache Software Foundation announced that Apache Beam has become a top-level Apache project. Essentially, becoming a top-level project formalizes and legitimizes it and ind...

The Panama Papers is the history’s biggest data leak and cross-border investigation in journalism history. For one year, around 400 reporters across almost 80 countries dived into this massive trove of information that exposed how the offshore economy works. Talend Big Data was instrumental in bringing that information into the public domain. Founded in 1997, the International Consortium of Investigative Journali...