Writing and Reading Data in HDFS

In this tutorial, generate random data and write them to HDFS. Then, read the data from HDFS, sort them and display the result in the Console.

Creating Cluster Connection Metadata from Configuration Files

In this tutorial, create Hadoop Cluster metadata by importing the configuration from the Hadoop configuration files.
This tutorial uses Talend Data Fabric Studio version 6 and a Hadoop cluster: Cloudera CDH version 5.4.
1. Create a new Hadoop cluster metadata definition
Ensure that the Integration perspective is selected.
In the Project Repository, expand Metadata, right-click Hadoop Cluster, and click Create Hadoop Cluster to open the wizard.
In the Name field of the Hadoop Cluster Connection wizard, type MyHadoopCluster_files. In the Purpose field, type Cluster connection metadata, in the Description field, type Metadata to connect to a Cloudera CDH 5.4 cluster, and click Next.

Creating Cluster Connection Metadata

Learn how to create Hadoop Cluster metadata automatically by connecting to the Cloudera Manager.

Using Context Variables

See how context variables can help run the same Talend Job in several different environments, and learn how to use them.

Adding Condition-Based Filters Using the tMap Component

Discover how to set filters on your tMap outputs, and learn how to configure them. This video tutorial will walk you through the process. Text instructions are available on-page, and in a downloadable PDF.

Configuring Joins in tMap

Learn how to configure the join outputs in a tMap component. This free video tutorial will walk you, step-by-step, through the process. Text instructions are available on-page or in a downloadable PDF.

Joining Two Data Sources with the tMap Component

Discover how to easily join two data sources with the tMap component. This free video tutorial will walk you through 4 simple steps, with on-page text instructions. You can also download a PDF of the instructions to take with you.

Filtering Data Using the tMap Component

Discover the tMap component and its interface, and learn how to use it to filter columns from a schema. This free video tutorial will walk you through three simple steps, with on-page instructions. Or you can download a PDF of the instructions to take with you.

Creating and Using Metadata

Discover how metadata can help save a lot of development time, and learn how to create and use them. This free video tutorial will walk you through 5 simple steps, and the on-page instructions are also available as a PDF.

Sorting a File

Learn how to use a processing component and learn how to sort data from a file. The video tutorial will walk you through 5 basic steps, with instructions on-page. Then, you can download a PDF version of the instructions to take with you!

Running a Job on YARN

In this tutorial, create a Big Data batch Job running on YARN, read data from HDFS, sort them and display them in the Console.

Reading a File

Learn how to read data from a simple delimited file. The video tutorial will walk you through the process, with on-page instructions. Download a PDF version of the instructions to take with you.

Running a Job on Spark

Learn how to create a Big Data batch Job using the Spark framework, read data from HDFS, sort them and display them in the Console.

Discovering Talend Studio

Discover Talend Studio and its interface, and create a project and a simple demo Job. The video tutorial will walk you through the process with on-page instructions, and a PDF version to download and take with you!

Dynamic Migration of Cloud Database to Snowflake

Follow this step-by-step tutorial to learn how to seamlessly load Salesforce data into Snowflake. Setup a few free, trial accounts, and you can have your Salesforce data extracted, prepared, transformed, loaded, and ready to go much faster than a manual coding process would allow for!

Try It! – Performing a Structural Analysis with Talend Data Quality

In this hands-on tutorial, you are provided a virtual training environment and step-by-step instructions to get started on Talend Data Quality.

After starting Talend Studio, you establish a connection to the local database server.
Then you use a structural analysis to create an overview of the databases stored on the MySQL server, focusing on the CRM database.

Try It! Performing a Business Rule Analysis with Talend Data Quality

In this hands-on tutorial, you are provided a virtual training environment and step-by-step instructions to get started on Talend Data Quality.

After starting Talend Studio, you will establish a connection to the local database server.
Then you will create a SQL business rule in the repository.
Finally, you will create a business rule analysis and associate the business rule with it.

Try It! – Executing a Task on a Remote Engine in Talend Cloud

In this hands-on tutorial, you are provided a virtual training environment and step-by-step instructions to get started on Talend Cloud.

You connect to Talend Cloud Portal then, you publish a predefined Job and run it on Talend Cloud.
You also see how to execute a task using a Remote Engine.

Try It! – Performing a Column Analysis with Talend Data Quality

In this hands-on tutorial, you are provided a virtual training environment and step-by-step instructions to get started on Talend Data Quality.

After starting Talend Studio, you will establish a connection to the local database server.
Then you will create a basic column analysis and use built-in patterns based on regular expressions to analyze individual column data statistics.
Finally, you will interpret the results.

Try It! Executing a Task in Talend Cloud

In this hands-on tutorial, you are provided a virtual training environment and step-by-step instructions to get started on Talend Cloud.

You connect to Talend Cloud Portal then, you publish a predefined Job and run it on Talend Integration Cloud.
You also see how to execute a task using a Cloud Engine.

Data Warehouse Optimization POC

In this example we explore a data warehouse optimization approach that utilizes the power of Spark to perform analytics of a large dataset.

Real-time Risk Assessment Engine POC

Using Web APIs and machine learning, this job will use a decision tree model to determine, at login, whether to display a specific credit offer, or no offer at all.

IoT Predictive Maintenance POC

This example shows how a large company with over 50,000 vending machines can use the power of IoT (Internet of Things) and Machine Learning to determine an individual machine’s likelihood to break down.

Recommendation Engine POC

This example provides users with movie recommendations from our Talend Movie Database website. Using Talend’s machine learning capabilities we can recommend movies based on the individual visitor’s ratings.

A Day in the Life of a Data Integration Developer: How to Import a License File [Part 7]

This quick tutorial will show you how to take the license file that you received in an evaluation email and import it into the Studio.