• Introducing Pipeline Designer (formerly Talend Data Streams), a new data integration design environment.
• With Pipeline Designer you will be able to:
  • Transform business data for analytics (e.g. Salesforce to Redshift) 
  • Move data from a data lake to a data warehouse (e.g. S3 to Redshift, Snowflake)  
  • Ingest and transform streaming data to a cloud data lake (e.g. Kafka to S3)
  • Offload on-prem data to the cloud (e.g. SQL Server to Azure SQL Database)
  • Perform lightweight data processing (design in the Cloud, connect Cloud and On-prem sources, run in the Cloud or On-Prem)
• Feature overview:
  • Use a web-based graphical designer to create end-to-end pipelines to preview and transform your data
  • Lightweight transformations with built-in processors including filter, aggregate, flatten, replicate, look up, join and time windowing
  • Extend pipelines processors through support for Python coding allowing greater flexibility
  • Built for modern data formats including: AVRO, JSON, Parquet, and CSV
  • Design seamlessly across batch and streaming use cases using a single interface
  • Easily process data without additional setup and configuration through built-in Cloud Engine
  • Design pipelines in the cloud, then run on-premises, in AWS EMR, or in a virtual private cloud
  • Schema-on-read support removes the need to define schemas before building pipelines and keep pipelines resilient when schema changes
  • See interactive data changes instantly through live preview of sample data
  • Utilize a shared, common data set service (repository) across all Talend products, facilitating teamwork, data sharing and reuse 
• Connectivity:
  • Read/Write support for Snowflake, Amazon Redshift, Azure SQL Database, Amazon RDS (Oracle, SQL Server, MySQL, MariaDB, PostgreSQL, Aurora), and on-prem through JDBC (Oracle, SQL Server, MySQL, MariaDB, PostgreSQL)
  • Native cloud data warehouse connectors: Snowflake and Amazon Redshift bulk loaders (destination only), Google BigQuery
  • NoSQL: Elasticsearch
  • Cloud Storage: Amazon S3
  • SaaS: Salesforce
  • Streaming message queues: Apache Kafka and Amazon Kinesis
• Administration:
  • Manage users and licenses through Talend Management Console
  • Schedule jobs and monitor status through Talend Management Console

Try Now

• Ability to import and export API definitions in OpenAPI Specification v3.0, ensuring compatibility with 3rd party API tools
• Easily import your API definitions into Amazon API Gateway and Azure API Management through a dedicated export mode in API Designer
• API design enhancements that provide improved expressivity and developer productivity, including:
  • Data type composition (allOf), e.g. merge different customer information (such as profile, contact, preferences) into a unified view of a customer
  • Data type polymorphism (anyOf, oneOf), e.g. accept either a “dog” or a “cat” as input
  • Ability to document new security schemes such as OpenID Connect or JWT
  • Reusable API components e.g. create a component that describe how to paginate results and use it across the API. Only a single edit is required to modify it.
  • Default response and status ranges, e.g. for “any error” on this operation, “this particular” response will be returned

• Display the name of the user who published a dedicated semantic type in the semantic types list

• Improved efficiency for dataset cleansing and standardization through:
• Applying functions across multiple columns, e.g. concatenation and math operations
• Intelligently extracting part of a name into respective subparts, e.g. title, first name, middle name, last name, and suffix
• Extracting parts of a field based on semantic types definition, i.e. the ability to split a field composed of several parts into the respective subparts
• Improved data privacy with ability to perform semantic data masking on compound semantic types

• Notify Data Stewards and Campaign Owners by email upon task assignment or expiration to improve responsiveness
• Support for adding comments/discussion threads on tasks and task attributes to improve team collaboration

• Automate service deployment for more efficient and flexible DevOps, through a Talend Management Console API
• Easily try out API capabilities in Talend Cloud using an example REST API artifact in Talend Management Console
• Create a personal token for authentication/connectivity between Studio and Talend Cloud, in place of username/password
• Group and search TMC tasks using tags to be more organized
• Pipeline Designer: manage artifacts, Cloud and Remote Engines, Run Profiles; and monitoring

Try Now