Discovering Data Services through Use Cases: Data Virtualization

January 23, 2012 --

Talend recently announced the availability of the Talend Platform for Data Services. Built around Talend v5’s data integration and ESB technologies, it lets IT organizations operationalize data through the single development, deployment, runtime and monitoring environment of the Talend Unified Platform.

Through a couple blog posts, we look at typical use cases of the Talend Platform for Data Services. The first one is: data virtualization through web services.

Data virtualization abstracts one or several heterogeneous data sources via a Data Services layer that can be invoked in real time, near-real time or polled, to support multiple applications and processes that require access to underlying data-sources.

For example, let’s consider a media organization that delivers content on demand, 24x7, and is handling hundreds of simultaneous requests during peak load. This organization uses a SaaS CRM such as, a home grown customer license management database running on Oracle, and SAP for invoicing and accounts receivables. Yet, a complete view of the customer is required by applications such as the customer web portal (where customers can retrieve licenses they have purchased, but only if their account is in good standing), the CRM itself (sales people need to see invoicing and payment history), the business intelligence system, and more.

In short, getting the complete view of a customer requires to access, at the same time, all three systems listed above. How can Data Services help?

  • Data integration jobs provide access to the sources through their native protocols and APIs, without the need to code. Data transformation, reconciliation and enrichment is defined graphically and results delivered in through code generation.
  • These data integration jobs are then exposed as web services, either using SOAP or REST and made available as a common Services Layer throughout the organization via the ESB.
  • Immediately, any application that needs to access a complete view of the customer can invoke the data services and retrieve, upon request and in real-time, the consolidated information required, as simply as if it was residing in a single data source.

Of course, to make this process smooth, complete integration between data integration and ESB is required. This enables automatic deployment, metadata compatibility, and ensures proper version control of the services.


Next posts: Guaranteed Delivery, Legacy Integration