Ofer Habushi

Ofer focuses on helping Talend’s customers successfully deliver Big Data related projects while understanding the advantages and potential of these new technologies. Ofer is dedicated to keeping current on the latest Big Data technology development and its practical uses. Ofer joined Talend in 2014; previously he worked as a developer and team lead at eBay.

    Contributions by Ofer Habushi

    How to Aggregate Clickstream Data with Apache Spark

    June 01 2016 Ofer Habushi
      As part of a POC of Talend v6.1 Big Data capabilities, I was asked by one of our long-time customers, a major e-commerce company, to present a solution for aggregating huge files of clickstream data on Hadoop. The input data was a giant clickstream file (larger than 100GB, or even terabytes) from a website. Our goal was to aggregate the file and add a session ID column. We needed to create session records for all u
    READ ARTICLE