• All Files

 

Processing Data in Real-time with Pipeline Designer to Generate a Heat Map

 

Subscription onlyThis content is available for Talend Academy subscription users only. Open use case - EN

 

Prerequisites

Talend Cloud Essentials, Talend ESB Basics, Talend Big Data Spark Streaming

Third-party software

  • Docker-compose 1.25.0

  • Docker Engine CE 19.03.5

  • Kafka 2.12-1.1.0

  • ELK stack 6.7.1 (included with Talend Data Fabric 7.2.1)

Description

 

 

This use case introduces you to the processes of streaming data in real-time with Pipeline Designer and generating a heat map with Kibana.

 

The Twitter API offers a streaming flow of data that comprises the location of the tweets. You learn how to process these data and generate a map that displays where the tweets come from.