Apache Kafka Essential Training: Getting Started

Apache Kafka Essential Training: Getting Started

English | MP4 | AVC 1280×720 | AAC 44KHz 2ch | 1h 18m | 199 MB

One of the key components of a big data processing pipeline is a scalable and distributed message queue. Message queues enable real-time streaming capabilities with multiple producers and consumers of data. This enables real-time applications that can analyze data and produce insights in a scalable fashion. Apache Kafka provides these capabilities. As the de facto standard for open-source messaging, Apache Kafka is an essential skill for data scientists, big data engineers, data architects, and solution architects. In this course, instructor Kumaran Ponnambalam introduces Apache Kafka and explains its fundamental concepts and basic operations. Kumaran covers basic concepts like messages, topics, logs, and more. He shows you how to use the Kafka command line, as well as partitions and groups. He goes over Kafka Java programming, then concludes with a use case project.

Table of Contents

1 Getting started with Apache Kafka
2 Kafka brokers
3 Logs in Kafka
4 Producers and consumers
5 Role of ZooKeeper
6 Kafka client scripts
7 Creating a topic
8 Exploring topics
9 Publishing messages to topics
10 Using console consumer
11 Topics management
12 Message queues
13 Kafka setup
14 Intro to partitions
15 Creating topics with partitions
16 Publishing with keys
17 Consumer groups
18 Consumer offset management
19 Consuming partitioned data
20 Kafka client libraries
21 Creating a producer in Java
22 Publishing messages in Java
23 What is Kafka-
24 Creating a consumer in Java
25 Consuming messages in Java
26 Kafka basics use case- Problem definition
27 Setting up topics
28 Producing and consuming data with scripts
29 Producing and consuming data with Java
30 Next steps
31 Benefits of Kafka
32 Kafka use cases
33 Setting up the exercise files
34 Setting up Kafka
35 Messages
36 Topics