English | MP4 | AVC 1280×720 | AAC 44KHz 2ch | 4h 18m | 1.09 GB
Kafka – Master Avro, the Confluent Schema Registry and Kafka REST Proxy. Build Avro Producers/Consumers, Evolve Schemas
This is the new volume in the Apache Kafka Series! Learn Apache Avro, the confluent schema registry for Apache Kafka and the confluent REST proxy for Apache Kafka. Join hundreds of knowledge savvy students in learning some of the most important components in a typical Apache Kafka stack. Apache Avro is one of the most powerful and most popular fast data serialisation mechanism with Apache Kafka: Schema is a first class citizen of the data; data serialisation format that is lightweight; documentation is embedded in the schema; easy to read and write using many languages; fast and big data de-facto data serialisation format. Confluent schema registry for Apache Kafka is the de-facto standard way of storing Avro schemas for your Apache Kafka topics: Stores a versioned history of all your schemas in Apache Kafka; supports and enforces conditions for schema evolution (backward, forward, full compatibility): Kafka Avro serialiser and deserialiser automatically integrate with Apache Kafka and confluent schema registry; make your messages much smaller and lighter! Perfect for increasing Apache Kafka throughput and performance. Confluent REST Proxy is the perfect way to communicate for sending Avro data using non Java languages to Apache Kafka: Write and read binary, JSON and Avro data to Apache Kafka using an HTTP REST API; interact with Apache Kafka using any programming language (not just Java); consult topic list and topic metadata in Apache Kafka
Apache Kafka is increasingly becoming a must-have skill, and this course will set you up for fast success using Avro in Kafka, and the confluent components – the Kafka schema registry and the Kafka REST proxy.
What You Will Learn
- Write simple and complex Avro schemas
- Create, write and read Avro objects in Java
- Write a Java producer and consumer leveraging Avro data and the schema registry
- Learn about schema evolution
- Perform schema evolution using the command line and in Java
- Utilize the REST proxy using a REST client
Table of Contents
01 The need of schemas in Kafka
02 Course Structure & Objectives
03 About your instructor
04 Architecture for Kafka with the Schema Registry and REST Proxy
05 What is Avro
06 Avro Primitive Types
07 Avro Record Schema Definition
08 Avro Complex Types
09 Practice Exercise – Customer & CustomerAddress
10 Avro Logical Types
11346_Code file.zip
11 The complex case of Decimals
12 Avro Section Summary
13 Section Objective
14 Generic Record in Avro – Hands On
15 Specific Record in Avro – Hands On
16 Check-in on now vs later in Kafka
17 Avro Tools – Hands On
18 Reflection in Avro – Hands On
19 Schema Evolution – Theory
20 Schema Evolution – Hands On
21 Avro Java Section Summary
22 Docker on Mac (recent versions)
23 Docker Toolbox on Mac (older versions)
24 Docker on Linux (Ubuntu as an example)
25 Docker on Windows 10 64bit
26 Docker Toolbox on Windows (older versions)
27 Starting Kafka using Docker Compose
28 Confluent Schema Registry
29 Kafka Avro Console Producer & Consumer
30 Writing a Kafka Avro Producer in Java
31 Writing a Kafka Avro Consumer in Java
32 Reminder on Schema Evolution
33 Writing a V2 Kafka Producer
34 Writing a V2 Kafka Consumer
35 Summary on Compatibility Changes
36 Kafka Schema Registry Deep Dive
37 Managing Schemas Efficiently & Section Summary
38 Kafka REST Proxy Introduction and Purpose
39 V1 vs V2 APIs
40 Insomnia Setup (REST Client)
41 Topic Operations
42 Producing in Binary with the Kafka REST Proxy
43 Consuming in Binary with the Kafka REST Proxy
44 Producing in JSON with the Kafka REST Proxy
45 Consuming in JSON with the Kafka REST Proxy
46 Producing in Avro with the Kafka REST Proxy
47 Consuming in Avro with the Kafka REST Proxy
48 Full Avro End to End – Kafka Producer + Kafka Connect + Kafka Streams
49 Kafka REST Proxy Installation and Scaling – Overview
Resolve the captcha to access the links!