Streaming Data
Hands-On Training Streaming Data with Apache Kafka on Azure
Hands-On Training: Streaming Data with Apache Kafka on Azure
39 lessons 3h 41m beginner5(1 review)
€19.60€49.00
About This Course
Most Apache Kafka courses explain concepts but never show how to build a complete real-world streaming system.
In this course, you will build a real-time data streaming pipeline from scratch using Apache Kafka on Microsoft Azure. Through practical, hands-on exercises, you will learn how to install, configure, and run Kafka in a cloud environment while implementing real data streaming scenarios.
This course focuses on learning by doing. Instead of only studying theory, you will deploy Kafka on Azure virtual machines, produce and consume streaming data using Python, and integrate your pipeline with Azure services such as Azure Data Lake and Azure Databricks.
By the end of the course, you will understand how real-time streaming architectures are built and how Apache Kafka is used in modern data engineering platforms.
What You Will Learn
Apache Kafka Fundamentals
Understand the architecture of Kafka, including brokers, topics, partitions, producers, and consumers.
Deploying Kafka on Azure
Learn how to create and configure Azure infrastructure to run Kafka clusters on virtual machines.
Hands-On Kafka Installation and Configuration
Install and configure Kafka and Zookeeper step-by-step and understand how they work together.
Building Real-Time Streaming Pipelines
Create streaming data workflows using Python producers and consumers.
Integration with Azure Data Platform
Stream data to Azure Data Lake and process it using Azure Databricks and Delta Tables.
End-to-End Streaming Project
Implement and run multiple real-world scenarios demonstrating how Kafka supports scalable real-time data processing.
Why Take This Course?
This course is designed around practical implementation, not just theoretical explanations.
You will:
• Deploy Apache Kafka in a real cloud environment
• Build a complete streaming pipeline from producer to analytics
• Work with industry tools such as Python, Azure Databricks, Delta Tables, and Data Lakes
• Understand how streaming architectures are implemented in real-world projects
By the end of the course, you will have built and tested a full streaming data architecture using Apache Kafka on Azure.
Who This Course Is For
This course is ideal for:
• Aspiring Data Engineers who want hands-on experience with streaming technologies
• Developers interested in real-time data processing and event-driven architectures
• Cloud engineers working with Azure and modern data platforms
• Anyone who wants to understand how Apache Kafka works in real-world data engineering scenarios
Who this course is for:
Have basic knowledge of Python or programming in general.
Are interested in learning hands-on about Apache Kafka, focusing on real-world applications.
Have some basics familiarity with Azure, Databricks, and a basic understanding of Unix.
Are looking to gain practical skills in streaming data and understand how Apache Kafka works in real-world business cases.
Course Curriculum
11 sections · 39 lessons · 3h 41m total
Why Learn by Doing?Free2:01
Top 5 Kafka Use Cases3:14
Brief Introduction to Apache KafkaFree11:04Quiz on IntroductionQuiz
Course Learning Objectives3:12
Prerequisites for This Course1:06
Overview of the Course Use Case2:25
Quiz on the use CaseQuiz
Setting Up Your Azure Account6:26
Essential Concepts for New Students in Azure4:03
Creating a Resource Group in Azure2:34
Creating a Virtual Machine for Kafka ServerFree5:40Testing Connection to Kafka Server VM2:13
Creating a Virtual Machine for Flask API Server4:29
Testing Connection to Flask API Server VM1:36
Quiz on Hands-On FoundationsQuiz
Configuring the Virtual Flask API Server10:50
Testing API Program on the Server Network3:38
Testing API Program Globally4:12
Python Flask API Tutorial: Code and Concepts5:37
Hands-On FoundationsQuiz
Creating a User in the Kafka Server5:21
Installing Java for Kafka3:30
Installing Apache Kafka2:28
High Level of Ubuntu Folder Structure1:47
Hands-On Foundations: Part 3Quiz
Setting Up Zookeeper Service8:35
Setting Up Kafka Service4:28
Starting Zookeeper and Kafka Services3:08
Creating a Kafka Topic10:21
Best Practices for Topic Creation3:17
Testing Producers and Consumers with Command-Line Tools6:53
Hands-on Foundation: Part-4Quiz
Consuming Data Using Python Application on Local Server7:21
Consuming Data Using Python Application from External Sources11:01
Scenario 1: Producing & Consuming CSV Files on Local Server9:23
Scenario 2: Producing & Consuming Data to Data Lake in Azure - Part 17:23
Scenario 2: Producing & Consuming Data to Data Lake in Azure - Part 211:09
Scenario 3: Creating Azure Databricks Workspace10:41
Scenario 3: Creating Databricks Compute Cluster4:02
Scenario 3: Consuming Data Using Databricks Application10:20
Scenario 3: Registering & Optimizing Delta Table10:09
Scenario 3: Versioning in Delta Table7:14
Course Conclusion & Next Steps1:11
Student Reviews1 review
5
D.M
13 Jul 2026
Excellent course!
€19.60€49.00
- 39 lessons
- 3h 41m of content
- beginner level
- Lifetime access