Course Information
Registration period
Year-round Recruitment
Course Level
Study Mode
Duration
3 Hour(s) 41 Minute(s)
Language
English
Taught by
Mohammed Al-moayed
Rating
Course Overview
From Setup to Streaming: Build Real-World Apache Kafka Solutions on Azure
Most Apache Kafka courses explain concepts but never show how to build a complete real-world streaming system.
In this course, you will build a real-time data streaming pipeline from scratch using Apache Kafka on Microsoft Azure. Through practical, hands-on exercises, you will learn how to install, configure, and run Kafka in a cloud environment while implementing real data streaming scenarios.
This course focuses on learning by doing. Instead of only studying theory, you will deploy Kafka on Azure virtual machines, produce and consume streaming data using Python, and integrate your pipeline with Azure services such as Azure Data Lake and Azure Databricks.
By the end of the course, you will understand how real-time streaming architectures are built and how Apache Kafka is used in modern data engineering platforms.
What You Will Learn
Apache Kafka Fundamentals
Understand the architecture of Kafka, including brokers, topics, partitions, producers, and consumers.
Deploying Kafka on Azure
Learn how to create and configure Azure infrastructure to run Kafka clusters on virtual machines.
Hands-On Kafka Installation and Configuration
Install and configure Kafka and Zookeeper step-by-step and understand how they work together.
Building Real-Time Streaming Pipelines
Create streaming data workflows using Python producers and consumers.
Integration with Azure Data Platform
Stream data to Azure Data Lake and process it using Azure Databricks and Delta Tables.
End-to-End Streaming Project
Implement and run multiple real-world scenarios demonstrating how Kafka supports scalable real-time data processing.
Why Take This Course?
This course is designed around practical implementation, not just theoretical explanations.
You will:
• Deploy Apache Kafka in a real cloud environment
• Build a complete streaming pipeline from producer to analytics
• Work with industry tools such as Python, Azure Databricks, Delta Tables, and Data Lakes
• Understand how streaming architectures are implemented in real-world projects
By the end of the course, you will have built and tested a full streaming data architecture using Apache Kafka on Azure.
Who This Course Is For
This course is ideal for:
• Aspiring Data Engineers who want hands-on experience with streaming technologies
• Developers interested in real-time data processing and event-driven architectures
• Cloud engineers working with Azure and modern data platforms
• Anyone who wants to understand how Apache Kafka works in real-world data engineering scenarios
Course Content
- 11 section(s)
- 39 lecture(s)
- Section 1 Course Kickoff
- Section 2 Course Preparation and Expectations
- Section 3 Hands-On Foundations: Part 1
- Section 4 Hands-On Foundations: Part 2
- Section 5 Hands-On Foundations: Part 3
- Section 6 Hands-On Foundations: Part 4
- Section 7 Python Data Consumption
- Section 8 Implementing Use Case Scenarios: Part 1
- Section 9 Implementing Use Case Scenarios-part 2
- Section 10 Running all scenarios
- Section 11 Course Conclusion & Next Steps
What You’ll Learn
- Understand and Set Up Apache Kafka, Implement Kafka Services and Topics, Use Python to Consume Data from Kafka, Use Python to produce Data to Kafka Topic, Apply Apache Kafka in Real-World Scenarios
Skills covered in this course
Reviews
-
PPavankumar Mushunuri
Well articulated to showcase Kafka architecture and the data flowing to the publishers and the respective subscribers. Also how data will flow to multiple consumers. Thanks.
-
MM Paul
Although the course covers a wide variety of topics it does not go deeper enough and looks more like a demo what Kafka streaming can do First suggestions , please update teh course with Kafka Version 4 specially how etc Kraft is implemented and used in Kafka stack Second ( may be only for me ) It was very hard to read the screen on the demos as it was so small even in may 15 Inch MacBook Thirrd may be add some basics coverage on real world CDC in db world
-
KKhalid Almansour
The course is truly amazing. Despite the vastness of the topics it covered, the explanations were clear, well-structured, and easy to follow. The Python code examples were clean and ready to use, which made the learning experience even better and easier. I really enjoyed the course and followed it step by step. Hopefully, this course will open the door to more learning and development, especially in Big Data and Machine Learning. Many thanks to you, Mr. Mohammed!
-
FFrank Pavelec
So far it has been great
