Course Information
Registration period
Year-round Recruitment
Course Level
Study Mode
Duration
3 Hour(s) 14 Minute(s)
Language
English
Taught by
Faizan Qazi
Rating
Course Overview
Any Body Can Deploy Airflow. Be it Local Development or Production Deployment on AWS - EKS. It's as simple as it can be.
Note: As of 2026 Airflow 2.x has reached End of Life and no longer would be deployed in Production. This course can be used as a learning for deploying Helm Applications in a CI/CD manner.
In this course, you will learn how to:
Create a Script to seamlessly deploy Airflow for Local Development
Create your own Helm Chart
Template Scripts and YAML files
Configure Airflow using Helm
Create a Scalable EKS Cluster using eksctl
Deploy an ALB Ingress Controller for Load Balancing and accessing the Airflow UI
Mounting EFS for Persisting Kubernetes Executor Logs
Creating a Pipeline to Deploy Airflow using AWS Code Pipeline
Prerequisites:
Basic Knowledge about Airflow Components
Basic Knowledge about Kubernetes
Basic Knowledge about AWS
Familiar with working on an IDE
Dependencies: Linux OS, Windows, AWS Account (For Non-Local Deployment )
This course is lined up with the Production Guide of Apache Airflow to deploy a Highly Scalable Airflow on EKS and also follows official Documentation of AWS while deploying Services making sure you always stay up to date and acquire more detailed information whenever you want to.
Who this course is for:
If you are a DevOps Engineer and want to know the technical dependencies for deploying Airflow such as using EFS for using a Kubernetes Executor.
If you are a Data Engineer and want to use Airflow for Development but don't want to spend a huge amount of time learning how to configure it.
If you are a Full Stack Engineer and want to learn about various frameworks revolving around Airflow such as Helm, AWS EKS.
If you want to focus on development and get rid of all the frustration coming from trying to set up Airflow with all the core components.
Who this course isn't for: If you want to know what Airflow is or learn how to create DAGs or pipelines.
Note: This course includes using AWS resources such as EKS which is not free tier eligible.
Course Content
- 9 section(s)
- 20 lecture(s)
- Section 1 Getting Started
- Section 2 Local Airflow Deployment - Minikube
- Section 3 Creating Helm Chart
- Section 4 Airflow on AWS EKS
- Section 5 Exposing UI and Persisting Logs
- Section 6 CI/CD Pipeline
- Section 7 Airflow in Action
- Section 8 CleanUp
- Section 9 Enabling SSL Optional
What You’ll Learn
- Create your own Helm Chart, Deploy Airflow on AWS EKS, Create a Scalable Cluster, Create Pipeline for Deployment, Configure airflow using templates
Skills covered in this course
Reviews
-
UUdemylearner
What an amazing course! The instructor provided an excellent framework work creating deployment automations that can be used to automate anything if you truly understood. Although I ran into a few issues, I was able to figure everything out because I have devops experience and experience with AWS. I highly suggest you brush up on those to take full advantage of this course. I definitely recommend!!
-
MMarzieh Norouzi
It was great.
-
JJae Yeol Lee
Best updated course for airflow in EKS so far. The instructor's explanation to what he tries to deliver is superb, along with a clear accent. Strongly recommended
-
AAtif Imam
This is an excellent course to get step-by-step instructions to deploy airflow on EKS. Instructions are clear. The instructor is more than eager to help you if you get stuck. He helped me solve my error on one to one call.
