Course Information
Registration period
Year-round Recruitment
Course Level
Study Mode
Duration
4 Hour(s) 55 Minute(s)
Language
English
Taught by
Alexandra Abbas
Rating
Course Overview
Learn Apache Airflow step-by-step. Real-Life Data Pipelines & Quizzes Included. Learn by Doing!
Hi there, my name is Alexandra Abbas. I’m an Apache Airflow Contributor and a Google Cloud Certified Data Engineer & Architect with over 3 years experience as a Data Engineer.
Are you struggling to learn Apache Airflow on your own? In this course I will teach you Airflow in a practical manner, with every lecture comes a full coding screencast. By the end of the course you will be able to use Airflow professionally and add Airflow to your CV.
This course includes 50 lectures and more than 4 hours of video, quizzes, coding exercises as well as 2 major real-life projects that you can add to your Github portfolio!
You will learn:
How to install and set up Airflow on your machine
Basic and advanced Airflow concepts
How to develop complex real-life data pipelines
How to interact with Google Cloud from your Airflow instance
How to extend Airflow with custom operators and sensors
How to test Airflow pipelines and operators
How to monitor your Airflow instance using Prometheus and Grafana
How to track errors with Sentry
How to set up and run Airflow in production
This course is for beginners. You do not need any previous knowledge of Apache Airflow, Data Engineering or Google Cloud. We will start right at the beginning and work our way through step by step.
You will get lifetime access to over 50 lectures plus corresponding cheat sheets, datasets and code base for the lectures!
Course Content
- 9 section(s)
- 54 lecture(s)
- Section 1 Introduction
- Section 2 Getting Started with Apache Airflow
- Section 3 Core Concepts in Apache Airflow
- Section 4 Loading Data to a Data Warehouse
- Section 5 Analysing Data using PySpark
- Section 6 Extending Airflow with Custom Plugins
- Section 7 Testing Airflow DAGs
- Section 8 Airflow in Production
- Section 9 Finale
What You’ll Learn
- Core and Advanced Concepts in Airflow through Real-World Examples
- Architecture Components of Apache Airflow
- How to Set Up Connections to External Resources
- How to Load and Analyse Data in a Data Warehouse using Airflow
- How to Schedule PySpark jobs using Apache Airflow
- How to Extend Airflow with Custom Operators and Sensors
- How to Test Airflow DAGs and Operators
- How to Deploy Airflow Instances with Different Executors
- How to Set Up Error Tracking and Monitoring
Skills covered in this course
Reviews
-
TTapodhan Awatipatil
Excellent Illustration
-
MMarco Nieto
Depende mucho de Google cloud
-
KKhalil Zakout
clear explaination but I found struggle in understanding her voice & accent (especially that I am not a native speaker). But even with that I still found the course clear and organized.
-
JJacindha Saminathan
Thank yu so much! This course is good for learning the concepts. However, the version used in this course is bit outdated, so you will find few/more commands not working, the web UI looks different, you might need to check the current airflow documentation for the latest updates.
