Apache Airflow on AWS EKS
The Hands-On Guide
Struggling to set up Airflow on AWS EKS?
You are at the right place.
With more than 10,000 students, I got many feedbacks about how difficult it is to configure Airflow on AWS with the official Helm chart.
Guess what? You are about to learn everything you need to set up a production-ready architecture for Apache Airflow on AWS EKS
This course is designed to guide you through the different steps of creating a real world architecture:
Configuring the EKS cluster following best practices
Deploying automatically changes with GitOps
Using Helm to configure and set up Airflow on Kubernetes
Configuring the official Helm chart of Airflow to use the Kubernetes Executor and many different features
Deploying DAGs in Airflow with Git-Sync and AWS EFS
Deploying DAGs/Airflow through CI/CD pipelines with AWS CodePipeline
Testing your DAGs automatically
Securing your credentials and sensitive data in a Secret Backend
Enabling remote logging with AWS S3
Creating 3 different environments dev/staging and prod
Making the production environment scalable and highly available
and more.
WARNING:
The course is not meant to learn the basic of Airflow, you must be already familiar with it.
If you already know Kubernetes/Docker/AWS your learning will be easier, but no worries I explain everything you need.
YOU WON'T learn how to interact with AWS in your DAGs. This course is about designing an architecture not about DAGs.
The course is NOT free-tier eligible as we are going to use many AWS services and set up a real world architecture.
Get a Reminder
Get a Reminder
Similar Courses
What people are saying
great content
Great content Marc... not for beginners.
deploying airflow on eks
You'll not only learn about deploying Airflow on EKS but you'll learn systems design, containers, and software engineering best practices.
provides some practical application
Thanks This course has a lot of great content/information and I like how it's building towards something, while each step provides some practical application all by itself.
software engineering best practices
data engineering domain
Very nice work This is a very important course in the industry since the area of data pipelines is such a hot topic in the Data Engineering domain.
it was good
It was good.
building towards something
each step provides
needed to understand
it is exactly what i needed to understand more about aws and kubernetes infrastructure.
eks but
top notch
Top notch course and support from Marc!
always awesome
Marc is always awesome.
Careers
An overview of related careers and their average salaries in the US. Bars indicate income percentile.
Sports Official 1 $28k
Intramural Basketball Official $35k
Assistant Youth Sports Official $41k
Teach in Thailand and CIEE Official Blogger $50k
Court official $52k
Athletic Official/Referee $56k
Associate Building Official $62k
Football Official (Umpire) $70k
Acting Building Official $70k
Campus Building Official $80k
Supervisor Official Court Reporter $88k
Privacy Official $105k
Write a review
Your opinion matters. Tell us what you think.
Please login to leave a review
Similar Courses
Sorted by relevance
Like this course?
Here's what to do next:
- Save this course for later
- Get more details from the course provider
- Enroll in this course