We may earn an affiliate commission when you visit our partners.
Course image
Data Soup

Learn the latest in AWS Glue - And learn to use it with other AWS resources.

In this growing world of data and growing cloud computing, it is necessary to have the core competency in cloud ETL tool also.  AWS Glue come with the in built Spark support, Data Quality and data curation using Data brew. The top technology, finance and insurance companies like JPMC, Vanguard, BCBS, Amazon, Capital One, Capgemini, FINRA  and more are all using AWS Glue  to run their ETL on PetaBytes scale of data everyday.

Read more

Learn the latest in AWS Glue - And learn to use it with other AWS resources.

In this growing world of data and growing cloud computing, it is necessary to have the core competency in cloud ETL tool also.  AWS Glue come with the in built Spark support, Data Quality and data curation using Data brew. The top technology, finance and insurance companies like JPMC, Vanguard, BCBS, Amazon, Capital One, Capgemini, FINRA  and more are all using AWS Glue  to run their ETL on PetaBytes scale of data everyday.

AWS Glue provides server less and scalable ETL solution where scripts can be written in Python, Spark and currently using Ray. It also provides the visual drag and drop options to create the ETL pipelines. As now more and more companies are migrating to cloud it has caused an explosion in demand for this skill. With the mastery of AWS Glue, you now have the ability to quickly become one of the most knowledgeable people in the job market.

This course will teach the basics in AWS Glue Data Catalog, AWS Glue Studio, AWS resources such as Once we've done that we'll go through how to use the Glue Data Quality, Glue Streaming and Glue Data Brew ETL pipelines. All along the way you'll have multiple labs to create all the resources and ETL pipelines using AWS console and CloudFormation templates that you put you right into a real world situation where you need to use your new skills to solve a real problem.

If you're ready to jump into the data engineering world of AWS Glue, this is the course for you.

Enroll now

What's inside

Learning objectives

  • Understanding of aws glue data catalog and creating aws glue database, glue tables and crawlers
  • Using aws glue studio, creating the etl pipeline along with scheduled triggers, conditional triggers and glue workflow
  • Kms, iam role, sns, s3 and other associated aws resources associated with glue. understanding and creation of all the resources
  • Understanding of aws glue data quality and creating the associated glue etl pipeline
  • Understanding aws glue data brew , creating the recipe, project and job to curate the dataset
  • Understanding the aws glue streaming, creating the stream using the python shell job and load the stream using the spark streaming
  • Different ways aws glue job can fail and debugging the failure and fix
  • Creating the aws resources for aws glue pipeline using the aws console and cloudformation

Syllabus

Introduction
Course Overview
Glue Pipeline Resources (Section 2,3 and 5) Overview
Glue Resources Setup Part 1 - IAM, KMS, SNS
Read more

We will make sure that required buckets ,files, CloudFormation templates and IAM Roles are in place before we create our first Glue Job.

Traffic lights

Read about what's good
what should give you pause
and possible dealbreakers
Provides hands-on experience with AWS Glue Data Catalog, Studio, Data Quality, and Data Brew, which are essential components for modern data engineering workflows
Explores integration with other AWS resources like KMS, IAM Role, SNS, and S3, which is crucial for building secure and scalable ETL pipelines
Covers debugging techniques for common AWS Glue job failures, which is invaluable for maintaining reliable data pipelines in production environments
Uses CloudFormation templates to create AWS resources, which is a best practice for infrastructure as code and ensures consistency across environments
Requires familiarity with AWS services like S3, IAM, and CloudFormation, which may necessitate additional learning for those new to the AWS ecosystem
Focuses on using AWS Glue with Python and Spark, so learners without prior experience in these technologies may face a steeper learning curve

Save this course

Create your own learning path. Save this course to your list so you can find it easily later.
Save

Reviews summary

Comprehensive aws glue hands-on masterclass

According to learners, this course provides a comprehensive and practical introduction to AWS Glue, covering key services and concepts essential for data engineering on AWS. Students particularly praise the numerous hands-on labs and practical demonstrations, finding them crucial for solidifying understanding and applying concepts effectively. The course is noted for its clear explanations and coverage of related AWS resources like IAM, S3, and CloudFormation, which helps integrate Glue into a broader AWS workflow. While some encountered minor challenges with environment setup, the overall consensus highlights the course's effectiveness in equipping learners with the skills needed to work with AWS Glue.
Instructor makes complex topics understandable.
"The instructor did a great job explaining complex topics in a clear and easy-to-understand manner."
"I found the explanations to be very clear and well-structured."
"Learning was easy because the concepts were broken down effectively."
Learn skills applicable to real-world jobs.
"This course focuses on practical skills that I can use immediately in my job."
"It felt like I was solving real-world data engineering problems."
"I learned how to apply AWS Glue effectively for typical use cases."
Includes Glue and related AWS services.
"It covers not just Glue but also relevant AWS services like S3, IAM, and CloudFormation which is very helpful."
"Appreciated learning how Glue integrates with other parts of AWS."
"The curriculum provides a good overview of the AWS ecosystem around Glue."
Practical exercises are key to learning.
"The course provides great hands-on labs that helped me understand the concepts by doing them."
"I really appreciated the labs, they made everything click and feel much more practical."
"Doing the exercises solidified my learning more than just watching lectures."
Initial setup can be challenging for some.
"I had some trouble setting up the environment correctly to run the labs."
"Getting the initial setup right required a bit of troubleshooting."
"Some steps in the environment setup could be more detailed or simplified."

Activities

Be better prepared before your course. Deepen your understanding during and after it. Supplement your coursework and achieve mastery of the topics covered in AWS Glue - The Complete Masterclass with these activities:
Review AWS Fundamentals
Reviewing AWS fundamentals will provide a solid foundation for understanding AWS Glue and its integration with other AWS services.
Show steps
  • Review the core AWS services like S3, IAM, and CloudWatch.
  • Understand basic cloud computing concepts.
  • Familiarize yourself with the AWS Management Console.
Brush up on Python and Spark
Practicing Python and Spark will enable you to write and debug AWS Glue ETL scripts more effectively.
Browse courses on Pyspark
Show steps
  • Practice writing basic Python scripts.
  • Learn the fundamentals of Apache Spark.
  • Explore PySpark for data manipulation.
Build a Simple ETL Pipeline with AWS Glue
Building a simple ETL pipeline will allow you to apply the concepts learned in the course and gain hands-on experience with AWS Glue.
Show steps
  • Set up an AWS account and configure the AWS CLI.
  • Create an S3 bucket to store your data.
  • Design and implement a basic ETL pipeline using AWS Glue Studio.
  • Monitor and debug your pipeline using AWS CloudWatch.
Four other activities
Expand to see all activities and additional details
Show all seven activities
Follow AWS Glue Tutorials
Following guided tutorials will provide step-by-step instructions and practical examples for using AWS Glue features.
Show steps
  • Find official AWS Glue tutorials on the AWS website.
  • Work through tutorials on creating crawlers and ETL jobs.
  • Experiment with different data sources and transformations.
Document Your AWS Glue Projects
Documenting your projects will reinforce your understanding of AWS Glue and help you share your knowledge with others.
Show steps
  • Create a README file for each AWS Glue project.
  • Describe the purpose, architecture, and implementation details of your project.
  • Include instructions on how to set up and run your project.
Contribute to AWS Glue Open Source Projects
Contributing to open source projects will allow you to collaborate with other developers and improve your AWS Glue skills.
Show steps
  • Find AWS Glue-related open source projects on GitHub.
  • Identify issues or features that you can contribute to.
  • Submit pull requests with your code changes.
Optimize an AWS Glue ETL Job for Performance
Optimizing an ETL job will provide practical experience in improving the efficiency and scalability of AWS Glue pipelines.
Show steps
  • Identify performance bottlenecks in an existing AWS Glue ETL job.
  • Experiment with different optimization techniques, such as partitioning and data filtering.
  • Measure the performance improvements and document your findings.

Career center

Learners who complete AWS Glue - The Complete Masterclass will develop knowledge and skills that may be useful to these careers:
ETL Developer
An ETL Developer specializes in designing, building, and maintaining ETL pipelines which extract, transform, and load data into data warehouses or data lakes. This course directly aligns with the work of an ETL developer; it provides hands on exercises with AWS Glue, a serverless ETL service. The course covers creation of ETL pipelines using AWS Glue Studio and how to manage data quality. It also covers use cases for Glue streaming. Anyone seeking to become an ETL developer will find this course useful due to its focus on cloud based ETL processes as well as debugging and failure resolution.
Data Engineer
A data engineer designs, builds, and maintains the infrastructure that allows for the collection, storage, processing, and analysis of large datasets. This course is ideal for an aspiring data engineer. The course provides practical experience with AWS Glue, a serverless ETL service which is commonly used by data engineers to build data pipelines and data lakes. The course covers key aspects of data engineering such as setting up data catalogs and crawlers. In addition, it covers data quality and data curation, which are critical for any successful data engineering project. This course provides hands-on experience using AWS Glue and related resources, which helps build a solid foundation for data engineering.
Data Integration Specialist
A data integration specialist is responsible for moving data between different systems. This course is directly applicable to the role of a data integration specialist. It gives practical experience with AWS Glue, a tool designed for ETL processes. This course also covers the AWS Glue Data Catalog, AWS Glue Studio, and how to create and manage ETL pipelines, which are all essential aspects of data integration. The course further covers how to integrate AWS Glue with other AWS resources. A data integration specialist will find this course useful.
Cloud Data Architect
A cloud data architect designs and oversees the implementation of data management systems in cloud environments. Aspiring cloud data architects may find this course beneficial, as it provides detailed exposure to AWS Glue, a crucial service for building data pipelines on the cloud. The course covers key topics including AWS Glue Data Catalog, AWS Glue Studio, and data quality. It also teaches how to integrate AWS Glue with other AWS resources, which is essential for building complex cloud-based data solutions. Familiarity with data quality, data curation and different ways AWS Glue jobs can fail helps a cloud data architect create robust and reliable data systems.
Analytics Engineer
An analytics engineer focuses on transforming raw data into usable formats for analysis and reporting. This course will be valuable for any analytics engineer. It provides a thorough overview of AWS Glue, a tool used for data transformation and pipeline creation. The course covers important skills such as data cataloging, setting up ETL pipelines within AWS Glue Studio, data quality checks, and data curation. An analytics engineer can use this knowledge to help produce reliable data sources for their organization. The practical skills provided in this course are key for the work of an analytics engineer.
Cloud Solutions Engineer
A cloud solutions engineer designs and implements cloud based solutions. This course will help those who seek to work as cloud solutions engineers by providing them with a solid grasp of AWS Glue, a core data integration service in AWS. The course will give you knowledge of data catalog, ETL pipeline creation, data quality management, and integration of Glue with other AWS resources. It allows a cloud solutions engineer to design comprehensive and effective data workflows within AWS. This course will help a cloud solutions engineer broaden the data processing aspect of their role.
Cloud Engineer
A cloud engineer is responsible for the design, implementation, and maintenance of cloud computing infrastructure. This course may be useful for those looking to become a cloud engineer. It provides practical experience with AWS Glue, which is often used in cloud environments for data processing. The hands-on labs on creating AWS resources, setting up IAM roles, and working with CloudFormation templates also contribute to essential cloud engineering skills. The course provides a foundation in how data is managed and moved within AWS, which is a frequent concern for cloud engineers.
Solutions Architect
A solutions architect designs and plans complex IT solutions that meet business needs. This course may be useful for a solutions architect looking to enhance their skills. It covers using AWS Glue to build data pipelines, which is often an important part of data intensive solutions. It also covers using other AWS resources with Glue. The course also provides familiarity with data quality and data curation, which are important aspects of many solutions. A solutions architect needs to be able to recommend solutions that integrate well with data systems, and understanding Glue helps in that goal.
Machine Learning Engineer
A machine learning engineer develops and deploys machine learning models. Aspiring machine learning engineers may find this course useful. It teaches how to use AWS Glue to prepare data for machine learning applications. It gives hands-on experience using AWS Glue Studio and data quality functions. Understanding these concepts is helpful in creating reliable datasets for building and training machine learning models. This course may be useful to a machine learning engineer seeking to expand their data engineering skills.
Data Analyst
A data analyst uses data to identify trends, provide insights, and support decision-making. This course may be helpful to a data analyst looking to learn more about how data is prepared, which happens before analysis. It provides an overview of how data is extracted, transformed and loaded and how it is managed using AWS Glue. The course also teaches AWS Glue Data Brew for data curation, and AWS Glue Data Quality features, both of which help a data analyst work with accurate and reliable data. The course provides direct experience with the processes that a data analyst should be familiar with to be successful.
Business Intelligence Developer
A business intelligence developer designs and creates systems and reports that help businesses make better decisions. This course may interest a business intelligence developer. It provides a foundation in how data is extracted, transformed, and loaded, particularly through AWS Glue, which is critical in building business intelligence solutions. The course also covers data quality and data curation using Data Brew, ensuring the accuracy of data used for reporting. A business intelligence developer can use the data pipelines created by Glue to populate their systems.
Database Administrator
A database administrator manages the performance, integrity, and security of databases. This course may be relevant for database administrators. It covers how AWS Glue manages data catalogs and crawlers to discover and organize data, which is a key function for database administration. The course also covers setting up database connections with the AWS Glue Data Catalog, which is helpful for a database administrator to understand. Though a database administrator may not use Glue directly, knowledge of how Glue functions helps them manage data efficiently.
Software Developer
A software developer designs, develops, and maintains software applications. This course may be helpful to a software developer who wants to expand skills in data processing, using AWS Glue. The course covers how to create and manage data pipelines specifically for AWS cloud environments, with hands-on labs that build experience. The course also covers using Python for writing ETL scripts, which helps to build a software developer's ability to create data driven applications. Software developers seeking to incorporate data management into their work may find this course useful.
System Administrator
A system administrator manages and maintains computer systems including cloud based systems. This course may be useful for a system administrator who wants to build skill with cloud data services. This course covers how AWS Glue is configured and maintained and gives a solid understanding of data pipelines, ETL processes, and the related AWS resources. It also provides information about how AWS Glue integrates with other AWS services, which is important for good cloud based system administration. The course helps a system administrator better maintain cloud based data systems.
Technical Project Manager
A technical project manager oversees the planning, execution, and delivery of technical projects. This course may be useful for technical project managers working in data intensive projects. It provides an overview of AWS Glue and how it is used to set up data integration and ETL processes. This course introduces AWS Glue components including Data Catalog, AWS Glue Studio, Data Quality, and Data Brew. This background helps a technical project manager understand the work that data engineers and ETL developers do, which aids in better project planning and management.

Reading list

We've selected 50 books that we think will supplement your learning. Use these to develop background knowledge, enrich your coursework, and gain a deeper understanding of the topics covered in AWS Glue - The Complete Masterclass.
Comprehensive reference guide to Spark, covering advanced topics such as performance tuning, security, and machine learning. It is suitable for experienced Spark users who want to deepen their knowledge.
Is specifically dedicated to the ETL process within a data warehousing context. It provides practical techniques and best practices for extracting, cleaning, transforming, and loading data. It's an excellent resource for understanding the intricacies of building robust ETL systems and is considered a key text for ETL developers and architects. This book is highly valuable as a reference tool for practitioners.
Considered a modern classic, this book delves into the fundamental trade-offs and concepts behind building robust, scalable, and maintainable data systems. While not exclusively about data engineering, its in-depth coverage of distributed systems, databases, and data processing patterns is essential for any data professional looking to deepen their understanding. It is highly valuable for undergraduate and graduate students, as well as working professionals.
The second edition of a highly-rated book, this version is updated to cover the latest features and best practices in AWS CloudFormation. It's a comprehensive guide for building resilient and production-ready infrastructure, suitable for engineers looking to deepen their understanding and extend CloudFormation capabilities with features like modules and macros.
Published recently, this book offers a comprehensive guide from foundational concepts to advanced topics like continuous delivery and template design. It's a versatile resource for all skill levels looking to master CloudFormation and IaC, providing practical examples and insights for automating, optimizing, and securing AWS infrastructures.
Gathers hundreds of battle-tested recipes covering network programming, memory management, data structures, and functional decorators for veteran application developers.
Delivers the canonical blueprint for numeric analysis from the creator of pandas, thoroughly detailing NumPy structures, data cleaning, and high-speed transformations.
Introduces clean architecture, domain-driven design, and event-driven microservices to Python developers, demonstrating repository patterns and dependency inversion.
Provides a solid introduction to the field of data engineering, covering the entire data lifecycle from data generation to consumption. ETL core component of this lifecycle, and the book provides context and foundational knowledge for understanding its role within a larger data ecosystem. It's a great starting point for anyone entering the field.
Demystifies programming for practical utility, guiding beginners through real-world automation projects including web scraping, spreadsheet generation, and file audits.
While this book has a broader scope than AWS Glue, it provides valuable insights into the concepts and best practices of big data integration.
Covers the latest AWS certification exam blueprint and provides comprehensive coverage of all exam topics. It is an excellent resource for anyone preparing for the AWS Certified Solutions Architect - Professional exam.
Covers the latest AWS certification exam blueprint and provides comprehensive coverage of all exam topics. It is an excellent resource for anyone preparing for the AWS Certified DevOps Engineer - Professional exam.
Provides a comprehensive overview of data quality, covering the key concepts, methodologies, and best practices. It valuable resource for anyone looking to improve the quality of their data.
Provides a comprehensive overview of data quality, covering the key concepts, methodologies, and best practices. It valuable resource for anyone looking to improve the quality of their data.
Provides a comprehensive overview of data quality, covering the key concepts, methodologies, and best practices. It valuable resource for anyone looking to improve the quality of their data.
Provides a comprehensive overview of Spark, covering its core concepts, programming models, and use cases. It is suitable for beginners who want to learn the fundamentals of Spark.
Focuses on static typing, structural subtyping, and defensive design techniques, demonstrating how modern type annotations prevent regressions in enterprise codebases.
This guide demystifies AWS CloudFormation for both beginners and seasoned IT professionals. It covers foundational concepts, advanced features, template design, performance optimization, and security enhancement. It's a useful reference for streamlining cloud infrastructure management with practical examples and real-world use cases.
Airflow popular platform for orchestrating complex data pipelines, including ETL workflows. provides a practical guide to using Airflow for building, scheduling, and monitoring data pipelines. It's highly relevant for data engineers and developers managing ETL processes in a production environment.
Unpacks professional testing methodologies using pytest, explaining fixture management, parameterized tests, coverage tracking, and automated CI test execution.
Apache Spark widely used engine for big data processing. provides a comprehensive introduction to Spark, covering its core concepts and APIs. It's essential for anyone working with big data pipelines and aligns with courses mentioning Spark. The 3rd edition, published in 2020, covers recent features and improvements.
Focuses on implementing data engineering concepts, including ETL, using Python. It's a practical guide for those who want to build data pipelines with a popular programming language. It covers extracting, transforming, and loading data using Python libraries and tools. This book is valuable for hands-on learners and professionals using Python for ETL tasks.
Investigates advanced software craft, detailing packaging distribution, bytecode internals, scaling architectures, and maintainability across large distributed systems.
Aligning with the Google Cloud focused course titles, this book provides guidance on performing data engineering tasks on GCP. It's a valuable resource for those preparing for the Google Cloud Professional Data Engineer exam or working with GCP data services. It covers the relevant tools and services offered by Google Cloud.
Establishes a foundation for applying software engineering best practices to infrastructure automation on AWS, with a focus on CloudFormation and the AWS Cloud Development Kit (CDK). It delves into IaC concepts, surrounding AWS tools, and integrated tools like Troposphere and Sceptre. It's valuable for understanding the broader IaC landscape on AWS.
Bridges volumetric point cloud analysis with Python, teaching LiDAR processing, spatial meshing, and 3D machine vision using modern scientific computing toolchains.
Presents a welcoming, foundational ramp into computational logic and programming, establishing syntax literacy, object modeling, and error handling for total beginners.
Provides 50 focused exercise routines and guided breakdowns designed to build instinctive muscle memory across collections, functional pipelines, algorithms, and file I/O.
This report focuses specifically on troubleshooting and resolving issues with CloudFormation Change Sets. It's a specialized resource for users who are already working with CloudFormation and need to understand common challenges and their resolutions. It's highly practical for experienced users and can serve as a valuable reference for debugging.
Understanding how databases work internally is crucial for data engineers. provides a detailed look into the design and implementation of databases and distributed data systems. It's a highly technical book, best suited for graduate students and experienced professionals who want to deepen their understanding of the foundational technologies they work with.
Serving as a fundamental guide, this book introduces basic IaC concepts and the AWS services needed for automation and infrastructure management using CloudFormation. It covers template concepts, mappings, conditions, and managing the entire AWS infrastructure with templates. It's well-suited for cloud engineers, system administrators, and architects new to CloudFormation.
Dbt (data build tool) popular tool in the modern data stack for transforming data in the warehouse. focuses on using dbt for data engineering workflows, aligning with courses mentioning dbt. It's particularly relevant for professionals and graduate students working with cloud data warehouses and ELT processes.
Tackles the full lifecycle of shipping models into production, covering feature store development, container packaging, drift detection, and continuous retraining.
Covers the fundamental principles and best practices for building scalable data systems in the big data era. It provides a broader perspective on designing data architectures that can handle large volumes of data and high traffic, valuable for undergraduates, graduates, and professionals involved in system design.
Published in early 2025, this book focuses on transforming IaC with AWS CDK for simplifying, securing, and scaling cloud operations. It covers CDK fundamentals, multi-stack projects, CI/CD pipelines, and best practices. It's a contemporary resource for those interested in using CDK as their primary IaC tool on AWS.
SQL fundamental language for data manipulation in ETL processes. highlights common mistakes and inefficient practices in SQL programming, which can directly impact the performance and maintainability of ETL code. It's a valuable resource for anyone writing SQL for ETL.
Provides a comprehensive overview of AWS security best practices and covers topics such as identity and access management, data protection, and network security. It valuable resource for anyone looking to secure their AWS environment.
SQL foundational skill for data engineers. goes beyond basic SQL, covering advanced techniques for data analysis and transformation. It's a useful reference for anyone looking to deepen their SQL skills for data engineering tasks, relevant for all audience levels, especially those focusing on data manipulation and analysis. Published in 2021, it offers recent perspectives on SQL for data professionals.
Effective ETL relies heavily on good data governance and master data management. provides a thorough understanding of these crucial concepts. It's valuable for professionals who need to understand the broader data landscape and how to ensure data quality and consistency within their ETL processes.
Provides a practical guide to data quality improvement. It covers the different techniques that can be used to improve data quality, and it provides advice on how to implement a data quality improvement program.
Another foundational book from W.H. Inmon, focusing on the enterprise data warehouse. It provides a different perspective on data warehousing compared to the Kimball approach, which can be beneficial for a well-rounded understanding. It discusses the architecture and design of data warehouses at an enterprise level, relevant to the scope and complexity of ETL.
Is written for data scientists who want to use Spark for machine learning and data analysis. It covers topics such as data preparation, feature engineering, and model evaluation.
Provides a hands-on guide to building real-time data analytics applications using Spark. It covers topics such as data ingestion, data processing, and visualization.
Covers the Spark Streaming module in detail. It is suitable for developers who need to build streaming data applications using Spark.
Covers the use of Spark for big data analytics. It is suitable for data analysts and engineers who need to process large volumes of data.

Share

Help others find this course page by sharing it with your friends and followers:

Similar courses

Udemy Buyer Protection & Guarantee

Verified partner policies & purchase protections

Global Marketplace Leader
Free Trial & Audit

Free Lecture Previews

Free preview video lectures available for all courses; optional 7-day free trial on Personal Plan subscriptions (cancel before trial ends to avoid conversion).

Return & Refund Policy

30-Day Money-Back Guarantee

30-day money-back guarantee on all eligible individual course purchases (provided course content has not been substantially consumed or downloaded). Subscription fees are non-refundable once billed.

Buyer Protections

Verified Academic & Industry Partner

Lifetime access to purchased individual courses and future updates, verifiable certificate of completion, and direct student Q&A forums.

Key Purchase Protections
30-day 100% money-back guarantee on course purchases
Lifetime access on web, mobile, and offline
Certificate of completion included with purchase
Direct instructor Q&A and active student community
OpenCourser Verified Partner Policy details last reviewed: 2026-10-22
Our mission

OpenCourser helps millions of learners each year. People visit us to learn workspace skills, ace their exams, and nurture their curiosity.

Our extensive catalog contains over 50,000 courses and twice as many books. Browse by search, by topic, or even by career interests. We'll match you to the right resources quickly.

Find this site helpful? Tell a friend about us.

Affiliate disclosure

We're supported by our community of learners. When you purchase or subscribe to courses and programs or purchase books, we may earn a commission from our partners.

Your purchases help us maintain our catalog and keep our servers humming without ads.

Thank you for supporting OpenCourser.

© 2016 - 2025 OpenCourser