OpenCourser brand icon
Sign in
We may earn an affiliate commission when you visit our partners.
Course image
Udemy logo

DP-203 - Data Engineering on Microsoft Azure

Alan Rodrigues

Release v2.0 - May 2023

The entire course has been updated and refreshed. All chapters have been re-recorded. This has been done to ensure that all contents now reflect the most recent changes to the services on the Azure platform.

Read more

Release v2.0 - May 2023

The entire course has been updated and refreshed. All chapters have been re-recorded. This has been done to ensure that all contents now reflect the most recent changes to the services on the Azure platform.

All course contents have also been aligned as per any changes to the course objectives.

Additional questions have been also added to the Practice Tests.

Release v1.0 Initial Release

This course is designed for students who want to attain the "Microsoft Certified: Azure Data Engineer Associate" certification

This course has contents for the Exam DP-203

The objectives covered in this course are

  • Design and implement data storage (40-45%)

  • Design and develop data processing (25-30%)

  • Design and implement data security (10-15%)

  • Monitor and optimize data storage and data processing (10-15%)

In this course students will learn about the various Azure services that pertain to Data Engineering. Some of the important aspects that students will learn include the following

  • What is the purpose of an Azure Data Lake Gen 2 storage account

  • Basics on Transact-SQL commands

  • How to work with Azure Synapse. This will include building a data warehouse into a dedicated SQL Pool.

  • How to build an ETL pipeline with the help of Azure Data Factory. There will be various scenarios on how to create mapping data flows.

  • How to stream data with the use of Azure Stream Analytics. You can see how SQL commands can be used for your streaming data.

  • Basics on the Scala programming language, and SPARK

  • How to work with SPARK, Scala in Azure Databricks. We will see how to work with Notebooks. We will also see how to stream data into Azure Databricks.

  • The different security measures and monitoring aspects to consider when working with Azure services

Enroll now

14 deals to help you save

We found 14 deals and offers that may be relevant to this course.
Save money when you learn. All coupon codes, vouchers, and discounts are applied automatically unless otherwise noted.
Use code at checkout. Valid until December 3
Cyber Monday
Develop career-changing skills with these steeply discounted courses.
Up to
85%
off
BFCMSALE24
Use code at checkout. Only 19 hours left!
Black Friday
Develop career-changing skills with these steeply discounted courses.
Up to
85%
off
BFCMSALE24
Use code at checkout. Valid until December 1
For new customers
Save when you purchase top courses. For new customers only.
Special Offer
UDEAFNULP2024
Valid for a limited time only
Future-proof your career
Access O'Reilly books, live events, courses, and more. Save with an annual subscription.
Take
15%
off

What's inside

Learning objectives

  • Students will be better prepared for the dp-203 certification exam
  • Students will learn the various azure services that pertain to data engineering

Syllabus

UPDATED - Introduction

This chapters looks into the course structure

Introduction to Cloud Computing
Azure and the Azure Free Account
Read more
Creating an Azure Free Account

This chapters looks into a quick tour of the Azure Portal

Quick note - Security Defaults
PDF Resources Download
This section focuses on the basics of Design and implement data storage

This chapters looks into understanding data

This chapters looks into example of data storage

NOTE - Installing Visual Studio 2022
It's time to use the cloud

This chapters looks into a lab on Azure storage accounts

This chapters looks into Azure SQL databases

This chapters looks into a lab on an application connecting to an Azure storage account

Thoughts on Udemy storing data

This chapters looks into Azure Data Lake Gen-2 storage accounts

This chapters looks into a Lab on creating Azure Data Lake Gen2 storage accounts

This chapters looks into the different file formats

Lab - Uploading data to Azure Data Lake Gen2

This chapters looks into using Power BI to view your data

Note - Installing PowerBI

This chapters looks into the costing aspect

This section looks into Design and implement data storage on Transact-SQL

This chapters looks has all the code for this section

This chapters looks into the section introduction

This chapters looks into the internals of a database

This chapters looks into setting up a new Azure SQL database

Lab - Setting up SQL Server Management Studio

This chapters looks into the T-SQL Select clause

This chapters looks into the T-SQL Where clause

This chapters looks into the T-SQL Order by clause

This chapters looks into the T-SQL Aggregate functions

This chapters looks into the T-SQL Group by clause

This chapters looks into the T-SQL Having clause

This chapters looks into the primary and foreign keys

This chapters looks into the T-SQL creating tables

This chapters looks into the T-SQL Table joins

This section focuses on Azure Synapse Analytics

This chapters looks into the Section introduction

The pre-requisite resources we require
What have we seen so far
A data warehouse

This chapters looks into Azure Synapse Analytics

This chapters looks into creating an Azure Synapse workspace

This chapters looks into the different compute options

Let's open up some data

This chapters looks into a lab on external tables - Part 1

This chapters looks into a lab on external tables - Part 2

Lab - External Tables - Parquet file
Lab - External Tables - Multiple Parquet files
Lab - OPENROWSET

This chapters looks into creating a SQL Pool

Lab - SQL Pool - External Tables - Parquet
Lab - SQL Pool - External Tables - CSV
Pausing the SQL Pool

This chapters looks into loading data into a Dedicated SQL Pool

This chapters looks into  copying data using the COPY command

This chapters looks into copying data using the COPY command with Parquet data

Loading data - Bulk Load - Quick Note

This chapters looks into loading data using Polybase

Lab - Loading data - Pipelines - Storage accounts
Lab - Loading data - Pipelines - Azure SQL database

This chapters looks into designing a data warehouse

This chapters looks into dimension tables

This chapters looks into building a fact table

This chapters looks into building a dimension table

This chapters looks into transferring data into the SQL Pool

This chapters looks into Power BI for the star schema

This chapters looks into understanding Azure Synapse Architecture

This chapters looks into understanding table types

About the staging area
Compute to data distribution
Note on the SQL pools

This chapters looks into understanding round-robin tables

This chapters looks into hash-distributed tables

This chapters looks into creating replicated tables

This chapters looks into designing your tables

Hash distribution for multiple columns
Lab - Example when using the right distributions for your tables
Good Practices when designing tables

This chapters looks into surrogate keys for dimension tables

This chapters looks into slowly changing dimensions

Indexes
Note on creating Indexes
Which Method to choose
Creating a heap table
Partitions in Azure Synapse
Lab - Creating a table with partitions
Lab - Switching partitions

This chapters looks into reading JSON files

This chapters looks into windowing functions

This chapters looks into the case statement

This chapters looks into a quick note on what we are taking forward

This chapters looks into the Spark pool

This section focuses on Azure Data Factory

This chapters looks into a section introduction

Code for this section

Good to know

Know what's good
, what to watch for
, and possible dealbreakers
Develops core data science concepts for learners to attain Microsoft Certified: Azure Data Engineer Associate certification
Taught by Alan Rodrigues, an instructor recognized for his work in Azure Data Engineering
Provides hands-on experience through labs and interactive materials, creating a practical learning opportunity
Covers diverse Azure services and tools, relevant to the industry, for comprehensive data engineering education

Save this course

Save DP-203 - Data Engineering on Microsoft Azure to your list so you can find it easily later:
Save

Activities

Be better prepared before your course. Deepen your understanding during and after it. Supplement your coursework and achieve mastery of the topics covered in DP-203 - Data Engineering on Microsoft Azure with these activities:
Review Cloud Computing Fundamentals
Revisit the basics of cloud computing, including concepts like cloud models, services, and security, ensuring a solid foundation for understanding Azure data engineering services.
Browse courses on Cloud Computing Fundamentals
Show steps
  • Read articles or watch videos on cloud computing concepts.
  • Review Microsoft's Azure Fundamentals documentation.
  • Take practice quizzes or tests on cloud computing fundamentals.
Review SQL
Review SQL fundamentals to refresh and solidify your understanding of database concepts and syntax, making it easier to follow along with the course material.
Browse courses on Structured Query Language
Show steps
  • Go through online tutorials and resources on SQL syntax and commands.
  • Practice writing SQL queries using an online SQL editor or a local database management system.
  • Review examples of SQL queries used in real-world applications.
Azure Data Engineering Tutorials
Explore hands-on tutorials and exercises provided by Microsoft to gain practical experience with Azure data services and tools, complementing the theoretical concepts covered in the course.
Show steps
  • Follow step-by-step tutorials on Azure Data Factory, Azure Synapse Analytics, and other Azure data services.
  • Complete interactive exercises and challenges to reinforce your understanding of data engineering concepts.
  • Refer to the Azure documentation and other resources for additional guidance.
Two other activities
Expand to see all activities and additional details
Show all five activities
Data Transformation Drills
Engage in repetitive exercises and challenges involving data transformation tasks, improving your proficiency in handling and manipulating data, which is essential for data engineering.
Browse courses on Data Transformation
Show steps
  • Use online platforms or textbooks to find data transformation exercises.
  • Practice transforming data from various sources, such as CSV, JSON, and XML.
  • Apply data cleaning techniques to handle missing values, outliers, and data inconsistencies.
Contribute to Open-Source Data Engineering Projects
Contribute to open-source data engineering projects on platforms like GitHub, enhancing your practical skills, collaborating with others, and gaining valuable experience in the field.
Browse courses on Cloud Data Engineering
Show steps
  • Find open-source data engineering projects on GitHub or other code-hosting platforms.
  • Identify issues or areas where you can contribute.
  • Submit pull requests with code contributions, bug fixes, or documentation improvements.

Career center

Learners who complete DP-203 - Data Engineering on Microsoft Azure will develop knowledge and skills that may be useful to these careers:
Data Engineer
The DP-203 certification exam, which this course prepares you for, is the industry standard for Data Engineers, so it can help you land a job in this field and succeed at it. The course will also help you familiarize yourself with the various Azure services pertaining to Data Engineering, which may be useful when applying for a job as a Data Engineer.
See salaries and explore the career path for Data Engineer
Data Architect
This certification, as well as the skills covered in the course, are relevant to a role as a Data Architect. To be successful in this role, you will need to have a strong understanding of data storage and processing, which this course can help you build. Additionally, the course will help you familiarize yourself with the various Azure services pertaining to Data Engineering, which can be very useful when working as a Data Architect.
See salaries and explore the career path for Data Architect
Data Scientist
This course will help you build a foundation for a career as a Data Scientist. The course will introduce you to the various Azure services pertaining to Data Engineering, which can be very useful when working as a Data Scientist. Additionally, the course will help you develop skills in data storage, data processing, data security, and data optimization, all of which are essential for a successful career as a Data Scientist.
See salaries and explore the career path for Data Scientist
Database Administrator
The skills you will learn in this course will prepare you for a role as a Database Administrator. The course will help you build a foundation in data storage and data security, which are essential for a successful career as a Database Administrator. Additionally, the course will help you familiarize yourself with the various Azure services pertaining to Data Engineering, which can be very useful when working as a Database Administrator.
See salaries and explore the career path for Database Administrator
Software Engineer
This course may be useful for those interested in a career as a Software Engineer. The course will help you build a foundation in data storage, data processing, and data security, all of which are essential for a successful career as a Software Engineer. Additionally, the course will help you familiarize yourself with the various Azure services pertaining to Data Engineering, which can be very useful when working as a Software Engineer.
See salaries and explore the career path for Software Engineer
Cloud Engineer
This course may be useful for those interested in a career as a Cloud Engineer. The course will help you build a foundation in data storage, data processing, and data security, all of which are essential for a successful career as a Cloud Engineer. Additionally, the course will help you familiarize yourself with the various Azure services pertaining to Data Engineering, which can be very useful when working as a Cloud Engineer.
See salaries and explore the career path for Cloud Engineer
Business Analyst
The skills you will learn in this course will help you build a foundation for a career as a Business Analyst. The course will help you develop skills in data storage, data processing, data security, and data optimization, all of which are essential for a successful career as a Business Analyst. Additionally, the course will help you familiarize yourself with the various Azure services pertaining to Data Engineering, which can be very useful when working as a Business Analyst.
See salaries and explore the career path for Business Analyst
Data Analyst
This course may be useful for those interested in a career as a Data Analyst. The course will help you build a foundation in data storage, data processing, and data security, all of which are essential for a successful career as a Data Analyst. Additionally, the course will help you familiarize yourself with the various Azure services pertaining to Data Engineering, which can be very useful when working as a Data Analyst.
See salaries and explore the career path for Data Analyst
IT Manager
The skills you will learn in this course will help you build a foundation for a career as an IT Manager. The course will help you develop skills in data storage, data processing, data security, and data optimization, all of which are essential for a successful career as an IT Manager. Additionally, the course will help you familiarize yourself with the various Azure services pertaining to Data Engineering, which can be very useful when working as an IT Manager.
See salaries and explore the career path for IT Manager
Systems Analyst
This course may be useful for those interested in a career as a Systems Analyst. The course will help you build a foundation in data storage, data processing, and data security, all of which are essential for a successful career as a Systems Analyst. Additionally, the course will help you familiarize yourself with the various Azure services pertaining to Data Engineering, which can be very useful when working as a Systems Analyst.
See salaries and explore the career path for Systems Analyst
Database Developer
The skills you will learn in this course may be helpful for a career as a Database Developer. The course will help you build a foundation in data storage, data processing, and data security, which are all essential for a successful career as a Database Developer. Additionally, the course will help you familiarize yourself with the various Azure services pertaining to Data Engineering, which can be very useful when working as a Database Developer.
See salaries and explore the career path for Database Developer
Software Developer
This course may be useful for those interested in a career as a Software Developer. The course will help you build a foundation in data storage, data processing, and data security, all of which are essential for a successful career as a Software Developer. Additionally, the course will help you familiarize yourself with the various Azure services pertaining to Data Engineering, which can be very useful when working as a Software Developer.
See salaries and explore the career path for Software Developer
IT Consultant
The skills you will learn in this course may be helpful for a career as an IT Consultant. The course will help you build a foundation in data storage, data processing, and data security, all of which are essential for a successful career as an IT Consultant. Additionally, the course will help you familiarize yourself with the various Azure services pertaining to Data Engineering, which can be very useful when working as an IT Consultant.
See salaries and explore the career path for IT Consultant
Data Management Analyst
This course may be useful for those interested in a career as a Data Management Analyst. The course will help you build a foundation in data storage, data processing, and data security, all of which are essential for a successful career as a Data Management Analyst. Additionally, the course will help you familiarize yourself with the various Azure services pertaining to Data Engineering, which can be very useful when working as a Data Management Analyst.
See salaries and explore the career path for Data Management Analyst
Information Security Analyst
The skills you will learn in this course may be helpful for a career as an Information Security Analyst. The course will help you build a foundation in data security, which is essential for a successful career as an Information Security Analyst. Additionally, the course will help you familiarize yourself with the various Azure services pertaining to Data Engineering, which can be very useful when working as an Information Security Analyst.
See salaries and explore the career path for Information Security Analyst

Reading list

We've selected six books that we think will supplement your learning. Use these to develop background knowledge, enrich your coursework, and gain a deeper understanding of the topics covered in DP-203 - Data Engineering on Microsoft Azure.
Cover image
Designing Data-Intensive Applications
Save
Provides a detailed overview of the challenges and techniques involved in designing data-intensive applications.
Designing Data-Intensive Applications: The Big...
Paperback
$$
Designing Data-Intensive Applications: The Big...
Kindle Edition
$$
Cover image
Machine Learning for Absolute Beginners
Save
Provides a gentle introduction to machine learning, making it accessible to beginners.
Machine Learning for Absolute Beginners: A Plain...
Paperback
$$
Data Analytics for Absolute Beginners: A...
Paperback
$$
Machine Learning For Absolute Beginners: A Plain...
Paperback
$$
Machine Learning for Absolute Beginners: A Plain...
Paperback
$$
Machine Learning for Absolute Beginners: A Plain...
Kindle Edition
$
Cover image
Deep Learning for Coders with fastai and PyTorch
Save
Provides a practical introduction to deep learning, using the Fastai and PyTorch libraries.
Deep Learning for Coders with Fastai and PyTorch:...
Paperback
$$
Deep Learning for Coders with fastai and PyTorch:...
Kindle Edition
$$
Cover image
Artificial Intelligence For Dummies
Save
Provides a gentle introduction to artificial intelligence, making it accessible to beginners.
Artificial Intelligence For Dummies (For Dummies...
Paperback
$$
Artificial Intelligence For Dummies (For Dummies...
Paperback
$$
L'Intelligence artificielle Pour les Nuls, NE
Paperback
$$
Artificial Intelligence For Dummies
Kindle Edition
$$
Cover image
The Elements of Statistical Learning
Save
Provides a comprehensive overview of statistical learning, including techniques for data mining, inference, and prediction.
The Elements of Statistical Learning: Data Mining,...
Hardcover
$$$
The Elements of Statistical Learning: Data Mining,...
Hardcover
$$$
The Elements of Statistical Learning: Data Mining,...
Kindle Edition
$$$
Cover image
Python for Data Analysis
Save
Provides a practical introduction to Python for data analysis, using the Pandas, NumPy, and IPython libraries.
Python for Data Analysis: Data Wrangling with...
Paperback
$$
Python for Data Analysis
Kindle Edition
$$
Python for Data Analysis: Data Wrangling with...
Paperback
$$$

Share

Help others find this course page by sharing it with your friends and followers:
Facebook
LinkedIn
Reddit
X
Link
Email

Similar courses

Here are nine courses similar to DP-203 - Data Engineering on Microsoft Azure.
Create IoT Solutions in Microsoft Azure
Most relevant
Understanding Azure Stream Analytics
Most relevant
DP-203: Processing in Azure Using Streaming Solutions
Most relevant
Azure Data Lake Storage Gen2 and Data Streaming Solution
Most relevant
Implement Real Time Analytics using Azure Stream Analytics
Most relevant
Configuring Encryption for Data at Rest in Microsoft Azure
Most relevant
Microsoft Azure Developer: Connecting to Storage
Most relevant
Configuring and Using Microsoft Azure Blob Storage
Most relevant
Building Streaming Data Pipelines in Microsoft Azure
Most relevant
Course image
Effort
21.5 total hours
Via
Udemy
Instructor
Alan Rodrigues
Language
English
Good to know
Develops core data science concepts for learners to attain Microsoft Certified: Azure Data Engineer Associate certification
Taught by Alan Rodrigues, an instructor recognized for his work in Azure Data Engineering
Provides hands-on experience through labs and interactive materials, creating a practical learning opportunity
Covers diverse Azure services and tools, relevant to the industry, for comprehensive data engineering education
Share and help others discover this course.
Facebook LinkedIn X Reddit Link Email
Don't miss out
Enroll today to gain access to this course
Enroll in this course
Our mission

OpenCourser helps millions of learners each year. People visit us to learn workspace skills, ace their exams, and nurture their curiosity.

Our extensive catalog contains over 50,000 courses and twice as many books. Browse by search, by topic, or even by career interests. We'll match you to the right resources quickly.

Find this site helpful? Tell a friend about us.

Affiliate disclosure

We're supported by our community of learners. When you purchase or subscribe to courses and programs or purchase books, we may earn a commission from our partners.

Your purchases help us maintain our catalog and keep our servers humming without ads.

Thank you for supporting OpenCourser.

© 2016 - 2024 OpenCourser