Data Integration with Microsoft Azure Data Factory from Coursera

In this course, you will learn how to create and manage data pipelines in the cloud using Azure Data Factory.

This course is part of a Specialization intended for Data engineers and developers who want to demonstrate their expertise in designing and implementing data solutions that use Microsoft Azure data services. It is ideal for anyone interested in preparing for the DP-203: Data Engineering on Microsoft Azure exam (beta).

This is the third course in a program of 10 courses to help prepare you to take the exam so that you can have expertise in designing and implementing data solutions that use Microsoft Azure data services. The Data Engineering on Microsoft Azure exam is an opportunity to prove knowledge expertise in integrating, transforming, and consolidating data from various structured and unstructured data systems into structures that are suitable for building analytics solutions that use Microsoft Azure data services. Each course teaches you the concepts and skills that are measured by the exam.

By the end of this Specialization, you will be ready to take and sign-up for the Exam DP-203: Data Engineering on Microsoft Azure (beta).

What's inside

Syllabus

Integrate data with Azure Data Factory or Azure Synapse Pipeline

Describe the core components of Azure Data Factory that enable you to create large scale data ingestion solutions in the cloud

Petabyte-scale ingestion with Azure Data Factory or Azure Synapse Pipeline

Describe the various methods that can be used to ingest data between various data stores using Azure Data Factory

Perform code-free transformation at scale with Azure Data Factory or Azure Synapse Pipeline

Perform common data transformation and cleansing activities within Azure Data Factory without using code Implement Slowly Changing Dimension using Azure Data Factory or Azure Synapse Pipelines

Orchestrate data movement and transformation in Azure Data Factory or Azure Synapse Pipeline

Use Azure Data Factory to orchestrate large scale data movement by using other Azure Data Platform and Machine Learning technologies

Execute existing SSIS packages in Azure Data Factory or Azure Synapse Pipeline

Integrate SQL Server Integration Services packages into an Azure Data Factory solution

Operationalize your Azure Data Factory or Azure Synapse Pipeline

Publish your Azure Data Factory work between different environments

Receive data with Azure Data Share and transforming with Azure Data Factory

Ingest data from Azure Data Share into Azure Data Factory pipelines to build automated ingestion pipelines

Course Practice Exam

Practice Exam on Data integration at scale with Azure Data Factory or Azure Synapse Pipeline

Good to know

Know what's good

, what to watch for

, and possible dealbreakers

Builds a foundation for and develops data engineering expertise using Microsoft Azure data services

Designed for data engineers and developers who want to master Microsoft Azure data services

Knowledge gained from the course is testable via the DP-203: Data Engineering on Microsoft Azure exam (beta)

Taught by Microsoft, a leading innovator in cloud computing

Activities

Be better prepared before your course. Deepen your understanding during and after it. Supplement your coursework and achieve mastery of the topics covered in Data Integration with Microsoft Azure Data Factory with these activities:

Compile and organize course materials

Show steps

Stay organized and improve your retention by compiling and reviewing course materials.

Show steps

Create a central repository for notes, assignments, and other materials
Organize materials by topic or module
Review materials regularly

Review basic programming concepts

Show steps

Strengthen your foundation in programming concepts to enhance your Data Factory skills.

Browse courses on Programming

Show steps

Review online tutorials or books on basic programming
Practice solving coding challenges on platforms like LeetCode or HackerRank

Review cloud computing concepts

Show steps

Refresh your knowledge of cloud computing concepts to enhance your understanding of Data Factory.

Browse courses on Cloud Computing

Show steps

Review online courses or tutorials on cloud computing
Practice using cloud services through hands-on exercises

Seven other activities

Expand to see all activities and additional details

Show all ten activities

Follow guided tutorials on Data Factory features

Show steps

Expand your knowledge of Data Factory features by following guided tutorials.

Browse courses on Azure Data Factory

Show steps

Find tutorials on Microsoft Learn or YouTube
Choose a tutorial that covers a feature you want to learn
Follow the tutorial step-by-step

Practice Data Factory concepts with hands-on exercises

Show steps

Solidify your understanding of Azure Data Factory concepts through practical exercises.

Browse courses on Azure Data Factory

Show steps

Set up your Azure Data Factory environment
Create a data pipeline to ingest data from a source
Transform data using data flow activities
Orchestrate data movement and transformation

Practice transforming data using Azure Data Factory Data Flows

Show steps

Practice data transformation tasks to become more proficient in using Azure Data Factory Data Flows.

Browse courses on Data Transformation

Show steps

Create a new data flow in Azure Data Factory
Add a source dataset to the data flow
Add a transformation to the data flow to perform data transformations
Add a sink dataset to the data flow to store the transformed data
Publish the data flow and trigger a run

Practice Azure Data Factory transformations

Show steps

Reinforce your understanding of data transformations in Azure Data Factory by completing practice exercises and drills.

Browse courses on Data Transformation

Show steps

Review the Azure Data Factory documentation on transformations.
Complete the hands-on labs in the Azure Data Factory learning module on transformations.
Create your own data transformation pipelines using Azure Data Factory.

Join a study group or online forum for Data Factory

Show steps

Engage with other learners and experts to discuss Data Factory concepts and share knowledge.

Browse courses on Azure Data Factory

Show steps

Find a study group or online forum
Join the group and participate in discussions
Share your knowledge and learn from others

Build a data pipeline using Data Factory

Show steps

Apply your skills by creating a data pipeline that meets a specific business need.

Browse courses on Azure Data Factory

Show steps

Define the data sources and destination
Design the data pipeline architecture
Implement the pipeline using Data Factory activities
Test and deploy the pipeline

Participate in data science competitions or hackathons

Show steps

Challenge yourself and showcase your skills by participating in data science competitions or hackathons.

Browse courses on Data Science

Show steps

Find a competition or hackathon that aligns with your interests
Form a team or work individually
Develop a solution using Data Factory
Submit your solution and compete for prizes or recognition

Career center

Learners who complete Data Integration with Microsoft Azure Data Factory will develop knowledge and skills that may be useful to these careers:

Data Engineer

A Data Engineer designs and builds the systems and processes that manage and transform data. They ensure that the data is reliable, secure, and accessible to those who need it. This course teaches the skills required for building effective data engineering solutions using Azure Data Factory.

See salaries and explore the career path for Data Engineer

Data Architect

A Data Architect is an architect who designs and oversees the implementation of data management systems. The systems that they design and oversee provide secure, reliable, efficient, and integrated access to data. They may oversee data integration projects which would require them to be familiar with integration techniques and solutions such as the ones taught in this course.

See salaries and explore the career path for Data Architect

Database Architect

A Database Architect designs and manages the structure and organization of databases. They ensure that databases are efficient, scalable, and secure. This course provides a foundation in data integration and data transformation, which are essential skills for Database Architects.

See salaries and explore the career path for Database Architect

Data Analyst

Data Analysts collect, clean, and analyze data to identify trends and patterns. They use this information to make recommendations and improve decision-making. This course provides a foundation in data integration and data transformation, which are essential skills for Data Analysts.

See salaries and explore the career path for Data Analyst

Database Administrator

A Database Administrator (DBA) is responsible for the day-to-day operation and maintenance of databases. They ensure that databases are running smoothly and efficiently. This course provides a foundation in data integration and data transformation, which are essential skills for DBAs.

See salaries and explore the career path for Database Administrator

Software Engineer

A Software Engineer designs, develops, and maintains software applications. They may work on projects that involve data integration and data transformation. This course provides a foundation in data integration and data transformation, which are essential skills for Software Engineers.

See salaries and explore the career path for Software Engineer

Information Architect

An Information Architect designs and manages the organization and structure of information systems. They ensure that information is accessible, usable, and relevant to the needs of users. This course provides a foundation in data integration and data transformation, which are essential skills for Information Architects.

See salaries and explore the career path for Information Architect

Business Intelligence Analyst

A Business Intelligence Analyst analyzes data to identify trends and patterns that can help businesses make better decisions. They may work on projects that involve data integration and data transformation. This course provides a foundation in data integration and data transformation, which are essential skills for Business Intelligence Analysts.

See salaries and explore the career path for Business Intelligence Analyst

Machine Learning Engineer

A Machine Learning Engineer develops and deploys machine learning models. They may work on projects that involve data integration and data transformation. This course provides a foundation in data integration and data transformation, which are essential skills for Machine Learning Engineers.

See salaries and explore the career path for Machine Learning Engineer

Data Scientist

A Data Scientist uses scientific methods to extract knowledge from data. They may work on projects that involve data integration and data transformation. This course provides a foundation in data integration and data transformation, which are essential skills for Data Scientists.

See salaries and explore the career path for Data Scientist

Cloud Engineer

A Cloud Engineer designs and manages cloud computing systems. They may work on projects that involve data integration and data transformation. This course provides a foundation in data integration and data transformation, which are essential skills for Cloud Engineers.

See salaries and explore the career path for Cloud Engineer

Systems Analyst

A Systems Analyst analyzes and designs computer systems. They may work on projects that involve data integration and data transformation. This course provides a foundation in data integration and data transformation, which are essential skills for Systems Analysts.

See salaries and explore the career path for Systems Analyst

Project Manager

A Project Manager plans, executes, and closes projects. They may work on projects that involve data integration and data transformation. This course provides a foundation in data integration and data transformation, which are essential skills for Project Managers.

See salaries and explore the career path for Project Manager

Technical Writer

A Technical Writer creates and maintains technical documentation. They may work on projects that involve data integration and data transformation. This course provides a foundation in data integration and data transformation, which are essential skills for Technical Writers.

See salaries and explore the career path for Technical Writer

Data Librarian

A Data Librarian organizes and manages data. They may work on projects that involve data integration and data transformation. This course provides a foundation in data integration and data transformation, which are essential skills for Data Librarians.

See salaries and explore the career path for Data Librarian

Data Integration with Microsoft Azure Data Factory

What's inside

Syllabus

Good to know

Save this course

Activities

Career center

Reading list

Share

Similar courses