Azure Data Engineer Technologies for Beginners [Bundle]

Why Microsoft Azure Data Engineer?

• Microsoft Azure Date Engineering is one of the fastest-growing and in-demand occupations among Data Science practitioners.

• According to a 2019 Dice report, there was an 88% year-over-year growth in job postings for data engineers, which was the highest growth rate among all technology jobs.

• If you are interested in this domain, there cannot be a better time to start learning these Microsoft Azure Data Solution technologies.

Expected Outcomes

After this course:

• Microsoft Azure SQL Server - You will be able to identify the right Azure SQL Server deployment option, purchasing model and service tier according to requirements and will be able to deploy it in the cloud. You will be able to set up a security configuration to secure your database.

• Microsoft Azure SQL Data Warehouse - You will able to deploy Azure Synapse Analytics (formerly known as Azure SQL Data warehouse) in Azure Cloud environment. You will have good internal MPP architecture understanding, and so you will be able to analyze your on-premises data warehouse and migrate data to Azure Data Warehouse.

• Microsoft Azure Data Lake - You will be able to create Azure Data Lake storage account, populate it will data using different tools and analyze it using Databricks and HDInsight

• Microsoft Azure Data Factory - You will understand Azure Data Factory's key components and advantages. You will be able to create, schedule and monitor simple pipelines.

• Hadoop Basics - You will learn the fundamental understanding of the Hadoop Ecosystem and 3 main building blocks. This module will prepare you to start learning Big Data in Azure Cloud using HDInsight.

• Microsoft Azure HDInsight - We will understand how HDInsight makes Hadoop easy, and we will go through simple demo where we’ll fetch data from Data Lake, process it through Hive and later will store data in SQL Server.

• Cosmos DB - You will understand all basic concepts of Cosmos DB, and will be able to create a new database, container, documents, and choose right partition key, configure the global distribution and use other important features

• Streaming Service - I will add details soon

• Databricks - Video lessons added, I will add details here soon

• Storage Service - Video lessons added, I will add details soon

Intended Audience

• Beginners in Microsoft Azure Platform

• Microsoft Azure Data Engineers

• Microsoft Azure Data Scientist

• Database and BI developers

• Database Administrators

• Data Analyst or similar profiles

• On-Premises Database related profiles who want to learn how to implement these technologies in Azure Cloud.

• Anyone who is looking forward to starting his career as an Azure Data Engineer.

Level

• Beginners (100)

• "if you are already experienced and working on these technologies, this may not be the best course for you."

• I have a few crash courses (Free) for absolute beginners, you can find links on my website.

Prerequisites

• Basic T-SQL and Database concepts

• Microsoft Azure Free trial Subscription

Language

• English

• If you are not comfortable in English, please do not take a course, captions are not good enough to understand the course.

What's inside

• Video lectures, PPTs, Demo Resources, Quiz, Assignment, other important links

• Full lifetime access with all future updates

• Certificate of course completion

• 30-Day Money-Back Guarantee

Course updates

I am consistently adding new content in terms of both lectures and demos. Please find below logs for past and upcoming changes.

Previous Updates:

• Jan 2021 - Revised Synapse module with all new changes

• Aug 2020 - Data Encryption related lessons added

• July 2020 - Monitoring and Optimization of services

• July 2020 - AMS (Azure Monitoring Service)

• July 2020 - Re-recorded Azure Data Factory with all new updates

• July 2020 - NoSQL Databases in Microsoft Azure (Azure Blob Storage)

• July 2020 - Added Azure Databricks Module

• July 2020 - Added Azure Streaming Analytics Module

• June 2020 - Added Azure Cosmos DB Module

• May 2020 - Full-length course on Data Lake

• Apr 2020 - Added modules on Azure cloud computing basics, and Data Engineer profile

• Apr 2020 - Added crash course on cloud computing and data warehouse

• Mar 2020 - Added Azure Synapse Analytics

• Feb 2020 -  Added Azure SQL Database

• Oct 2019 -  Added Azure HDInsight

• Sep 2019 -  Added Azure Data Factory

• Aug 2019 - Course Created on Azure Data Lake

Course In Detail

By the end of this course

• Microsoft Azure SQL Server -

  • You will know the advantages of Azure Database over on-premises Database

  • You will be able to provision all three types of Azure Database PaaS Deployments (Single, Elastic Pool, Managed Instance)

  • You will learn different purchasing models and Service tiers and how to configure them according to requirements.

  • You will be able to provision Azure Database in Virtual Machine (IaaS)

  • You will be able to deploy Elastic Pool Database and able to add/remove more databases from the pool.

  • You will be able to deploy the Managed Instance Database, configure it and connect it with your SQL Server Management studio.

• Microsoft Azure Synapse Analytics Service

  • You will learn why we should consider warehousing solutions in the cloud.

  • You will learn about Microsoft's brand new Azure Synapse analytics service, and how this service brings together enterprise data warehousing and Big Data analytics, and provide a unified experience to ingest, prepare, manage, and serve data for immediate BI and machine learning needs.

  • You will learn the difference between Traditional vs Modern vs Synapse Architecture.

  • You will learn Azure famous MPP (Massive Parallel Processing) architecture

  • You will also learn many internal concepts like Data Distribution, Sharding, and partitioning.

  • You will learn different migration methods and best practices.

  • You will learn PolyBase setup (Best Loading method)

  • You will perform a lot of demos to migrate data to Azure SQL Data warehouse using SSIS, Data Factory and PolyBase.

• Microsoft Azure Data Lake Gen1

  • You will learn the limitations of traditional database systems to handle the Big Data revolution.

  • You will learn the difference between Azure Data Lake, SSIS, Hadoop and Data Warehouse.

  • You will be able to create Azure Data Lake Gen1 storage account, populate it will data and analyze it using U-SQL Language.

• Microsoft Azure Data Factory -

  • You will understand Azure Data Factory's key components and advantages.

  • You will be able to create, schedule and monitor simple pipelines.

• Hadoop Basics

  • You will learn a fundamental understanding of the Hadoop Ecosystem and 3 main building blocks.

  • This module will prepare you to start learning Big Data in Azure Cloud using HDInsight.

• Microsoft HDInsight -

  • You will learn what are the challenges with Hadoop and how HDInsight solves these challenges.

  • You will also learn Cluster types, HDInsight Architecture and other important aspects of Azure HDInsight.

  • You will also go through demo where we’ll fetch data from Data Lake, process it through Hive and later will store data in SQL Server.

Some students Feedback

• One of the most amazing courses i have ever taken on Udemy. Please don't hesitate to take this course. The instructor is really professional and has a great experience about the subject of the course. - Khadija Badary

• Very nicely explained most of the concepts. a must have course for beginners - Manoranjan Swain

• I appreciate this course explaining everything in great detail for a beginner. This will assist me in overcoming challenges at my work - Benjamin Curtis

• Good course for Beginners. Labs are really helpful to grasp the concept. Thank you - Sapna