We may earn an affiliate commission when you visit our partners.
Course image
Microsoft

In this course, you will see how Azure Data Lake Storage can make processing Big Data analytical solutions more efficient and how easy it is to set up. You will also explore how it fits into common architectures, as well as the different methods of uploading the data to the data store. You will examine the myriad of security features that will ensure your data is secure. Learn the concepts of event processing and streaming data and how this applies to Azure Stream Analytics. You will then set up a stream analytics job to stream data, and learn how to manage and monitor a running job.

Read more

In this course, you will see how Azure Data Lake Storage can make processing Big Data analytical solutions more efficient and how easy it is to set up. You will also explore how it fits into common architectures, as well as the different methods of uploading the data to the data store. You will examine the myriad of security features that will ensure your data is secure. Learn the concepts of event processing and streaming data and how this applies to Azure Stream Analytics. You will then set up a stream analytics job to stream data, and learn how to manage and monitor a running job.

This course is part of a Specialization intended for Data engineers and developers who want to demonstrate their expertise in designing and implementing data solutions that use Microsoft Azure data services for anyone interested in preparing for the Exam DP-203: Data Engineering on Microsoft Azure (beta). You will take a practice exam that covers key skills measured by the certification exam.

This is the ninth course in a program of 10 courses to help prepare you to take the exam so that you can have expertise in designing and implementing data solutions that use Microsoft Azure data services. The Data Engineering on Microsoft Azure exam is an opportunity to prove knowledge expertise in integrating, transforming, and consolidating data from various structured and unstructured data systems into structures that are suitable for building analytics solutions that use Microsoft Azure data services. Each course teaches you the concepts and skills that are measured by the exam.

By the end of this Specialization, you will be ready to take and sign-up for the Exam DP-203: Data Engineering on Microsoft Azure (beta).

Enroll now

What's inside

Syllabus

Azure Data Lake Storage
In this module, you will learn how Azure Data Lake Storage provides a cloud storage service that is highly available, secure, durable, scalable, and redundant and brings new efficiencies to processing big data analytics workloads.
Read more
Secure your Azure Storage account
In this module, you will learn how Azure Storage provides multilayered security to protect your data. Find out how to use access keys, to secure networks, and to use Advanced Threat Protection to proactively monitor your system.
Use Azure Stream Analytics
In this module, you will learn the concepts of event processing and streaming data and how this applies to Azure Stream Analytics. You will then set up a stream analytics job to stream data, and learn how to manage and monitor a running job.
Practice Exam on Azure Data Lake Storage Gen2 and Data Streaming Solution
In this module, you will take a practice exam that covers key skills measured in the Exam DP-203: Data Engineering on Microsoft Azure.

Good to know

Know what's good
, what to watch for
, and possible dealbreakers
Teaches the use of Azure Data Lake Storage to more efficiently process big data analytical solutions
Taught by Microsoft, who are recognized for their work in software engineering

Save this course

Save Azure Data Lake Storage Gen2 and Data Streaming Solution to your list so you can find it easily later:
Save

Activities

Be better prepared before your course. Deepen your understanding during and after it. Supplement your coursework and achieve mastery of the topics covered in Azure Data Lake Storage Gen2 and Data Streaming Solution with these activities:
Practice data storage concepts
Review the basics of data storage and management to strengthen your foundation for Azure Data Lake Storage.
Show steps
  • Review concepts of data storage and management
  • Explore different types of data storage solutions
  • Practice implementing data storage and management techniques
Azure fundamentals review
Review essential Azure concepts covered in the Azure Fundamentals certification to strengthen your knowledge base before diving into this course.
Browse courses on Azure Fundamentals
Show steps
  • Go through the Microsoft Learn module on Azure Fundamentals (AZ-900).
  • Take practice tests or quizzes to assess your understanding.
  • Review documentation or tutorials on core Azure services like Azure Storage, Azure Compute, and Azure Networking.
Gather learning materials
Consolidate notes, assignments, quizzes, and exams to ensure you have everything needed to succeed.
Show steps
  • Find a storage system that works for you
  • Collect and organize all course materials
  • Review and update materials regularly
17 other activities
Expand to see all activities and additional details
Show all 20 activities
Set Up Azure Storage Account
Following a guided tutorial on setting up an Azure Storage Account will provide hands-on experience and a strong foundation for the course.
Browse courses on Data Storage
Show steps
  • Identify a detailed tutorial on setting up an Azure Storage Account.
  • Follow the steps outlined in the tutorial.
  • Test the functionality of your newly created Azure Storage Account.
Azure Storage Concepts
Reinforce your understanding of the fundamental concepts of Azure Storage, ensuring a strong foundation for working with Azure Data Lake Storage.
Browse courses on Azure Storage
Show steps
  • Review Microsoft's documentation on Azure Storage.
  • Create a storage account in the Azure portal and explore its settings
  • Experiment with different storage types such as blobs, files, and tables
Discuss Azure Security Best Practices
Engaging in peer discussions on Azure security best practices will foster knowledge sharing and promote critical thinking.
Show steps
  • Join a study group or online forum.
  • Identify topics related to Azure security best practices.
  • Prepare talking points and research relevant materials.
  • Actively participate in discussions, sharing insights and listening to others.
Azure Data Lake Storage Gen2 Tutorial
Enhance your understanding of Azure Data Lake Storage Gen2 by following step-by-step tutorials that guide you through its features and functionalities.
Show steps
  • Go through the Microsoft Learn tutorial on Introduction to Azure Data Lake Storage Gen2.
  • Follow a hands-on tutorial to create an Azure Data Lake Storage Gen2 account and upload data.
  • Explore additional tutorials covering real-world scenarios and advanced features.
Build a Data Lake using Azure Data Lake Storage Gen2
Gain hands-on experience creating and managing a data lake in Azure, providing a practical understanding of how to store and process large amounts of data.
Show steps
  • Create an Azure Data Lake Storage Gen2 account
  • Configure access permissions for the data lake
  • Ingest data into the data lake from various sources
  • Query and analyze the data using tools like Azure Data Explorer or Azure Synapse Analytics
  • Monitor and optimize the data lake for performance and cost
Join a Study Group for DP-203 Exam Preparation
Connect with other students preparing for the DP-203 exam, collaborate on practice questions, and reinforce your understanding of the concepts covered in the course.
Show steps
  • Find a study group or create one with fellow course participants
  • Establish a regular meeting schedule and agenda
  • Take turns leading discussions and presenting practice exam questions
  • Collaborate on mock exams and provide feedback to each other
Work through Azure Data Lake Storage tutorials
Gain hands-on experience with Azure Data Lake Storage by completing guided tutorials provided by Microsoft.
Show steps
  • Find relevant tutorials on the Microsoft Learn platform
  • Follow the instructions and complete the exercises
  • Review the concepts and apply them to your own projects
Analyze Azure Stream Analytics Job Performance
Analyzing the performance of an Azure Stream Analytics job through practice drills will enhance understanding of job efficiency.
Browse courses on Data Analytics
Show steps
  • Set up an Azure Stream Analytics job.
  • Run the job and monitor its performance.
  • Identify performance bottlenecks and potential areas for improvement.
  • Implement optimization techniques to enhance the job's performance.
Attend an Azure Data Engineering Workshop
Participate in a workshop specifically designed to enhance your data engineering skills in Azure, allowing you to learn from experts and engage with peers.
Show steps
  • Research and identify a relevant Azure Data Engineering workshop
  • Register and attend the workshop
  • Actively participate in the workshop sessions and ask questions
  • Follow up with the workshop organizers or speakers for additional resources
Azure Stream Analytics Exercises
Solidify your skills in Azure Stream Analytics by completing hands-on exercises that simulate real-world data processing scenarios.
Browse courses on Azure Stream Analytics
Show steps
  • Set up an Azure Stream Analytics job using the Azure portal.
  • Write queries to transform and analyze streaming data.
  • Monitor and troubleshoot your Azure Stream Analytics job.
Solve Azure Data Lake Storage practice problems
Test your understanding of Azure Data Lake Storage by solving practice problems and exercises.
Show steps
  • Find practice problems and exercises online or in textbooks
  • Attempt to solve the problems on your own
  • Review your answers and identify areas for improvement
Design a Data Lake Storage Architecture
Creating a Data Lake Storage architecture will provide practical experience in designing efficient data storage solutions.
Browse courses on Cloud Storage
Show steps
  • Define the requirements and objectives of the data storage architecture.
  • Research and evaluate different Azure Data Lake Storage features and capabilities.
  • Design a logical architecture that meets the defined requirements.
  • Consider security, scalability, and cost-effectiveness in the design.
  • Document the architecture and share it for review.
Design a Data Streaming Solution using Azure Stream Analytics
Develop a real-world data streaming solution using Azure Stream Analytics, showcasing your ability to process and analyze data in real time.
Browse courses on Azure Stream Analytics
Show steps
  • Identify a suitable data source for streaming
  • Create an Azure Stream Analytics job
  • Design and implement the data processing logic using SQL queries
  • Configure outputs for the processed data
  • Monitor and evaluate the performance of the streaming solution
Data Lake Storage Gen2 Design and Implementation Plan
Deepen your knowledge of Azure Data Lake Storage Gen2 by designing and documenting a storage solution for a specific use case.
Show steps
  • Identify the business requirements and data storage needs.
  • Design the Data Lake Storage Gen2 architecture, including data layout and security measures.
  • Create a detailed implementation plan and document the design decisions.
Build a data storage solution using Azure Data Lake Storage
Apply your skills by creating a functional data storage solution using Azure Data Lake Storage.
Show steps
  • Define the requirements and scope of your project
  • Design and implement your data storage solution
  • Test and evaluate your solution
  • Document your project and share your findings
Participate in Azure Data Lake Storage competitions
Challenge yourself and showcase your skills by participating in Azure Data Lake Storage competitions.
Show steps
  • Find relevant competitions online or through Microsoft
  • Register and participate in the competition
  • Collaborate with others and learn from their approaches
Write a blog post or article about Azure Data Lake Storage
Enhance your understanding and share your knowledge by writing a blog post or article about Azure Data Lake Storage.
Show steps
  • Choose a specific topic related to Azure Data Lake Storage
  • Research and gather information from reliable sources
  • Write a well-organized and informative article
  • Publish your article on a relevant platform

Career center

Learners who complete Azure Data Lake Storage Gen2 and Data Streaming Solution will develop knowledge and skills that may be useful to these careers:
Data Engineer
Data Engineers design and implement data pipelines that process and transform large volumes of data. This course can help you build a foundation in Azure Data Lake Storage Gen2 and Azure Stream Analytics, which are essential technologies for data engineers. You will learn how to use these technologies to build scalable, reliable, and secure data pipelines.
Big Data Engineer
Big Data Engineers design and implement systems for processing and analyzing large volumes of data. This course can help you build a foundation in Azure Data Lake Storage Gen2 and Azure Stream Analytics, which are essential technologies for big data engineers. You will learn how to use these technologies to build scalable, reliable, and secure big data systems.
Data Architect
Data Architects design and implement the architecture for data storage and processing systems. This course can help you build a foundation in Azure Data Lake Storage Gen2 and Azure Stream Analytics, which are essential technologies for data architects. You will learn how to use these technologies to design and implement scalable, reliable, and secure data systems.
Data Analytics Engineer
Data Analytics Engineers design and implement systems for analyzing data. This course can help you build a foundation in Azure Data Lake Storage Gen2 and Azure Stream Analytics, which are essential technologies for data analytics engineers. You will learn how to use these technologies to build scalable, reliable, and secure data analytics systems.
Cloud Architect
Cloud Architects design and implement cloud-based solutions. This course can help you build a foundation in Azure Data Lake Storage Gen2 and Azure Stream Analytics, which are essential technologies for cloud architects. You will learn how to use these technologies to build scalable, reliable, and secure cloud-based solutions.
Cloud Engineer
Cloud Engineers implement and manage cloud-based solutions. This course can help you build a foundation in Azure Data Lake Storage Gen2 and Azure Stream Analytics, which are essential technologies for cloud engineers. You will learn how to use these technologies to implement and manage scalable, reliable, and secure cloud-based solutions.
Data Scientist
Data Scientists use data to solve business problems. This course can help you build a foundation in Azure Data Lake Storage Gen2 and Azure Stream Analytics, which can be used to store and process large volumes of data. You will learn how to use these technologies to access and analyze data, and to develop models that can solve business problems.
Data Visualization Engineer
Data Visualization Engineers design and implement data visualization solutions. This course can help you build a foundation in Azure Data Lake Storage Gen2 and Azure Stream Analytics, which can be used to store and process large volumes of data. You will learn how to use these technologies to create data visualizations that can help users understand data and make informed decisions.
Business Analyst
Business Analysts use data to solve business problems. This course can help you build a foundation in Azure Data Lake Storage Gen2 and Azure Stream Analytics, which can be used to store and process large volumes of data. You will learn how to use these technologies to access and analyze data, and to develop solutions that can solve business problems.
Data Analyst
Data Analysts use data to make informed decisions. This course can help you build a foundation in Azure Data Lake Storage Gen2 and Azure Stream Analytics, which can be used to store and process large volumes of data. You will learn how to use these technologies to access and analyze data, and to present your findings to decision-makers.
Information Architect
Information Architects design and implement information systems. This course can help you build a foundation in Azure Data Lake Storage Gen2 and Azure Stream Analytics, which are essential technologies for information architects. You will learn how to use these technologies to design and implement scalable, reliable, and secure information systems.
Database Administrator
Database Administrators design and implement database systems. This course can help you build a foundation in Azure Data Lake Storage Gen2 and Azure Stream Analytics, which are essential technologies for database administrators. You will learn how to use these technologies to design and implement scalable, reliable, and secure database systems.
Software Engineer
Software Engineers design and implement software solutions. This course can help you build a foundation in Azure Data Lake Storage Gen2 and Azure Stream Analytics, which can be used to store and process large volumes of data. You will learn how to use these technologies to develop software solutions that can solve business problems.
Data Management Specialist
Data Management Specialists design and implement data management solutions. This course can help you build a foundation in Azure Data Lake Storage Gen2 and Azure Stream Analytics, which are essential technologies for data management specialists. You will learn how to use these technologies to design and implement scalable, reliable, and secure data management solutions.
Systems Analyst
Systems Analysts design and implement systems solutions. This course can help you build a foundation in Azure Data Lake Storage Gen2 and Azure Stream Analytics, which are essential technologies for systems analysts. You will learn how to use these technologies to design and implement scalable, reliable, and secure systems solutions.

Reading list

We've selected six books that we think will supplement your learning. Use these to develop background knowledge, enrich your coursework, and gain a deeper understanding of the topics covered in Azure Data Lake Storage Gen2 and Data Streaming Solution.
Must-read for anyone interested in designing and building data-intensive applications. It covers the fundamental principles and patterns of data processing, and provides insight into the trade-offs involved in choosing different technologies.
Comprehensive guide to Hadoop, the open-source framework for storing and processing big data. While it does not focus on Azure-specific technologies, it provides a solid foundation for understanding the principles of big data processing.
Provides a practical guide to data visualization with Power BI. It covers topics such as data preparation, data visualization techniques, and dashboard creation. This book is recommended as additional reading for those interested in using Power BI for data visualization.
Provides a practical guide to securing your data in Azure Storage. It covers topics such as access control, encryption, and threat protection, and offers best practices to help you protect your data.

Share

Help others find this course page by sharing it with your friends and followers:

Similar courses

Here are nine courses similar to Azure Data Lake Storage Gen2 and Data Streaming Solution.
DP-203: Data Ingestion and Preparation
Most relevant
DP-203: Processing in Azure Using Streaming Solutions
Most relevant
Data Integration with Microsoft Azure Data Factory
Most relevant
Data Storage in Microsoft Azure
Most relevant
Microsoft Azure for Data Engineering
Most relevant
Data Storage in Microsoft Azure for Associate Developers
Most relevant
Microsoft Azure Databricks for Data Engineering
Most relevant
Building Batch Data Processing Solutions in Microsoft...
Most relevant
Data Engineering with MS Azure Synapse Apache Spark Pools
Most relevant
Our mission

OpenCourser helps millions of learners each year. People visit us to learn workspace skills, ace their exams, and nurture their curiosity.

Our extensive catalog contains over 50,000 courses and twice as many books. Browse by search, by topic, or even by career interests. We'll match you to the right resources quickly.

Find this site helpful? Tell a friend about us.

Affiliate disclosure

We're supported by our community of learners. When you purchase or subscribe to courses and programs or purchase books, we may earn a commission from our partners.

Your purchases help us maintain our catalog and keep our servers humming without ads.

Thank you for supporting OpenCourser.

© 2016 - 2024 OpenCourser