Managing Big Data with AWS Storage Options from Pluralsight

Discover solutions offered by Amazon Web Services for collecting, processing, and storing big data coming in from different sources, to derive insights about your businesses and your customers

In the modern world, data has become a critical factor in companies making decisions about their business and understanding their customers. But making sense of this data is no small or cheap task. In this course, Managing Big Data with AWS Storage Options, you will learn how to process large amounts of data generated by your company using Amazon Web Services. First, you will learn how to collect, process and store petabytes of data into Amazon Redshift using AWS Glue. Next, you will discover how to process and store real-time data using Amazon Kinesis Data Firehose. Finally, you will explore how to use Amazon Elastic Map Reduce to provision clusters and perform data analysis on your big data, by turning it into meaningful insights. At the end of this course, you will be able to use Amazon Web Services to set up an infrastructure to collect and analyze petabytes of data, to take your business to the next level. In order to get the most out of this course, you will need to have an AWS account to follow the exercises demonstrated.

What's inside

Syllabus

Course Overview

Setting up Amazon Redshift

Populating Amazon Redshift with Data

Creating and Securing Hadoop Environments with Amazon EMR

Good to know

Know what's good

, what to watch for

, and possible dealbreakers

Provides hands-on practice with AWS tools including Glue, Kinesis and Elastic MapReduce

Builds a foundation for understanding big data engineering concepts and tools

Taught by Nertil Poci, an experienced data engineer

Requires an AWS account for exercises, which may incur costs

Activities

Be better prepared before your course. Deepen your understanding during and after it. Supplement your coursework and achieve mastery of the topics covered in Managing Big Data with AWS Storage Options with these activities:

Review Data Warehousing Concepts

Show steps

Refreshing your understanding of data warehousing principles will lay a solid foundation for managing and analyzing big data.

Browse courses on Data Warehousing

Show steps

Review Star and Snowflake Schemas
Understand ETL Processes and Data Integration

Read 'Designing Data-Intensive Applications' by Martin Kleppmann

Show steps

This book provides a comprehensive overview of data-intensive applications, covering key concepts and practical considerations relevant to big data management.

View Secret Colors on Amazon

Show steps

Read Chapters on Big Data Architectures
Review Case Studies and Examples

Attend AWS Big Data Workshops

Show steps

Participating in AWS Big Data workshops offers guided, hands-on learning experiences that will supplement your theoretical knowledge.

Show steps

Identify Relevant Workshops
Register and Attend Workshops
Engage with Instructors and Participants

Five other activities

Expand to see all activities and additional details

Show all eight activities

Review R/Programming Essentials

Show steps

Reinforce understanding of R/Programming Essentials concepts to strengthen the foundation for this course.

Browse courses on R Programming

Show steps

Revisit R/Programming concepts (e.g., data types, control flow, functions).
Practice writing and executing basic R/Programming code snippets.
Review resources such as online tutorials or documentation.

Contribute to Open Source Big Data Projects

Show steps

By contributing to real-world big data projects, you can contribute to the community, enhance your skills, and gain valuable experience.

Browse courses on Open Source

Show steps

Identify Suitable Projects
Contribute Code and Enhancements
Engage in Project Discussions and Issues

Develop a Sample Big Data Infrastructure

Show steps

Guided tutorials allow you to practice and understand the process of collecting, processing, and storing big data using AWS services.

Browse courses on Amazon Web Services

Show steps

Choose an AWS Region
Set Up Virtual Private Cloud Networking
Configure IAM Roles and Permissions
Deploy Amazon Redshift Cluster
Configure Amazon Kinesis Data Firehose

Configure AWS Glue for Big Data Processing

Show steps

Hands-on practice with AWS Glue will reinforce your understanding of data extraction, transformation, and loading techniques for big data processing.

Browse courses on Amazon Web Services

Show steps

Create an AWS Glue Job
Define Data Sources and Sink
Configure Data Transformations
Run and Monitor the Glue Job

Analyze Big Data Using Amazon EMR

Show steps

Analyzing big data through an Amazon EMR cluster will give you practical experience in handling large datasets for insights and decision-making.

Browse courses on Amazon EMR

Show steps

Provision an Amazon EMR Cluster
Configure Hadoop and Spark
Develop and Execute Analysis Scripts
Visualize and Interpret Results

Career center

Learners who complete Managing Big Data with AWS Storage Options will develop knowledge and skills that may be useful to these careers:

Chief Data Officer

A Chief Data Officer is responsible for overseeing an organization's data strategy. This course may help you prepare for a career as a Chief Data Officer by teaching you how to use Amazon Web Services to set up an infrastructure to collect and analyze petabytes of data.

See salaries and explore the career path for Chief Data Officer

Data Architect

A Data Architect designs and manages data systems. This course may help you prepare for a career as a Data Architect by teaching you how to collect, process, and store petabytes of data into Amazon Redshift using AWS Glue.

See salaries and explore the career path for Data Architect

Big Data Architect

A Big Data Architect designs, develops, and manages big data systems. This course may help you prepare for a career as a Big Data Architect by teaching you how to use Amazon Web Services to set up an infrastructure to collect and analyze petabytes of data.

See salaries and explore the career path for Big Data Architect

Data Analyst

Data Analysts use their understanding of data to help businesses understand trends and make better decisions. This course may be useful as it teaches how to process large amounts of data generated by your company using Amazon Web Services.

See salaries and explore the career path for Data Analyst

Data Engineer

A Data Engineer designs and implements data pipelines using AWS to provide solutions to specific data-related problems. This course may help you prepare for a career as a Data Engineer by teaching you how to use Amazon Web Services to set up an infrastructure to collect, store and analyze petabytes of data.

See salaries and explore the career path for Data Engineer

Data Scientist

Data Scientists make use of data to solve complex problems by applying techniques from fields such as statistics, mathematics, and computer science. This course may help you prepare for a career as a Data Scientist by teaching you how to use Amazon Web Services to collect, store, and process petabytes of data, to take your business to the next level.

See salaries and explore the career path for Data Scientist

Cloud Architect

A Cloud Architect designs and manages cloud infrastructure. This course may help you build a foundation for a career as a Cloud Architect by teaching you how to set up an infrastructure to collect, analyze, and store petabytes of data using Amazon Redshift, Amazon Kinesis Data Firehose, and Amazon Elastic Map Reduce.

See salaries and explore the career path for Cloud Architect

Software Engineer

Software Engineers build and maintain software applications. As a Software Engineer, familiarity with data storage and processing techniques is an asset. This course may help you build a foundation for a career as a Software Engineer by covering topics such as collecting, processing, storing, and analyzing big data using AWS Storage Options, and setting up data pipelines and performing data analysis.

See salaries and explore the career path for Software Engineer

Information Security Analyst

Information Security Analysts protect an organization's data from unauthorized access. As an Information Security Analyst, it is crucial to understand data storage and processing techniques. This course may help build a foundation for a career as an Information Security Analyst by covering topics such as collecting, processing, storing, and analyzing big data using AWS Storage Options.

See salaries and explore the career path for Information Security Analyst

Business Analyst

A Business Analyst analyzes data to help businesses make decisions. This course may help build a foundation for a career as a Business Analyst by teaching you how to use Amazon Web Services to collect and analyze petabytes of data.

See salaries and explore the career path for Business Analyst

Database Administrator

Database Administrators manage and maintain databases. This course may be useful as it teaches how to set up Amazon Redshift, process and store data from different sources using Amazon Kinesis Data Firehose, and use Amazon Elastic Map Reduce to provision clusters and perform data analysis on big data.

See salaries and explore the career path for Database Administrator

Statistician

Statisticians work to collect, analyze, interpret, and present quantitative data. As a Statistician, it is crucial to have a solid understanding of data storage and processing techniques. This course may be useful as it covers topics such as collecting, processing, storing, and analyzing big data using AWS Storage Options.

See salaries and explore the career path for Statistician

Data Management Consultant

Data Management Consultants help organizations manage their data effectively. This course may be useful as it teaches how to set up Amazon Redshift, process and store data from different sources using Amazon Kinesis Data Firehose, and use Amazon Elastic Map Reduce to provision clusters and perform data analysis on big data.

See salaries and explore the career path for Data Management Consultant

Project Manager

Project Managers plan and execute projects. As a Project Manager, data management is a key skill. This course may be useful as it teaches how to manage big data projects using Amazon Web Services.

See salaries and explore the career path for Project Manager

Operations Manager

Operations Managers oversee the day-to-day operations of an organization, including data management. This course may be useful as it teaches how to manage big data using Amazon Web Services.

See salaries and explore the career path for Operations Manager