Moving Data with Snowflake from Pluralsight

In this course, you'll learn how to build batch and streaming pipelines in Snowflake - by understanding data load options, securely connecting to external stores & querying them, handling errors, and working with structured & semi-structured formats.

Snowflake is one of the most popular cloud data platforms. It allows data storage, data processing, and analytics at massive scale, with extremely less administrative effort, one of the key areas for any data platform is to build data pipelines.

In this course, Moving Data with Snowflake, you’ll learn how to quickly & reliably, ingest the data into the tables of Snowflake database - by building Batch and Streaming pipelines in Snowflake.

First, you’ll delve into each different data loading options in Snowflake.

Then, you’ll see how the batch loading process works in Snowflake - how to connect to external data stores, like Azure Storage; and how to directly query the files in Snowflake.

Next, you’ll explore how to work with structured, and semi-structured file formats, like CSV, JSON, and Parquet.

finally, you’ll see how to process streaming data in Snowflake – how to continuously load the data using Snowpipe; and how to automate this loading process.

By the end of this course, you’ll have the knowledge and skills, to Move Data with Snowflake, by building batch and streaming pipelines.

What's inside

Syllabus

Course Overview

Getting Started with Snowflake

Working with Batch Data in Snowflake

Working with Streaming Data in Snowflake

Good to know

Know what's good

, what to watch for

, and possible dealbreakers

Explores Snowflake, which is a widely-used cloud data platform in industry

Taught by Mohit Batra, a recognized expert in Snowflake

Examines data loading options in Snowflake, which is highly relevant to data engineers and data analysts

Builds a strong foundation for working with batch data in Snowflake, which is essential for data management

Delves into streaming data in Snowflake, which is useful for real-time data processing

Requires learners to come in with some background knowledge in data engineering or data analysis

Activities

Be better prepared before your course. Deepen your understanding during and after it. Supplement your coursework and achieve mastery of the topics covered in Moving Data with Snowflake with these activities:

Find a Mentor in Data Pipelines

Show steps

Find a mentor who can provide guidance and support as you learn about data pipelines.

Browse courses on Data Pipelines

Show steps

Identify potential mentors in your network.
Reach out to them and introduce yourself.
Explain your goals and ask if they would be willing to mentor you.

Review Core Data Structures

Show steps

Refresh your knowledge of core data structures to prepare for the course

Browse courses on Data Structures

Show steps

Review the basics of arrays, linked lists, and hash tables
Go through practice problems involving data structures

Tutorial: Snowflake's Data Loading Options

Show steps

Follow a guided tutorial to learn about the different data loading options available in Snowflake.

Browse courses on Data Loading

Show steps

Visit the Snowflake documentation.
Read through the tutorial on data loading.
Complete the hands-on exercises.

Six other activities

Expand to see all activities and additional details

Show all nine activities

Tutorial: Processing Streaming Data in Snowflake

Show steps

Follow a guided tutorial to learn how to process streaming data in Snowflake using Snowpipe.

Browse courses on Streaming Data

Show steps

Visit the Snowflake documentation.
Read through the tutorial on streaming data.
Complete the hands-on exercises.

Practice SQL Queries

Show steps

Complete practice drills to refine your SQL querying skills

Browse courses on SQL

Show steps

Download a SQL practice problem set
Complete a set of practice problems
Review and understand the solutions

Practice Building Batch Pipelines

Show steps

Practice building batch pipelines to improve your understanding of the process and gain hands-on experience.

Browse courses on Data Pipelines

Show steps

Set up a local environment for Snowflake.
Create a Snowflake database and schema.
Load data into a table using the COPY command.
Query the loaded data using SQL.
Optimize your pipeline for performance.

Practice Working with Structured and Semi-Structured File Formats

Show steps

Practice working with structured and semi-structured file formats to improve your ability to handle real-world data.

Browse courses on File Formats

Show steps

Create a Snowflake table with a specific schema.
Load CSV data into the table.
Load JSON data into the table.
Query the data using SQL.
Optimize your queries for performance.

Build a Real-World Data Pipeline

Show steps

Apply your knowledge by building a real-world data pipeline to reinforce your understanding and gain practical experience.

Browse courses on Data Pipelines

Show steps

Define the scope and requirements of your pipeline.
Choose the appropriate tools and technologies.
Design and implement the pipeline.
Test and deploy the pipeline.
Monitor and maintain the pipeline.

Snowflake Data Pipelines Workshop

Show steps

Attend a workshop on Snowflake data pipelines to learn from experts and network with other professionals in the field.

Browse courses on Data Pipelines

Show steps

Find a relevant workshop.
Register for the workshop.
Attend the workshop.
Participate in the discussions and exercises.
Follow up with the organizers after the workshop.

Career center

Learners who complete Moving Data with Snowflake will develop knowledge and skills that may be useful to these careers:

Data Engineer

A Data Engineer is responsible for designing, building, and maintaining data pipelines that move data between different systems. This course can help you develop the skills you need to become a Data Engineer by teaching you how to use Snowflake to build batch and streaming data pipelines. You will learn how to connect to external data stores, transform and cleanse data, and load data into Snowflake. You will also learn how to use Snowflake's built-in features to automate the data pipeline process.

See salaries and explore the career path for Data Engineer

Data Analyst

A Data Analyst is responsible for analyzing data to identify trends and patterns. This course can help you develop the skills you need to become a Data Analyst by teaching you how to use Snowflake to query and analyze data. You will learn how to use SQL to write queries, create visualizations, and build reports. You will also learn how to use Snowflake's built-in features to automate the data analysis process.

See salaries and explore the career path for Data Analyst

Database Administrator

A Database Administrator is responsible for managing and maintaining databases. This course can help you develop the skills you need to become a Database Administrator by teaching you how to use Snowflake to create and manage databases. You will learn how to create tables, indexes, and views. You will also learn how to use Snowflake's built-in features to automate the database administration process.

See salaries and explore the career path for Database Administrator

Data Scientist

A Data Scientist is responsible for developing and deploying machine learning models. This course can help you develop the skills you need to become a Data Scientist by teaching you how to use Snowflake to prepare and analyze data for machine learning. You will learn how to use SQL to write queries, create visualizations, and build reports. You will also learn how to use Snowflake's built-in features to automate the data preparation process.

See salaries and explore the career path for Data Scientist

Software Engineer

A Software Engineer is responsible for designing, developing, and maintaining software applications. This course can help you develop the skills you need to become a Software Engineer by teaching you how to use Snowflake to build data pipelines and data analysis applications. You will learn how to use SQL to write queries, create visualizations, and build reports. You will also learn how to use Snowflake's built-in features to automate the data pipeline and data analysis process.

See salaries and explore the career path for Software Engineer

Data Architect

A Data Architect is responsible for designing and managing data architectures. This course can help you develop the skills you need to become a Data Architect by teaching you how to use Snowflake to design and implement data pipelines and data warehouses. You will learn how to create data models, design data schemas, and implement data security. You will also learn how to use Snowflake's built-in features to automate the data architecture process.

See salaries and explore the career path for Data Architect

Cloud Architect

A Cloud Architect is responsible for designing and managing cloud computing environments. This course can help you develop the skills you need to become a Cloud Architect by teaching you how to use Snowflake to build data pipelines and data warehouses in the cloud. You will learn how to create and manage virtual machines, configure networks, and implement security. You will also learn how to use Snowflake's built-in features to automate the cloud architecture process.

See salaries and explore the career path for Cloud Architect

Business Intelligence Analyst

A Business Intelligence Analyst is responsible for analyzing data to identify trends and patterns that can help businesses make better decisions. This course can help you develop the skills you need to become a Business Intelligence Analyst by teaching you how to use Snowflake to query and analyze data. You will learn how to use SQL to write queries, create visualizations, and build reports. You will also learn how to use Snowflake's built-in features to automate the data analysis process.

See salaries and explore the career path for Business Intelligence Analyst

Data Management Consultant

A Data Management Consultant is responsible for helping businesses manage their data. This course can help you develop the skills you need to become a Data Management Consultant by teaching you how to use Snowflake to build data pipelines and data warehouses. You will learn how to create data models, design data schemas, and implement data security. You will also learn how to use Snowflake's built-in features to automate the data management process.

See salaries and explore the career path for Data Management Consultant

Project Manager

A Project Manager is responsible for planning, executing, and closing projects. This course may be useful for you if you are interested in becoming a Project Manager by teaching you how to use Snowflake to manage data projects. You will learn how to create project plans, track project progress, and manage project risks. You will also learn how to use Snowflake's built-in features to automate the project management process.

See salaries and explore the career path for Project Manager

Product Manager

A Product Manager is responsible for planning, developing, and launching products. This course may be useful for you if you are interested in becoming a Product Manager by teaching you how to use Snowflake to manage product data. You will learn how to create product roadmaps, track product progress, and manage product risks. You will also learn how to use Snowflake's built-in features to automate the product management process.

See salaries and explore the career path for Product Manager

Sales Engineer

A Sales Engineer is responsible for helping customers understand and use products and services. This course may be useful for you if you are interested in becoming a Sales Engineer by teaching you how to use Snowflake to demonstrate product capabilities. You will learn how to create demos, give presentations, and answer customer questions. You will also learn how to use Snowflake's built-in features to automate the sales process.

See salaries and explore the career path for Sales Engineer

Systems Analyst

A Systems Analyst is responsible for analyzing and designing systems. This course may be useful for you if you are interested in becoming a Systems Analyst by teaching you how to use Snowflake to model systems. You will learn how to create system models, design system architectures, and implement system security. You will also learn how to use Snowflake's built-in features to automate the systems analysis process.

See salaries and explore the career path for Systems Analyst

Technical Writer

A Technical Writer is responsible for writing and editing technical documentation. This course may be useful for you if you are interested in becoming a Technical Writer by teaching you how to use Snowflake to document data pipelines and data warehouses. You will learn how to write user guides, create technical specifications, and develop training materials. You will also learn how to use Snowflake's built-in features to automate the technical writing process.

See salaries and explore the career path for Technical Writer

Data Librarian

A Data Librarian is responsible for managing and organizing data. This course may be useful for you if you are interested in becoming a Data Librarian by teaching you how to use Snowflake to manage data assets. You will learn how to create data catalogs, define data governance policies, and implement data security. You will also learn how to use Snowflake's built-in features to automate the data management process.

See salaries and explore the career path for Data Librarian

Moving Data with Snowflake

What's inside

Syllabus

Good to know

Save this course

Activities

Career center

Reading list

Share

Similar courses