Building Resilient Streaming Analytics Systems on Google Cloud from Pluralsight

Processing streaming data is becoming increasingly popular as streaming enables businesses to get real-time metrics on business operations. This course covers how to build streaming data pipelines on Google Cloud. Pub/Sub is described for handling incoming streaming data. The course also covers how to apply aggregations and transformations to streaming data using Dataflow, and how to store processed records to BigQuery or Cloud Bigtable for analysis. Learners get hands-on experience building streaming data pipeline components on Google Cloud by using QwikLabs.

What's inside

Syllabus

Introduction

Introduction to Processing Streaming Data

Serverless Messaging with Pub/Sub

Dataflow Streaming Features

High-Throughput BigQuery and Bigtable Streaming Features

Advanced BigQuery Functionality and Performance

Course Summary

Course Resources

Good to know

Know what's good

, what to watch for

, and possible dealbreakers

Teaches specialized skills that are highly relevant to business operations

Enables learners to build streaming data pipelines on Google Cloud using QwikLabs

Covers advanced BigQuery functionality and performance

Taught by Google Cloud, a recognized leader in cloud computing

Covers essential components of streaming data pipelines, including Pub/Sub, Dataflow, and BigQuery or Cloud Bigtable

Provides hands-on experience with streaming data pipeline components

Activities

Be better prepared before your course. Deepen your understanding during and after it. Supplement your coursework and achieve mastery of the topics covered in Building Resilient Streaming Analytics Systems on Google Cloud with these activities:

Review Fundamentals of Pub/Sub

Show steps

This activity will ensure that you have a solid understanding of the core concepts of Pub/Sub, the service used to handle incoming streaming data in the course.

Browse courses on Pub/Sub

Show steps

Review the Pub/Sub documentation (https://cloud.google.com/pubsub/docs/quickstart-client-libraries).
Create a Pub/Sub topic and subscription (https://cloud.google.com/pubsub/docs/quickstart).

Follow a Tutorial on Advanced BigQuery Features

Show steps

This activity will ensure that you are familiar with advanced BigQuery features, which will be used to store and analyze processed streaming data in the course.

Browse courses on BigQuery

Show steps

Identify a specific BigQuery feature that you want to learn more about.
Find a tutorial or documentation on that feature (https://cloud.google.com/bigquery/docs/).
Follow the tutorial and complete the exercises.

Practice Building Streaming Data Pipelines with Dataflow

Show steps

This activity will provide you with hands-on experience in building streaming data pipelines using Dataflow, the service used to process streaming data in the course.

Browse courses on Dataflow

Show steps

Follow the Dataflow Quickstart (https://cloud.google.com/dataflow/docs/quickstart).
Build a simple streaming data pipeline that reads data from a Pub/Sub topic and writes data to a BigQuery table.

Five other activities

Expand to see all activities and additional details

Show all eight activities

Attend a Meetup on Streaming Data Technologies

Show steps

This activity will provide you with an opportunity to connect with professionals in the field of streaming data.

Browse courses on Data Pipelines

Show steps

Research streaming data meetups in your area (https://www.meetup.com).
Attend a meetup and introduce yourself to other attendees.

Attend an Online Workshop on Streaming Data Analytics

Show steps

This activity will expose you to industry best practices and innovative techniques in streaming data analytics.

Browse courses on Streaming Data Analytics

Show steps

Research online workshops on streaming data analytics.
Register for a workshop that aligns with your interests and learning goals.
Attend the workshop and actively participate in discussions.

Create a Presentation on Streaming Data Architectures

Show steps

This activity will challenge you to synthesize your understanding of streaming data architectures and communicate it effectively.

Browse courses on Data Pipelines

Show steps

Research different streaming data architectures.
Design a streaming data architecture for a specific use case.
Create a presentation that explains your architecture and its benefits.

Write a Blog Post on Streaming Data Best Practices

Show steps

This activity will encourage you to think critically about streaming data best practices and share your knowledge with the community.

Browse courses on Data Pipelines

Show steps

Research streaming data best practices.
Identify a specific best practice that you want to write about.
Write a blog post that discusses the best practice, its benefits, and how to implement it.

Participate in a Streaming Data Hackathon

Show steps

This activity will challenge you to apply your streaming data skills in a real-world setting.

Browse courses on Data Pipelines

Show steps

Find a streaming data hackathon that aligns with your interests.
Form a team or participate individually.
Develop a streaming data solution that addresses the hackathon challenge.

Career center

Learners who complete Building Resilient Streaming Analytics Systems on Google Cloud will develop knowledge and skills that may be useful to these careers:

Data Analyst

Data Analysts design, implement, and maintain the systems that collect, process, and interpret data. They work with stakeholders to understand their business needs and translate them into technical requirements. This course helps build a foundation in streaming data analytics, which is a critical skill for Data Analysts in the modern era, where real-time data is increasingly important.

See salaries and explore the career path for Data Analyst

Data Engineer

Data Engineers are responsible for designing, building, and maintaining the infrastructure that stores and processes data. They work with Data Analysts and other stakeholders to understand the business needs and design systems that meet those needs. This course helps build a foundation in streaming data analytics, which is an important skill for Data Engineers who want to work with real-time data.

See salaries and explore the career path for Data Engineer

Data Scientist

Data Scientists use data to solve business problems. They work with stakeholders to understand the business needs and use data to develop solutions. This course helps build a foundation in streaming data analytics, which is a critical skill for Data Scientists who want to work with real-time data.

See salaries and explore the career path for Data Scientist

Machine Learning Engineer

Machine Learning Engineers design, build, and maintain machine learning models. They work with stakeholders to understand the business needs and use data to develop models that meet those needs. This course helps build a foundation in streaming data analytics, which is an important skill for Machine Learning Engineers who want to work with real-time data.

See salaries and explore the career path for Machine Learning Engineer

Software Engineer

Software Engineers design, build, and maintain software applications. They work with stakeholders to understand the business needs and develop software that meets those needs. This course helps build a foundation in streaming data analytics, which is an important skill for Software Engineers who want to work with real-time data.

See salaries and explore the career path for Software Engineer

Business Analyst

Business Analysts work with stakeholders to understand their business needs and develop solutions that meet those needs. They may also be responsible for gathering and analyzing data to support decision-making. This course may be useful for Business Analysts who want to learn more about streaming data analytics.

See salaries and explore the career path for Business Analyst

Product Manager

Product Managers are responsible for the development and launch of new products. They work with stakeholders to understand the market needs and develop products that meet those needs. This course may be useful for Product Managers who want to learn more about streaming data analytics, which can be used to track product usage and identify opportunities for improvement.

See salaries and explore the career path for Product Manager

Marketing Manager

Marketing Managers are responsible for developing and executing marketing campaigns. They work with stakeholders to understand the target market and develop campaigns that reach that market. This course may be useful for Marketing Managers who want to learn more about streaming data analytics, which can be used to track campaign performance and identify opportunities for improvement.

See salaries and explore the career path for Marketing Manager

Sales Manager

Sales Managers are responsible for leading sales teams and achieving sales goals. They work with stakeholders to understand the sales process and develop strategies to improve sales performance. This course may be useful for Sales Managers who want to learn more about streaming data analytics, which can be used to track sales performance and identify opportunities for improvement.

See salaries and explore the career path for Sales Manager

Customer Success Manager

Customer Success Managers are responsible for ensuring that customers are satisfied with their products or services. They work with customers to identify their needs and develop solutions that meet those needs. This course may be useful for Customer Success Managers who want to learn more about streaming data analytics, which can be used to track customer satisfaction and identify opportunities for improvement.

See salaries and explore the career path for Customer Success Manager

Operations Manager

Operations Managers are responsible for the day-to-day operations of a business. They work with stakeholders to understand the business needs and develop processes that meet those needs. This course may be useful for Operations Managers who want to learn more about streaming data analytics, which can be used to track operational performance and identify opportunities for improvement.

See salaries and explore the career path for Operations Manager

Financial Analyst

Financial Analysts are responsible for analyzing financial data and making recommendations on investments. They work with stakeholders to understand the investment goals and develop strategies to achieve those goals. This course may be useful for Financial Analysts who want to learn more about streaming data analytics, which can be used to track financial performance and identify opportunities for improvement.

See salaries and explore the career path for Financial Analyst

Auditor

Auditors are responsible for examining financial records and ensuring that they are accurate and compliant with all applicable laws and regulations. They work with stakeholders to understand the company's financial reporting requirements and develop audit plans to meet those requirements. This course may be useful for Auditors who want to learn more about streaming data analytics, which can be used to track audit performance and identify opportunities for improvement.

See salaries and explore the career path for Auditor

Risk Analyst

Risk Analysts are responsible for identifying and assessing risks. They work with stakeholders to understand the organization's risk appetite and develop strategies to mitigate those risks. This course may be useful for Risk Analysts who want to learn more about streaming data analytics, which can be used to track risk exposure and identify opportunities for mitigation.

See salaries and explore the career path for Risk Analyst

Compliance Officer

Compliance Officers are responsible for ensuring that a company complies with all applicable laws and regulations. They work with stakeholders to understand the company's compliance obligations and develop policies and procedures to meet those obligations. This course may be useful for Compliance Officers who want to learn more about streaming data analytics, which can be used to track compliance performance and identify opportunities for improvement.

See salaries and explore the career path for Compliance Officer