OpenCourser brand icon
Sign in
We may earn an affiliate commission when you visit our partners.
Course image
Course image
Coursera logo

Building Resilient Streaming Analytics Systems on Google Cloud

Google Cloud Training

Processing streaming data is becoming increasingly popular as streaming enables businesses to get real-time metrics on business operations. This course covers how to build streaming data pipelines on Google Cloud. Pub/Sub is described for handling incoming streaming data. The course also covers how to apply aggregations and transformations to streaming data using Dataflow, and how to store processed records to BigQuery or Cloud Bigtable for analysis. Learners get hands-on experience building streaming data pipeline components on Google Cloud by using QwikLabs.

Enroll now

What's inside

Syllabus

Introduction
This module introduces the course and agenda
Introduction to Processing Streaming Data
This modules talks about challenges with processing streaming data
Read more
Serverless Messaging with Pub/Sub
This module talks about using Pub/Sub to ingest incoming streaming data
Dataflow Streaming Features
This module revisits Dataflow and focuses on its streaming data processing capabilities
High-Throughput BigQuery and Bigtable Streaming Features
This modules covers BigQuery and Bigtable for streaming data
Advanced BigQuery Functionality and Performance
This module dives into more advanced features of BigQuery
Summary
This module recaps the topics covered in course

Good to know

Know what's good
, what to watch for
, and possible dealbreakers
Teaches learners how to build streaming data pipelines on Google Cloud
Delves into advanced features of BigQuery, assisting learners in optimizing their data storage and analysis capabilities
Emphasizes hands-on experience by utilizing QwikLabs, enabling learners to apply their knowledge in a practical setting
Addresses the challenges associated with streaming data processing, providing learners with a comprehensive understanding of potential obstacles
Aligned with industry practices, utilizing Pub/Sub for handling incoming streaming data, ensuring learners are equipped with up-to-date knowledge

Save this course

Save Building Resilient Streaming Analytics Systems on Google Cloud to your list so you can find it easily later:
Save

Reviews summary

Recommended google cloud data engineering course

Learners say this course on building resilient streaming analytics systems on Google Cloud gets largely positive reviews. It engages learners with various hands-on labs, where learners praise the real-world applicability of concepts and the usefulness of the Qwiklabs. The course is said to be well-structured and practical, offering a comprehensive overview of the subject matter. However, some learners have noted that certain instructors can be difficult to understand and that some labs may be difficult to complete due to bugs or outdated materials.
The course offers engaging and informative content, with real-world examples and practical labs.
"A great introduction course to the GCP services that makes easier the building of streaming systems."
"Clair et completC'est parce qu'il y a ce genre de contenu que je progresse beaucoup plus vite sur GCP que sur les autres plateformes."
"Great labs to make the course very useful!"
The course's labs are highly praised for providing practical experience and real-world applicability.
"I really enjoyed this course. There is ample time in the labs to experiment and get familiar with the concepts and techniques being taught in this course."
"The labs are very useful"
"Many opportunities to use Cloud Dataflow and effective ways of using Google's big data warehouse, BigQuery."
Some learners have reported difficulty in understanding certain instructors and completing labs due to bugs or outdated materials.
"Sometimes the presenter in week two spoke unclear."
"The videos or Nitis are extremely unintelligeble and the trascripts are just not helping much."
"Few labs with bugs that didn't allow me to complete the course for a while.."

Activities

Be better prepared before your course. Deepen your understanding during and after it. Supplement your coursework and achieve mastery of the topics covered in Building Resilient Streaming Analytics Systems on Google Cloud with these activities:
Review Python Fundamentals
Ensure a strong foundation in Python, which is essential for working with Dataflow and other streaming data technologies.
Browse courses on Python
Show steps
  • Review basic syntax and data structures.
  • Complete a few practice problems.
Review Basic Data Analysis Concepts
Refresh your understanding of data analysis concepts, which will help you better understand and apply streaming data techniques.
Browse courses on Data Analysis
Show steps
  • Review descriptive statistics.
  • Review inferential statistics.
Review Data Science from Scratch
Review the foundational concepts and techniques of data science, providing a strong foundation for the course.
View Data Science from Scratch: First Principles... on Amazon
Show steps
  • Read chapters 1-3.
  • Complete the exercises in chapters 1-3.
  • Summarize the key concepts from chapters 1-3.
Five other activities
Expand to see all activities and additional details
Show all eight activities
Build a Simple Data Pipeline with Pub/Sub
Gain hands-on experience with the fundamental components of a data pipeline by building your own.
Browse courses on Pub/Sub
Show steps
  • Create a Pub/Sub topic and subscription.
  • Write a Python script to publish data to the topic.
  • Create a Dataflow pipeline to process the data from the subscription.
  • Write the data to a BigQuery table.
  • Test and iterate on your pipeline.
Follow Google Cloud Training's 'Building Streaming Data Pipelines' Guide
Reinforce the concepts covered in the course by following a structured guide provided by the course instructors.
Browse courses on Streaming Data Pipelines
Show steps
  • Read the guide.
  • Complete the hands-on labs.
  • Review the sample code and documentation.
Solve Dataflow Streaming Coding Challenges
Enhance your understanding of Dataflow's streaming capabilities by solving coding challenges.
Browse courses on Dataflow
Show steps
  • Find coding challenges online or on platforms like HackerRank.
  • Attempt to solve the challenges.
  • Review the solutions and learn from your mistakes.
Write a Blog Post on a Streaming Data Pipeline Technique
Deepen your understanding and share your knowledge by writing about a specific technique used in streaming data pipelines.
Show steps
  • Choose a specific technique.
  • Research and gather information.
  • Write a blog post explaining the technique.
  • Share your blog post.
Contribute to a Dataflow Open-Source Project
Gain practical experience and contribute to the streaming data ecosystem by participating in an open-source project.
Browse courses on Open Source
Show steps
  • Find an open-source project related to Dataflow.
  • Identify an issue or feature to work on.
  • Fork the project and make your changes.
  • Submit a pull request.
  • Review feedback and iterate on your contribution.

Career center

Learners who complete Building Resilient Streaming Analytics Systems on Google Cloud will develop knowledge and skills that may be useful to these careers:
Data Engineer
Data Engineers are responsible for designing, building, and managing data processing pipelines. This course provides a foundation in the tools and technologies used by Data Engineers, including Pub/Sub, Dataflow, BigQuery, and Bigtable. By completing this course, you will gain the skills needed to build streaming data pipelines that can process real-time data and provide valuable insights to businesses.
See salaries and explore the career path for Data Engineer
Data Analyst
Data Analysts use data to solve business problems and make informed decisions. This course provides a foundation in the tools and technologies used by Data Analysts, including Pub/Sub, Dataflow, BigQuery, and Bigtable. By completing this course, you will gain the skills needed to analyze streaming data and provide valuable insights to businesses.
See salaries and explore the career path for Data Analyst
Machine Learning Engineer
Machine Learning Engineers build and deploy machine learning models. This course provides a foundation in the tools and technologies used by Machine Learning Engineers, including Pub/Sub, Dataflow, BigQuery, and Bigtable. By completing this course, you will gain the skills needed to build streaming data pipelines that can collect and process data in real time, enabling you to build more accurate and timely models.
See salaries and explore the career path for Machine Learning Engineer
Data Scientist
Data Scientists use data to build models that can predict future outcomes. This course provides a foundation in the tools and technologies used by Data Scientists, including Pub/Sub, Dataflow, BigQuery, and Bigtable. By completing this course, you will gain the skills needed to build streaming data pipelines that can collect and process data in real time, enabling you to build more accurate and timely models.
See salaries and explore the career path for Data Scientist
Data Integration Engineer
Data Integration Engineers design and build data integration solutions. This course provides a foundation in the tools and technologies used by Data Integration Engineers, including Pub/Sub, Dataflow, BigQuery, and Bigtable. By completing this course, you will gain the skills needed to build streaming data pipelines that can process real-time data and provide valuable insights to businesses.
See salaries and explore the career path for Data Integration Engineer
Software Engineer
Software Engineers design, build, and maintain software applications. This course provides a foundation in the tools and technologies used by Software Engineers, including Pub/Sub, Dataflow, BigQuery, and Bigtable. By completing this course, you will gain the skills needed to build streaming data pipelines that can process real-time data and provide valuable insights to businesses.
See salaries and explore the career path for Software Engineer
Cloud Architect
Cloud Architects design and manage cloud computing environments. This course provides a foundation in the tools and technologies used by Cloud Architects, including Pub/Sub, Dataflow, BigQuery, and Bigtable. By completing this course, you will gain the skills needed to build streaming data pipelines that can process real-time data and provide valuable insights to businesses.
See salaries and explore the career path for Cloud Architect
DevOps Engineer
DevOps Engineers work to bridge the gap between development and operations teams. This course provides a foundation in the tools and technologies used by DevOps Engineers, including Pub/Sub, Dataflow, BigQuery, and Bigtable. By completing this course, you will gain the skills needed to build streaming data pipelines that can process real-time data and provide valuable insights to businesses.
See salaries and explore the career path for DevOps Engineer
Systems Engineer
Systems Engineers design and manage complex systems. This course provides a foundation in the tools and technologies used by Systems Engineers, including Pub/Sub, Dataflow, BigQuery, and Bigtable. By completing this course, you will gain the skills needed to build streaming data pipelines that can process real-time data and provide valuable insights to businesses.
See salaries and explore the career path for Systems Engineer
Business Intelligence Analyst
Business Intelligence Analysts use data to help businesses make better decisions. This course provides a foundation in the tools and technologies used by Business Intelligence Analysts, including Pub/Sub, Dataflow, BigQuery, and Bigtable. By completing this course, you will gain the skills needed to analyze streaming data and provide valuable insights to businesses.
See salaries and explore the career path for Business Intelligence Analyst
Sales Engineer
Sales Engineers help customers understand and purchase products and services. This course may be useful for Sales Engineers who are interested in learning about the tools and technologies used to build streaming data pipelines. By completing this course, you will gain a better understanding of the challenges and opportunities associated with processing streaming data.
See salaries and explore the career path for Sales Engineer
Technical Writer
Technical Writers create and maintain documentation for software and hardware products. This course may be useful for Technical Writers who are interested in learning about the tools and technologies used to build streaming data pipelines. By completing this course, you will gain a better understanding of the challenges and opportunities associated with processing streaming data.
See salaries and explore the career path for Technical Writer
Product Manager
Product Managers are responsible for the development and management of products. This course may be useful for Product Managers who are interested in learning about the tools and technologies used to build streaming data pipelines. By completing this course, you will gain a better understanding of the challenges and opportunities associated with processing streaming data.
See salaries and explore the career path for Product Manager
Marketing Analyst
Marketing Analysts use data to help businesses understand their customers and develop marketing campaigns. This course may be useful for Marketing Analysts who are interested in learning about the tools and technologies used to build streaming data pipelines. By completing this course, you will gain a better understanding of the challenges and opportunities associated with processing streaming data.
See salaries and explore the career path for Marketing Analyst
Project Manager
Project Managers plan and execute projects. This course may be useful for Project Managers who are interested in learning about the tools and technologies used to build streaming data pipelines. By completing this course, you will gain a better understanding of the challenges and opportunities associated with processing streaming data.
See salaries and explore the career path for Project Manager

Reading list

We've selected ten books that we think will supplement your learning. Use these to develop background knowledge, enrich your coursework, and gain a deeper understanding of the topics covered in Building Resilient Streaming Analytics Systems on Google Cloud.
Cover image
Hands-On Machine Learning with Scikit-Learn, Keras,...
Save
Provides a comprehensive overview of large-scale machine learning with TensorFlow. It covers the basics of TensorFlow, as well as more advanced topics such as distributed training, model optimization, and serving.
Hands-On Machine Learning with Scikit-Learn, Keras,...
Paperback
$$
Hands-On Machine Learning with Scikit-Learn, Keras,...
Paperback
$$$
Hands-On Machine Learning with Scikit-Learn, Keras,...
Kindle Edition
$$
Cover image
Deep Learning with Python, Second Edition
Save
Provides a comprehensive overview of deep learning with Python. It covers the basics of deep learning, as well as more advanced topics such as convolutional neural networks, recurrent neural networks, and generative adversarial networks.
Deep Learning with Python, Second Edition
Paperback
$$
Deep Learning with Python, Second Edition
Kindle Edition
$$
Cover image
Hands-On Machine Learning with Scikit-Learn, Keras,...
Save
Provides a hands-on introduction to machine learning with Scikit-Learn, Keras, and TensorFlow. It covers the basics of machine learning, as well as more advanced topics such as data preprocessing, model selection, and hyperparameter tuning.
Hands-On Machine Learning with Scikit-Learn, Keras,...
Paperback
$$
Hands-On Machine Learning with Scikit-Learn, Keras,...
Paperback
$$$
Hands-On Machine Learning with Scikit-Learn, Keras,...
Kindle Edition
$$
Cover image
Data-Intensive Text Processing with MapReduce
Save
Provides a comprehensive overview of data-intensive text processing with MapReduce. It covers the basics of MapReduce, as well as more advanced topics such as natural language processing, information retrieval, and machine learning.
Data-Intensive Text Processing with MapReduce...
Paperback
$$
Cover image
Natural Language Processing with Python
Save
Provides a comprehensive overview of natural language processing with Python. It covers the basics of natural language processing, as well as more advanced topics such as machine learning, deep learning, and information retrieval.
Natural Language Processing with Python: Analyzing...
Paperback
$$$
Natural Language Processing with Python: Analyzing...
Kindle Edition
$$
Cover image
Speech and Language Processing. An Introduction to...
Save
Provides a comprehensive overview of speech and language processing. It covers the basics of speech and language processing, as well as more advanced topics such as machine learning, deep learning, and natural language processing.
Speech and Language Processing An Introduction to...
Paperback
$$
Cover image
Computer Vision
Save
Provides a comprehensive overview of computer vision. It covers the basics of computer vision, as well as more advanced topics such as machine learning, deep learning, and image processing.
Computer Vision
Paperback
Check
Computer Vision
Kindle Edition
Check
Pattern Recognition and Machine Learning
Save
Provides a comprehensive overview of pattern recognition and machine learning. It covers the basics of pattern recognition and machine learning, as well as more advanced topics such as statistical learning, Bayesian inference, and neural networks.
Pattern Recognition and Machine Learning...
Hardcover
$$$
Pattern Recognition and Machine Learning...
Paperback
$$$
Pattern Recognition and Machine Learning (text...
Unknown Binding
$$$$
Cover image
MACHINE LEARNING
Save
Provides a comprehensive overview of machine learning from an algorithmic perspective. It covers the basics of machine learning, as well as more advanced topics such as supervised learning, unsupervised learning, and reinforcement learning.
Machine Learning: An Algorithmic Perspective,...
Hardcover
$$$
Machine Learning: An Algorithmic Perspective...
Paperback
$$
An Algorithmic Perspective on Machine Learning (2nd...
Paperback
$$$
Machine Learning: An Algorithmic Perspective,...
Kindle Edition
$$$
Cover image
Data Science for Business
Save
Provides a comprehensive overview of data science for business. It covers the basics of data science, as well as more advanced topics such as data mining, machine learning, and data visualization.
Data Science for Business: What You Need to Know...
Paperback
$$
Data Science for Business: What You Need to Know...
Kindle Edition
$$

Share

Help others find this course page by sharing it with your friends and followers:
Facebook
LinkedIn
Reddit
X
Link
Email

Similar courses

Here are nine courses similar to Building Resilient Streaming Analytics Systems on Google Cloud.
Building Resilient Streaming Analytics Systems on Google...
Most relevant
Serverless Data Processing with Dataflow: Foundations
Most relevant
Building Batch Data Pipelines on Google Cloud
Building Realtime Pipelines in Cloud Data Fusion
Conceptualizing the Processing Model for Azure Databricks...
Machine Learning Operations (MLOps) with Vertex AI:...
Building Batch Data Pipelines on Google Cloud
Exploring the Apache Beam SDK for Modeling Streaming Data...
Smart Analytics, Machine Learning, and AI on Google Cloud
Course image
Level
Intermediate
Via
Coursera
Institution
Google Cloud
Instructor
Google Cloud Training
Language
English
Building Resilient Streaming Analytics Systems on Google Cloud belongs to the following collections:
  1. Data Engineering, Big Data, and Machine Learning on GCP
  2. Preparing for Google Cloud Certification: Cloud Data Engineer
Good to know
Teaches learners how to build streaming data pipelines on Google Cloud
Delves into advanced features of BigQuery, assisting learners in optimizing their data storage and analysis capabilities
Emphasizes hands-on experience by utilizing QwikLabs, enabling learners to apply their knowledge in a practical setting
Addresses the challenges associated with streaming data processing, providing learners with a comprehensive understanding of potential obstacles
Aligned with industry practices, utilizing Pub/Sub for handling incoming streaming data, ensuring learners are equipped with up-to-date knowledge
Share and help others discover this course.
Facebook LinkedIn X Reddit Link Email
Don't miss out
Enroll today to gain access to this course
Enroll in this course
Our mission

OpenCourser helps millions of learners each year. People visit us to learn workspace skills, ace their exams, and nurture their curiosity.

Our extensive catalog contains over 50,000 courses and twice as many books. Browse by search, by topic, or even by career interests. We'll match you to the right resources quickly.

Find this site helpful? Tell a friend about us.

Affiliate disclosure

We're supported by our community of learners. When you purchase or subscribe to courses and programs or purchase books, we may earn a commission from our partners.

Your purchases help us maintain our catalog and keep our servers humming without ads.

Thank you for supporting OpenCourser.

© 2016 - 2024 OpenCourser