OpenCourser brand icon
Sign in
We may earn an affiliate commission when you visit our partners.
Course image
Course image
Coursera logo

Serverless Data Processing with Dataflow

Foundations - 日本語版

Google Cloud Training

このコースは、Dataflow を使用したサーバーレスのデータ処理に関する 3 コースシリーズのパート 1 です。この最初のコースでは、始めに Apache Beam とは何か、そして Dataflow とどのように関係しているかを復習します。次に、Apache Beam のビジョンと Beam Portability フレームワークの利点について説明します。Beam Portability フレームワークによって、デベロッパーが好みのプログラミング言語と実行バックエンドを使用できるビジョンが実現します。続いて、Dataflow によってどのように費用を節約しながらコンピューティングとストレージを分離できるか、そして識別ツール、アクセスツール、管理ツールがどのように Dataflow パイプラインと相互に機能するかを紹介します。最後に、Dataflow でそれぞれのユースケースに合った適切なセキュリティ モデルを実装する方法について学習します。

Enroll now

What's inside

Syllabus

はじめに
このモジュールでは、コースの概要を説明するとともに、Apache Beam プログラミング モデルと Google の Dataflow マネージド サービスについて簡単に復習します。
Beam Portability
このモジュールでは、Beam Portablity、Runner v2、コンテナ環境、言語間変換の 4 つのセクションについて学習します。
Read more
Dataflow を使用したコンピューティングとストレージの分離
このモジュールでは、Dataflow を使用してコンピューティングとストレージを分離する方法について説明します。このモジュールには、Dataflow、Dataflow Shuffle Service、Dataflow Streaming Engine、Flexible Resource Scheduling の 4 つのセクションが含まれています。
IAM、割り当て、権限
このモジュールでは、Dataflow を実行するのに必要な、さまざまな IAM ロール、割り当て、権限について説明します。
セキュリティ
このモジュールでは、Dataflow でそれぞれのユースケースに合った適切なセキュリティ モデルを実装する方法について学習します。
まとめ
このコースでは、始めに Apache Beam とは何か、そして Dataflow とどのように関係しているかを復習しました。

Good to know

Know what's good
, what to watch for
, and possible dealbreakers
Introduces learners to serverless data processing with Dataflow
Course is part of a three-course series on serverless data processing with Dataflow
Designed for beginners in Dataflow or serverless data processing
Instructors are from Google Cloud Training, the recognized experts in Dataflow

Save this course

Save Serverless Data Processing with Dataflow: Foundations - 日本語版 to your list so you can find it easily later:
Save

Activities

Be better prepared before your course. Deepen your understanding during and after it. Supplement your coursework and achieve mastery of the topics covered in Serverless Data Processing with Dataflow: Foundations - 日本語版 with these activities:
Organize notes, assignments, and resources from the course
Stay organized and improve your ability to review and reference course materials.
Show steps
  • Create a system for organizing notes
  • File and store assignments
  • Keep track of useful resources
Review basic programming concepts
Strengthen your foundation in programming concepts to enhance your ability to follow and implement Dataflow code.
Browse courses on Programming Fundamentals
Show steps
  • Review introductory programming concepts
  • Practice writing simple code snippets
Practice using the Apache Beam Programming Model to transform and process data
Reinforce your understanding of the Apache Beam Programming Model and practice applying it to transform and process data.
Browse courses on Data Transformation
Show steps
  • Familiarize yourself with the Apache Beam Programming Model
  • Implement data transformations using the Apache Beam API
  • Practice processing data streams using the Apache Beam Streaming API
Four other activities
Expand to see all activities and additional details
Show all seven activities
Follow video tutorials on Dataflow's advanced features
Enhance your understanding of Dataflow's capabilities by exploring video tutorials on its advanced features.
Browse courses on Streaming Data Processing
Show steps
  • Search for video tutorials on Dataflow's advanced features
  • Watch and follow the tutorials
  • Experiment with the features shown in the tutorials
Build a Dataflow pipeline to analyze a real-world dataset
Apply your knowledge of Dataflow by building a complete pipeline that addresses a real-world data analysis problem.
Browse courses on Big Data Analytics
Show steps
  • Identify a dataset and define the problem
  • Design the Dataflow pipeline
  • Implement the pipeline using Apache Beam and Dataflow
  • Deploy and monitor the pipeline
Attend a workshop on Dataflow best practices and optimization techniques
Learn from experienced practitioners and gain insights into optimizing and troubleshooting Dataflow pipelines.
Show steps
  • Research and identify workshops on Dataflow best practices
  • Attend the workshop
  • Apply the techniques learned to your own Dataflow projects
Participate in a Dataflow hackathon or competition
Challenge yourself and test your Dataflow skills in a competitive environment.
Show steps
  • Find and register for a Dataflow hackathon or competition
  • Form a team or collaborate with others
  • Design and implement a Dataflow solution
  • Submit your solution and compete for recognition

Career center

Learners who complete Serverless Data Processing with Dataflow: Foundations - 日本語版 will develop knowledge and skills that may be useful to these careers:
Data Scientist
A Data Scientist is someone who uses data to solve problems. This course may be useful to those looking to enter this field as it provides a foundation in the Apache Beam programming model and the Google Dataflow managed service, both of which are used extensively in data science.
See salaries and explore the career path for Data Scientist
Machine Learning Engineer
A Machine Learning Engineer is someone who develops and deploys machine learning models. This course may be useful to those looking to enter this field as it provides a foundation in the Apache Beam programming model and the Google Dataflow managed service, both of which are used extensively in machine learning.
See salaries and explore the career path for Machine Learning Engineer
Software Engineer
A Software Engineer is someone who designs, develops, and maintains software applications. This course may be useful to those looking to enter this field as it provides a foundation in the Apache Beam programming model and the Google Dataflow managed service, both of which are used extensively in software engineering.
See salaries and explore the career path for Software Engineer
Data Analyst
A Data Analyst is someone who analyzes data to find trends and patterns. This information can then be used to make better decisions. This course may be useful to those looking to enter this field as it provides a foundation in the Apache Beam programming model and the Google Dataflow managed service, both of which are used extensively in data analysis.
See salaries and explore the career path for Data Analyst
Database Administrator
A Database Administrator is someone who manages and maintains databases. This course may be useful to those looking to enter this field as it provides a foundation in the Apache Beam programming model and the Google Dataflow managed service, both of which are used extensively in database administration.
See salaries and explore the career path for Database Administrator
Data Engineer
A Data Engineer is someone who designs and builds data pipelines. Data pipelines help to ensure that data is available to those who need it, when they need it, and in the format that they need it. This course may be useful to those looking to enter this field as it provides a foundation in the Apache Beam programming model and the Google Dataflow managed service, both of which are used extensively in data engineering.
See salaries and explore the career path for Data Engineer
Cloud Architect
A Cloud Architect is someone who designs and builds cloud-based solutions. This course may be useful to those looking to enter this field as it provides a foundation in the Apache Beam programming model and the Google Dataflow managed service, both of which are used extensively in cloud architecture.
See salaries and explore the career path for Cloud Architect
Data Warehouse Engineer
A Data Warehouse Engineer is someone who designs and builds data warehouses. This course may be useful to those looking to enter this field as it provides a foundation in the Apache Beam programming model and the Google Dataflow managed service, both of which are used extensively in data warehousing.
See salaries and explore the career path for Data Warehouse Engineer
Data Visualization Specialist
A Data Visualization Specialist is someone who creates visual representations of data. This course may be useful to those looking to enter this field as it provides a foundation in the Apache Beam programming model and the Google Dataflow managed service, both of which are used extensively in data visualization.
See salaries and explore the career path for Data Visualization Specialist
Business Intelligence Analyst
A Business Intelligence Analyst is someone who uses data to make better business decisions. This course may be useful to those looking to enter this field as it provides a foundation in the Apache Beam programming model and the Google Dataflow managed service, both of which are used extensively in business intelligence.
See salaries and explore the career path for Business Intelligence Analyst
DevOps Engineer
A DevOps Engineer is someone who works to bridge the gap between development and operations. This course may be useful to those looking to enter this field as it provides a foundation in the Apache Beam programming model and the Google Dataflow managed service, both of which are used extensively in DevOps.
See salaries and explore the career path for DevOps Engineer
Data Governance Specialist
A Data Governance Specialist is someone who develops and implements data governance policies. This course may be useful to those looking to enter this field as it provides a foundation in the Apache Beam programming model and the Google Dataflow managed service, both of which are used extensively in data governance.
See salaries and explore the career path for Data Governance Specialist
Big Data Engineer
A Big Data Engineer is someone who works with large datasets. This course may be useful to those looking to enter this field as it provides a foundation in the Apache Beam programming model and the Google Dataflow managed service, both of which are used extensively in big data engineering.
See salaries and explore the career path for Big Data Engineer
Data Integration Engineer
A Data Integration Engineer is someone who integrates data from different sources. This course may be useful to those looking to enter this field as it provides a foundation in the Apache Beam programming model and the Google Dataflow managed service, both of which are used extensively in data integration.
See salaries and explore the career path for Data Integration Engineer

Reading list

We've selected five books that we think will supplement your learning. Use these to develop background knowledge, enrich your coursework, and gain a deeper understanding of the topics covered in Serverless Data Processing with Dataflow: Foundations - 日本語版.
Cover image
Secret Colors
Save
Provides a comprehensive overview of the principles and patterns for designing data-intensive applications. It covers a wide range of topics, including data modeling, data storage, and data processing.
Secret Colors
Paperback
Check
Secret Colors
Kindle Edition
Check
Cover image
Scalable Internet Architectures
Save
Provides an accessible introduction to distributed systems, covering the key concepts and principles. It valuable resource for anyone looking to understand how distributed systems work and how to build and maintain them.
Scalable Internet Architectures
Paperback
Check
Scalable Internet Architectures
Kindle Edition
Check
Cover image
Hadoop: The Definitive Guide
Save
Comprehensive guide to using Hadoop, which provides background knowledge that is helpful for understanding Apache Beam.
Hadoop: The Definitive Guide: Storage and Analysis...
Paperback
$$
Hadoop: The Definitive Guide
Kindle Edition
$$
Hadoop: The Definitive Guide
Paperback
$$
Hadoop: The Definitive Guide
Paperback
$$
Cover image
Spark: The Definitive Guide
Save
Comprehensive guide to using Spark, which provides background knowledge that is helpful for understanding Apache Beam.
Spark: The Definitive Guide
Paperback
Check
Spark: The Definitive Guide
Kindle Edition
Check
Cover image
Kafka: The Definitive Guide
Save
Comprehensive guide to using Apache Kafka, which popular distributed streaming platform. This book can provide additional context and background knowledge for Apache Beam.
Kafka: The Definitive Guide: Real-Time Data and...
Paperback
$$$

Share

Help others find this course page by sharing it with your friends and followers:
Facebook
LinkedIn
Reddit
X
Link
Email

Similar courses

Here are nine courses similar to Serverless Data Processing with Dataflow: Foundations - 日本語版.
通訳者が教える基本動詞116のイメージと声に出して学ぶ例文演習法Vol.３：動詞を使いこなせば英語を話すのが楽になる...
Most relevant
通訳者が教える 英語筋肉の鍛え方と使い方 / 誰でも英語が話せるようになる発音練習法A to Zその４・発音編
Most relevant
通訳者が教える前置詞・助動詞・フレーズのイメージをマスターする講座：誰でも英語が話せるようになるシリーズその５
Most relevant
【教科書英語にさようなら!】 海外に行かずに2024年のリアル英会話をマスターするためのステップバイステップガイド
Most relevant
TOEIC L&Rテスト・単語力強化で絶対攻略！1ヶ月で1000単語を楽しく暗記するタニケイ式ボキャビル
Most relevant
英語リスニング力UP！ 【日本人のためのアメリカ英語発音講座 Vol.1】
Most relevant
【No２コース...
Most relevant
ディープラーニング : Pythonでゼロから構築し学ぶ人工知能（AI）と深層学習の原理
Most relevant
ChatGPT API入門－PythonによるAPI基本操作から、業務で使える実践的なChatGPT活用法を学ぼう
Most relevant
Course image
Level
Intermediate
Via
Coursera
Institution
Google Cloud
Instructor
Google Cloud Training
Language
English
Transcript
日本語
Good to know
Introduces learners to serverless data processing with Dataflow
Course is part of a three-course series on serverless data processing with Dataflow
Designed for beginners in Dataflow or serverless data processing
Instructors are from Google Cloud Training, the recognized experts in Dataflow
Share and help others discover this course
Facebook LinkedIn X Reddit Link Email
Our mission

OpenCourser helps millions of learners each year. People visit us to learn workspace skills, ace their exams, and nurture their curiosity.

Our extensive catalog contains over 50,000 courses and twice as many books. Browse by search, by topic, or even by career interests. We'll match you to the right resources quickly.

Find this site helpful? Tell a friend about us.

Affiliate disclosure

We're supported by our community of learners. When you purchase or subscribe to courses and programs or purchase books, we may earn a commission from our partners.

Your purchases help us maintain our catalog and keep our servers humming without ads.

Thank you for supporting OpenCourser.

© 2016 - 2024 OpenCourser