Leveraging Unstructured Data with Cloud Dataproc on Google Cloud Platform 日本語版 from Coursera

この 1 週間の速習コースは、Data Engineering on Google Cloud Platform 専門講座の以前のコースを基にして作成されています。動画講義、デモ、ハンズオンラボを通して、Google Cloud Platform で Hadoop、Spark、Pig、Hive の各ジョブを実行するためのコンピューティングクラスタを作成、管理する方法を学びます。また、コンピューティングクラスタからクラウドストレージのさまざまなオプションにアクセスして、Google の機械学習機能を分析プログラムに統合する方法についても学習します。ハンズオンラボでは、ウェブコンソールと CLI を使って Dataproc クラスタを作成、管理し、クラスタを使用して Spark と Pig のジョブを実行します。次に、BigQuery およびストレージと統合する iPython ノートブックを作成し、Spark を活用します。最後に、機械学習 API をデータ分析に統合します。要件 • Google Cloud Platform Big Data & Machine Learning Fundamentals を修了していること（または同等の経験があること） • Python に関する知識があること

Good to know

Know what's good

, what to watch for

, and possible dealbreakers

Helps learners gain experience with Hadoop, Spark, Pig, and Hive, which are used by many Fortune 500 firms

Explores Google Cloud Platform, which is used by many fast-growing startups as well as established companies

Taught by Google Cloud Training, who provide training for Google's own products, which can add confidence in the accurateness of the material

Builds professional skills for individuals new to the field or seeking to explore job opportunities in data engineering

Activities

Be better prepared before your course. Deepen your understanding during and after it. Supplement your coursework and achieve mastery of the topics covered in Leveraging Unstructured Data with Cloud Dataproc on Google Cloud Platform 日本語版 with these activities:

Review foundational concepts in Python

Show steps

Strengthen the foundation by reviewing Python concepts.

Browse courses on Python

Show steps

Review online resources or textbooks on Python.
Complete practice exercises to test understanding.

Attend a local meetup or conference on Big Data

Show steps

Connect with professionals in the field and learn about industry trends.

Browse courses on Networking

Show steps

Research local meetups or conferences.
Attend the event and engage with other attendees.

Creating a Hadoop cluster

Show steps

Creating a Hadoop cluster will allow you to become more comfortable in a foundational aspect of the course

Browse courses on Hadoop

Show steps

Review documentation on creating a Hadoop cluster
Create a Hadoop cluster
Test your cluster

Six other activities

Expand to see all activities and additional details

Show all nine activities

Review Hadoop: The Definitive Guide

Show steps

Review Hadoop basics to strengthen understanding and build a foundation for the course.

View Hadoop: The Definitive Guide: Storage and... on Amazon

Show steps

Read chapters 1-3 to understand Hadoop architecture.
Install Hadoop on your local machine.
Run basic Hadoop commands to familiarize yourself with the system.

Organize and review course materials

Show steps

Enhance comprehension by organizing and reviewing course resources.

Show steps

Gather and organize course materials.
Review materials regularly to reinforce concepts.

Create a simple Hadoop cluster for practice

Show steps

Develop practical skills by creating your own Hadoop cluster.

Browse courses on Hadoop

Show steps

Set up a virtual machine or cloud environment.
Install Hadoop and configure the cluster.
Test the cluster by running a sample job.

Follow online tutorials on Pig and Hive

Show steps

Expand knowledge of Pig and Hive through guided tutorials.

Browse courses on Pig

Show steps

Locate tutorials on Pig and Hive.
Follow the tutorials to complete example tasks.

Develop a Spark application to analyze a large dataset

Show steps

Reinforce Spark concepts by building a practical data analysis application.

Browse courses on Spark

Show steps

Gather and preprocess the dataset.
Write a Spark program to perform data analysis tasks.
Visualize and interpret the analysis results.

Contribute to an open-source Big Data project

Show steps

Gain real-world experience and contribute to the Big Data community.

Browse courses on Open Source

Show steps

Identify open-source Big Data projects.
Review the documentation and contribute code or other resources.

Career center

Learners who complete Leveraging Unstructured Data with Cloud Dataproc on Google Cloud Platform 日本語版 will develop knowledge and skills that may be useful to these careers:

Data Scientist

Data Scientists use statistical and machine learning techniques to extract insights from data. They use a variety of tools and technologies, including Hadoop, Spark, Pig, Hive, and Google Cloud Platform. This course teaches the fundamentals of these tools and technologies, and provides hands-on experience in using them to build and manage data pipelines. This course can help you build a foundation for a successful career as a Data Scientist.

See salaries and explore the career path for Data Scientist

Machine Learning Engineer

Machine Learning Engineers build and maintain machine learning models. They use a variety of tools and technologies, including Hadoop, Spark, Pig, Hive, and Google Cloud Platform. This course teaches the fundamentals of these tools and technologies, and provides hands-on experience in using them to build and manage data pipelines. This course can help you build a foundation for a successful career as a Machine Learning Engineer.

See salaries and explore the career path for Machine Learning Engineer

Data Engineer

Data Engineers build and manage data pipelines, and develop systems and processes for organizing, storing, and analyzing large amounts of data. They use a variety of tools and technologies, including Hadoop, Spark, Pig, Hive, and Google Cloud Platform. This course teaches the fundamentals of these tools and technologies, and provides hands-on experience in using them to build and manage data pipelines. This course can help you build a foundation for a successful career as a Data Engineer.

See salaries and explore the career path for Data Engineer

Big Data Architect

Big Data Architects design and implement data management solutions for large and complex data sets. They use a variety of tools and technologies, including Hadoop, Spark, Pig, Hive, and Google Cloud Platform. This course teaches the fundamentals of these tools and technologies, and provides hands-on experience in using them to build and manage data pipelines. This course can help you build a foundation for a successful career as a Big Data Architect.

See salaries and explore the career path for Big Data Architect

Cloud Architect

Cloud Architects design and implement cloud computing solutions. They use a variety of tools and technologies, including Hadoop, Spark, Pig, Hive, and Google Cloud Platform. This course teaches the fundamentals of these tools and technologies, and provides hands-on experience in using them to build and manage cloud computing solutions. This course can help you build a foundation for a successful career as a Cloud Architect.

See salaries and explore the career path for Cloud Architect

Data Analyst

Data Analysts collect, analyze, and interpret data to identify trends and patterns. They use a variety of tools and technologies, including Hadoop, Spark, Pig, Hive, and Google Cloud Platform. This course teaches the fundamentals of these tools and technologies, and provides hands-on experience in using them to collect, analyze, and interpret data. This course can help you build a foundation for a successful career as a Data Analyst.

See salaries and explore the career path for Data Analyst

Business Intelligence Analyst

Business Intelligence Analysts use data to identify business opportunities and solve business problems. They use a variety of tools and technologies, including Hadoop, Spark, Pig, Hive, and Google Cloud Platform. This course teaches the fundamentals of these tools and technologies, and provides hands-on experience in using them to collect, analyze, and interpret data. This course can help you build a foundation for a successful career as a Business Intelligence Analyst.

See salaries and explore the career path for Business Intelligence Analyst

Software Engineer

Software Engineers design, develop, and maintain software systems. They use a variety of tools and technologies, including Hadoop, Spark, Pig, Hive, and Google Cloud Platform. This course teaches the fundamentals of these tools and technologies, and provides hands-on experience in using them to design, develop, and maintain software systems. This course can help you build a foundation for a successful career as a Software Engineer.

See salaries and explore the career path for Software Engineer

Data Governance Analyst

Data Governance Analysts develop and implement data governance policies and procedures. They use a variety of tools and technologies, including Hadoop, Spark, Pig, Hive, and Google Cloud Platform. This course teaches the fundamentals of these tools and technologies, and provides hands-on experience in using them to develop and implement data governance policies and procedures. This course can help you build a foundation for a successful career as a Data Governance Analyst.

See salaries and explore the career path for Data Governance Analyst

Data Warehouse Engineer

Data Warehouse Engineers design, develop, and maintain data warehouses. They use a variety of tools and technologies, including Hadoop, Spark, Pig, Hive, and Google Cloud Platform. This course teaches the fundamentals of these tools and technologies, and provides hands-on experience in using them to design, develop, and maintain data warehouses. This course can help you build a foundation for a successful career as a Data Warehouse Engineer.

See salaries and explore the career path for Data Warehouse Engineer

Database Administrator

Database Administrators manage and maintain databases. They use a variety of tools and technologies, including Hadoop, Spark, Pig, Hive, and Google Cloud Platform. This course teaches the fundamentals of these tools and technologies, and provides hands-on experience in using them to manage and maintain databases. This course can help you build a foundation for a successful career as a Database Administrator.

See salaries and explore the career path for Database Administrator

Data Integration Engineer

Data Integration Engineers design, develop, and maintain data integration systems. They use a variety of tools and technologies, including Hadoop, Spark, Pig, Hive, and Google Cloud Platform. This course teaches the fundamentals of these tools and technologies, and provides hands-on experience in using them to design, develop, and maintain data integration systems. This course can help you build a foundation for a successful career as a Data Integration Engineer.

See salaries and explore the career path for Data Integration Engineer

Cloud Data Engineer

Cloud Data Engineers design, develop, and maintain data pipelines in the cloud. They use a variety of tools and technologies, including Hadoop, Spark, Pig, Hive, and Google Cloud Platform. This course teaches the fundamentals of these tools and technologies, and provides hands-on experience in using them to design, develop, and maintain data pipelines in the cloud. This course can help you build a foundation for a successful career as a Cloud Data Engineer.

See salaries and explore the career path for Cloud Data Engineer

Data Security Analyst

Data Security Analysts protect data from unauthorized access, use, disclosure, disruption, modification, or destruction. They use a variety of tools and technologies, including Hadoop, Spark, Pig, Hive, and Google Cloud Platform. This course teaches the fundamentals of these tools and technologies, and provides hands-on experience in using them to protect data from unauthorized access, use, disclosure, disruption, modification, or destruction. This course can help you build a foundation for a successful career as a Data Security Analyst.

See salaries and explore the career path for Data Security Analyst

Data Architect

Data Architects design and develop data management solutions. They use a variety of tools and technologies, including Hadoop, Spark, Pig, Hive, and Google Cloud Platform. This course teaches the fundamentals of these tools and technologies, and provides hands-on experience in using them to design and develop data management solutions. This course can help you build a foundation for a successful career as a Data Architect.

See salaries and explore the career path for Data Architect