Serverless Data Processing with Dataflow: Operations en Español from Coursera

What's inside

Syllabus

Introducción

En este módulo, se aborda la descripción del curso.

Monitoring

En este módulo, aprenderemos a usar la página Lista de trabajos para filtrar los trabajos que deseamos supervisar o investigar. Observaremos cómo las pestañas Gráfico del trabajo, Información del trabajo y Métricas del trabajo brindan en conjunto un resumen completo de su trabajo de Dataflow. Por último, aprenderemos a usar la integración de Dataflow en el Explorador de métricas a fin de crear políticas de alertas para métricas de Dataflow.

Informes de errores y registros

En este módulo, aprenderemos a usar el panel Registro ubicado al final de las páginas Grafo de trabajo y Métricas del trabajo, y sobre la página Informes de errores centralizada.

Solución de problemas y depuración

En este módulo, aprenderemos a depurar canalizaciones de Dataflow y solucionar sus problemas. También revisaremos los cuatro modos habituales de fallas de Dataflow: falla en la compilación de canalizaciones, falla en el inicio de la canalización de Dataflow, falla en la ejecución de canalizaciones y problemas de rendimiento.

Rendimiento

En este módulo, analizaremos las consideraciones de rendimiento que se deben tener presentes cuando se desarrollan canalizaciones por lotes y de transmisión en Dataflow.

Testing y CI/CD

En este módulo, analizaremos cómo realizar pruebas de unidades de las canalizaciones de Dataflow. También presentaremos los frameworks y las funciones disponibles a fin de optimizar su flujo de trabajo de CI/CD para las canalizaciones de Dataflow.

Confiabilidad

En este módulo, analizaremos métodos para compilar sistemas que sean resilientes ante la corrupción de datos y las interrupciones de los centros de datos.

Plantillas Flexibles

En este módulo, se abordan las plantillas flexibles, una función que ayuda a los equipos de ingeniería a estandarizar y reutilizar el código de las canalizaciones de Dataflow. Muchos desafíos operativos se pueden solucionar con las plantillas flexibles.

Resumen

En este módulo, se revisan los temas abordados en el curso.

Good to know

Know what's good

, what to watch for

, and possible dealbreakers

Esta parte de la serie de cursos de Dataflow investiga el modelo operativo de Dataflow

Examina las herramientas y técnicas que permiten solucionar problemas y optimizar el rendimiento de las canalizaciones

Estudia las prácticas recomendadas de las pruebas, la implementación y la confiabilidad en relación con las canalizaciones de Dataflow

Concluye con una revisión de las plantillas, que facilitan el ajuste de escala de las canalizaciones de Dataflow para organizaciones con cientos de usuarios

Estas clases asegurarán que su plataforma de datos sea estable y resiliente ante circunstancias inesperadas

Activities

Be better prepared before your course. Deepen your understanding during and after it. Supplement your coursework and achieve mastery of the topics covered in Serverless Data Processing with Dataflow: Operations en Español with these activities:

Explore the Dataflow documentation.

Show steps

You will become more familiar with the Dataflow ecosystem and resources.

Show steps

Visit the Dataflow website.
Read the Dataflow documentation.
Watch the Dataflow video tutorials.

Review the fundamentals of Java.

Show steps

To understand Dataflow, it is important to have a strong understanding of the basics of Java programming.

Browse courses on Java Programming

Show steps

Review the basic syntax of Java.
Review the principles of object-oriented programming.
Practice writing Java code to solve simple problems.

Develop a sample streaming pipeline in Dataflow

Show steps

This activity will improve your ability to understand and apply the Dataflow programming model.

Show steps

Create a Dataflow project.
Set up your development environment.
Write a simple streaming pipeline.

Four other activities

Expand to see all activities and additional details

Show all seven activities

Collaborate on Dataflow projects with other learners.

Show steps

This will enhance your understanding of Dataflow and provide opportunities to troubleshoot problems.

Show steps

Join an online Dataflow community.
Meet with other learners.
Work together on Dataflow projects.

Build a real-time data analytics application using Dataflow.

Show steps

This will help you apply your knowledge and skills to a practical problem.

Show steps

Define the problem you want to solve.
Design your Dataflow pipeline.
Implement your pipeline.

Create complex Dataflow pipelines.

Show steps

This activity will improve your skills in designing and implementing complex pipelines.

Show steps

Study the Dataflow documentation on advanced topics.
Practice writing complex Dataflow pipelines.
Troubleshoot and debug your pipelines.

Develop a scalable and reliable Dataflow pipeline for a large-scale data processing application.

Show steps

This will challenge you to apply your skills to a real-world problem and improve your ability to design and implement scalable and reliable systems.

Show steps

Define the requirements for your application.
Design a scalable and reliable Dataflow pipeline.
Implement your pipeline and deploy it to a production environment.

Career center

Learners who complete Serverless Data Processing with Dataflow: Operations en Español will develop knowledge and skills that may be useful to these careers:

Data Engineer

Data Engineers are responsible for building and maintaining data pipelines. They work with data analysts and data scientists to design and implement data pipelines that meet the needs of the business. This course can help you become a Data Engineer by teaching you the concepts of data processing and how to build and maintain data pipelines.

See salaries and explore the career path for Data Engineer

Data Analyst

Data Analysts are responsible for analyzing data to find trends and patterns. They use this information to help businesses make better decisions. This course can help you become a Data Analyst by teaching you the concepts of data processing and how to analyze data to find trends and patterns.

See salaries and explore the career path for Data Analyst

Data Scientist

Data Scientists are responsible for developing and implementing machine learning models. They use these models to help businesses solve problems and make better decisions. This course can help you become a Data Scientist by teaching you the concepts of data processing and how to develop and implement machine learning models.

See salaries and explore the career path for Data Scientist

Software Engineer

Software Engineers are responsible for designing, developing, and maintaining software applications. They work with data engineers and data scientists to develop software applications that use data to solve problems and make better decisions. This course can help you become a Software Engineer by teaching you the concepts of data processing and how to build and maintain software applications.

See salaries and explore the career path for Software Engineer

Operations Research Analyst

Operations Research Analysts are responsible for applying mathematical and analytical techniques to solve problems in business and industry. They use this course to help businesses make better decisions. This course can help you become an Operations Research Analyst by teaching you the concepts of data processing and how to apply mathematical and analytical techniques to solve problems in business and industry.

See salaries and explore the career path for Operations Research Analyst

Business Analyst

Business Analysts are responsible for analyzing business processes and identifying opportunities for improvement. They use this information to help businesses make better decisions. This course can help you become a Business Analyst by teaching you the concepts of data processing and how to analyze business processes and identify opportunities for improvement.

See salaries and explore the career path for Business Analyst

Market Research Analyst

Market Research Analysts are responsible for conducting surveys and analyzing data to understand consumer behavior. They use this information to help businesses make better decisions. This course can help you become a Market Research Analyst by teaching you the concepts of data processing and how to conduct surveys and analyze data to understand consumer behavior.

See salaries and explore the career path for Market Research Analyst

Management Analyst

Management Analysts are responsible for studying an organization's operations and recommending ways to improve them. They work with data engineers and data scientists to design and implement systems that use data to solve problems and make better decisions.

See salaries and explore the career path for Management Analyst

Systems Analyst

Systems Analysts are responsible for studying an organization's information needs and designing and implementing systems to meet those needs. They work with data engineers and data scientists to design and implement systems that use data to solve problems and make better decisions.

See salaries and explore the career path for Systems Analyst

Statistician

Statisticians are responsible for collecting, analyzing, and interpreting data. They use this information to help businesses make better decisions. This course can help you become a Statistician by teaching you the concepts of data processing and how to collect, analyze, and interpret data.

See salaries and explore the career path for Statistician

Quality Assurance Analyst

Quality Assurance Analysts are responsible for testing software applications to find defects. They work with software engineers and data scientists to find defects in software applications and improve their quality.

See salaries and explore the career path for Quality Assurance Analyst

Database Administrator

Database Administrators are responsible for managing and maintaining databases. They work with data engineers and data scientists to ensure that databases are running smoothly and are available to users. This course can help you become a Database Administrator by teaching you the concepts of data processing and how to manage and maintain databases.

See salaries and explore the career path for Database Administrator

Information Security Analyst

Information Security Analysts are responsible for protecting an organization's data from unauthorized access. They work with data engineers and data scientists to develop and implement security measures to protect data from unauthorized access.

See salaries and explore the career path for Information Security Analyst

Computer Systems Analyst

Computer Systems Analysts are responsible for studying an organization's computer systems and recommending ways to improve them. They work with data engineers and data scientists to ensure that computer systems are running smoothly and are available to users.

See salaries and explore the career path for Computer Systems Analyst

Network Administrator

Network Administrators are responsible for managing and maintaining computer networks. They work with data engineers and data scientists to ensure that networks are running smoothly and are available to users.

See salaries and explore the career path for Network Administrator