We may earn an affiliate commission when you visit our partners.
Pluralsight logo

Workflow Orchestration with Google Cloud Composer

Saravanan Dhandapani

In this course, *Workflow Orchestration with Google Cloud Composer*, you’ll learn to create and deploy a workflow application in Google Cloud Composer. First, you’ll explore the core concepts of Apache Airflow and Google Cloud Composer. Next, you’ll discover the basic constructs that make up a DAG and learn how to write and execute one. Then, you will learn how to secure, troubleshoot, and optimize the workflow. Finally, you’ll learn how to integrate Google Cloud Composer with other Google Services. When you’re finished with this course, you’ll have the skills and knowledge to execute Python-based DAGs on Google Cloud Composer needed to create high-performing workflow applications.

Enroll now

Good to know

Know what's good
, what to watch for
, and possible dealbreakers
Explores fundamental concepts in the field of workflow orchestration
Focuses on using Google Cloud Composer, a renowned platform in the industry
Taught by Saravanan Dhandapani, an experienced instructor in the field
Provides practical, hands-on exercises to reinforce learning
Suitable for learners with some background in Python and cloud computing

Save this course

Save Workflow Orchestration with Google Cloud Composer to your list so you can find it easily later:
Save

Activities

Coming soon We're preparing activities for Workflow Orchestration with Google Cloud Composer . These are activities you can do either before, during, or after a course.

Career center

Learners who complete Workflow Orchestration with Google Cloud Composer will develop knowledge and skills that may be useful to these careers:
Software Engineer
A Software Engineer crafts software solutions based on client needs. Using programming languages and writing software code, a Software Engineer is responsible for implementing and testing applications for a variety of devices, including computers, mobile phones, and tablets. Workflow Orchestration with Google Cloud Composer can be a helpful complement to your goals in this field, as learning about writing and executing DAGs can help you to create efficient workflows in your software solutions.
Software Development Manager
A Software Development Manager leads and manages software development teams to deliver high-quality software products. With a strong understanding of software development methodologies and project management, a Software Development Manager ensures that software projects are completed on time, within budget, and to the required quality standards. Workflow Orchestration with Google Cloud Composer may be useful to you as a Software Development Manager, as you learn about managing and orchestrating complex software development workflows.
Data Analyst
A Data Analyst transforms raw data into insights, trends, and reports using statistical analysis and data mining techniques. With a strong understanding of data analysis tools and techniques, a Data Analyst helps businesses make data-driven decisions. Workflow Orchestration with Google Cloud Composer may be useful to you as a Data Analyst, as you learn about creating automated workflows that can process and analyze large datasets efficiently.
Data Engineer
A Data Engineer designs, builds, and maintains data pipelines and infrastructure to support data-intensive applications. Using their expertise in data management and cloud technologies, a Data Engineer ensures that data is accessible, reliable, and secure. Workflow Orchestration with Google Cloud Composer may be useful to you as a Data Engineer, as you learn about creating automated workflows that can handle data ingestion, processing, and transformation tasks efficiently.
Cloud Architect
A Cloud Architect designs, builds, and manages cloud computing solutions for businesses. Using their expertise in cloud technologies and infrastructure, a Cloud Architect ensures that cloud solutions are scalable, reliable, and cost-effective. Workflow Orchestration with Google Cloud Composer may be useful to you as a Cloud Architect, as you learn about architecting and deploying workflow applications in the cloud.
DevOps Engineer
A DevOps Engineer collaborates with development and operations teams to improve the speed and quality of software delivery. With a strong understanding of software development and IT operations, a DevOps Engineer automates and streamlines the software delivery process. The concepts covered in Workflow Orchestration with Google Cloud Composer may be useful to you as a DevOps Engineer, as you learn about automating and orchestrating complex software delivery pipelines.
IT Manager
An IT Manager plans, implements, and manages IT infrastructure and services for an organization. With a strong understanding of IT technologies and business needs, an IT Manager ensures that IT solutions are aligned with business goals and support the organization's operations. Workflow Orchestration with Google Cloud Composer may be useful to you as an IT Manager, as you learn about managing and orchestrating IT workflows to improve efficiency and reduce costs.
Chief Technology Officer (CTO)
A Chief Technology Officer (CTO) leads and manages an organization's technology strategy and operations. With a strong understanding of technology trends and business needs, a CTO ensures that technology investments align with business goals and drive innovation. Workflow Orchestration with Google Cloud Composer may be useful to you as a CTO, as you learn about architecting and managing complex technology solutions to support the organization's mission and objectives.
Data Warehouse Architect
A Data Warehouse Architect designs, builds, and maintains data warehouses to support data-intensive applications. With a strong understanding of data warehousing technologies and data modeling techniques, a Data Warehouse Architect ensures that data warehouses are scalable, reliable, and meet the performance requirements of the business. Workflow Orchestration with Google Cloud Composer may be useful to you as a Data Warehouse Architect, as you learn about architecting and deploying workflow applications for data warehousing tasks.
Big Data Engineer
A Big Data Engineer designs, builds, and maintains big data infrastructure and applications. With a strong understanding of big data technologies and cloud platforms, a Big Data Engineer ensures that big data solutions are scalable, reliable, and cost-effective. Workflow Orchestration with Google Cloud Composer may be useful to you as a Big Data Engineer, as you learn about architecting and deploying workflow applications for big data processing.
Systems Architect
A Systems Architect develops high-level designs for complex systems, such as networks, software applications, or cloud-based infrastructure. Using their knowledge of system integration and software implementation, a Systems Architect creates solutions that leverage multiple technologies to achieve business goals. The concepts covered in Workflow Orchestration with Google Cloud Composer may be helpful to you as a Systems Architect, as you learn about architecting workflows in a scalable and reliable way.
Data Scientist
A Data Scientist uses statistical analysis, machine learning, and data mining techniques to extract insights from data. With a strong understanding of data science and programming, a Data Scientist develops models and algorithms to solve complex business problems. Workflow Orchestration with Google Cloud Composer may be useful to you as a Data Scientist, as you learn about automating and scaling data science workflows.
Cloud Operations Manager
A Cloud Operations Manager plans, implements, and manages cloud computing infrastructure and services for an organization. With a strong understanding of cloud technologies and operations, a Cloud Operations Manager ensures that cloud solutions are scalable, reliable, and cost-effective. Workflow Orchestration with Google Cloud Composer may be useful to you as a Cloud Operations Manager, as you learn about managing and orchestrating cloud operations workflows to improve efficiency and reduce costs.
Machine Learning Engineer
A Machine Learning Engineer designs, develops, and deploys machine learning models for a variety of applications. With a strong understanding of machine learning algorithms and cloud technologies, a Machine Learning Engineer builds and maintains machine learning infrastructure to support data-driven decision-making. Workflow Orchestration with Google Cloud Composer may be useful to you as a Machine Learning Engineer, as you learn about automating and scaling machine learning workflows.
Business Analyst
A Business Analyst gathers and analyzes business requirements to develop solutions that meet the needs of the organization. With a strong understanding of business processes and technology, a Business Analyst bridges the gap between business and IT to ensure that technology solutions align with business goals. Workflow Orchestration with Google Cloud Composer may be useful to you as a Business Analyst, as you learn about automating and streamlining business processes using workflow applications.

Reading list

We've selected five books that we think will supplement your learning. Use these to develop background knowledge, enrich your coursework, and gain a deeper understanding of the topics covered in Workflow Orchestration with Google Cloud Composer .
While not specific to Airflow, this book provides valuable insights into the principles and patterns of designing and building scalable, fault-tolerant, and performant data-intensive applications.
While not specific to Airflow, this book provides a solid foundation in Python, the programming language used in Airflow DAGs, and its core data analysis libraries, such as NumPy, Pandas, and Matplotlib, essential for data manipulation and visualization in workflow applications.
Popular introduction to Python programming, focusing on practical automation tasks like web scraping and data manipulation.
Provides a comprehensive overview of Python for data analysis, including its core libraries such as NumPy, Pandas, and Matplotlib.

Share

Help others find this course page by sharing it with your friends and followers:

Similar courses

Here are nine courses similar to Workflow Orchestration with Google Cloud Composer .
Building Pipelines for Workflow Orchestration Using...
Most relevant
Cloud Composer: Copying BigQuery Tables Across Different...
Most relevant
Cloud Composer: Qwik Start - Console
Most relevant
Cloud Composer: Qwik Start - Command Line
Most relevant
Productionalizing Data Pipelines with Apache Airflow 1
Most relevant
Orchestrating a TFX Pipeline with Airflow
Most relevant
The Complete Hands-On Introduction to Apache Airflow
Most relevant
Introduction to Airflow
Most relevant
Building ETL and Data Pipelines with Bash, Airflow and...
Most relevant
Our mission

OpenCourser helps millions of learners each year. People visit us to learn workspace skills, ace their exams, and nurture their curiosity.

Our extensive catalog contains over 50,000 courses and twice as many books. Browse by search, by topic, or even by career interests. We'll match you to the right resources quickly.

Find this site helpful? Tell a friend about us.

Affiliate disclosure

We're supported by our community of learners. When you purchase or subscribe to courses and programs or purchase books, we may earn a commission from our partners.

Your purchases help us maintain our catalog and keep our servers humming without ads.

Thank you for supporting OpenCourser.

© 2016 - 2024 OpenCourser