Probabilistic Deep Learning with TensorFlow 2 from Coursera

Welcome to this course on Probabilistic Deep Learning with TensorFlow!

This course builds on the foundational concepts and skills for TensorFlow taught in the first two courses in this specialisation, and focuses on the probabilistic approach to deep learning. This is an increasingly important area of deep learning that aims to quantify the noise and uncertainty that is often present in real world datasets. This is a crucial aspect when using deep learning models in applications such as autonomous vehicles or medical diagnoses; we need the model to know what it doesn't know.

You will learn how to develop probabilistic models with TensorFlow, making particular use of the TensorFlow Probability library, which is designed to make it easy to combine probabilistic models with deep learning. As such, this course can also be viewed as an introduction to the TensorFlow Probability library.

You will learn how probability distributions can be represented and incorporated into deep learning models in TensorFlow, including Bayesian neural networks, normalising flows and variational autoencoders. You will learn how to develop models for uncertainty quantification, as well as generative models that can create new samples similar to those in the dataset, such as images of celebrity faces.

You will put concepts that you learn about into practice straight away in practical, hands-on coding tutorials, which you will be guided through by a graduate teaching assistant. In addition there is a series of automatically graded programming assignments for you to consolidate your skills.

At the end of the course, you will bring many of the concepts together in a Capstone Project, where you will develop a variational autoencoder algorithm to produce a generative model of a synthetic image dataset that you will create yourself.

This course follows on from the previous two courses in the specialisation, Getting Started with TensorFlow 2 and Customising Your Models with TensorFlow 2. The additional prerequisite knowledge required in order to be successful in this course is a solid foundation in probability and statistics. In particular, it is assumed that you are familiar with standard probability distributions, probability density functions, and concepts such as maximum likelihood estimation, change of variables formula for random variables, and the evidence lower bound (ELBO) used in variational inference.

What's inside

Syllabus

TensorFlow Distributions

Probabilistic modelling is a powerful and principled approach that provides a framework in which to take account of uncertainty in the data. The TensorFlow Probability (TFP) library provides tools for developing probabilistic models that extend the capability of TensorFlow. In this first week of the course, you will learn how to use the Distribution objects in TFP, and the key methods to sample from and compute probabilities from these distributions. You will also learn how to make these distributions trainable. The programming assignment or this week will put these techniques into practice by implementing a Naive Bayes classifier on the Iris dataset.

Traffic lights

Read about what's good

what should give you pause

and possible dealbreakers

Introduces learners to foundational problems and methodologies in deep learning, which may be useful to continue studies in this field

Develops crucial skills for building models for uncertainty quantification and generative models in autonomous vehicles or medical diagnoses

Builds upon knowledge from the first two courses in this specialization

Requires a solid foundation in probability and statistics

In addition to theory, course includes practical hands-on coding tutorials led by a graduate teaching assistant

Offers a Capstone Project to synthesize learning by developing a variational autoencoder algorithm to produce a generative model of a synthetic image dataset

Reviews summary

In-depth probabilistic deep learning with tensorflow

According to learners, this course on Probabilistic Deep Learning with TensorFlow 2 is a highly valuable and practical resource for those seeking to understand uncertainty in deep learning. It offers a comprehensive introduction to the TensorFlow Probability library, exploring key models like Bayesian Neural Networks, Normalizing Flows, and Variational Autoencoders. Students particularly praise the hands-on coding tutorials and challenging programming assignments, culminating in a significant Capstone Project. While learners highlight its strong practical focus, a frequent point is the demanding prerequisites; a solid foundation in probability, statistics, and TensorFlow 2 is essential for success. This course is considered challenging yet rewarding, ideal for career-focused individuals aiming to quantify model uncertainty.

Pacing is fast; deep dives into complex topics for motivated learners.

"The pace was quite fast, especially for someone trying to grasp both the advanced theory and the TensorFlow Probability code simultaneously."

"For those with the right mathematical and TensorFlow background, the course moves at an ideal pace, covering a lot of ground efficiently."

"I wished for more rigorous theoretical derivations in some sections, but the practical focus for implementation was strong."

Covers key probabilistic deep learning models effectively.

"The course gives a great overview of Bayesian Neural Networks, Normalizing Flows, and VAEs, which are crucial for modern AI."

"I particularly enjoyed learning how to develop generative models using VAEs for image datasets, a fascinating application."

"It really helped me grasp the concepts behind uncertainty quantification in deep learning models, essential for critical applications."

Provides a comprehensive introduction to the TFP library.

"This course is an excellent introduction to TensorFlow Probability, making complex topics like bijectors accessible."

"I finally understood how to effectively use TFP Distribution objects and Bijectors for my own probabilistic models."

"The detailed explanations of probabilistic layers in TFP were incredibly helpful for extending my existing deep learning projects."

Focuses on hands-on coding and real-world model development.

"The hands-on coding and projects are the strongest part of the course for me, truly solidifying the concepts learned."

"I really appreciated the practical implementation of VAEs and Normalizing Flows; it's not just theory, I could build working models."

"The programming assignments, especially the Capstone Project, helped me apply what I learned immediately to real datasets."

Requires strong background in TensorFlow and advanced probability.

"Be warned, you really need a solid foundation in probability and statistics as stated; this isn't for beginners in the field."

"I found myself struggling without a deeper understanding of TensorFlow 2 and its customisation features, so prepare accordingly."

"The course assumes you're familiar with concepts like ELBO and MLE, which made it challenging but ultimately rewarding."

Activities

Be better prepared before your course. Deepen your understanding during and after it. Supplement your coursework and achieve mastery of the topics covered in Probabilistic Deep Learning with TensorFlow 2 with these activities:

Organize Course Resources and Notes

Show steps

Stay organized throughout the course by effectively managing your notes, assignments, and other materials.

Show steps

Create a system for organizing digital and physical materials.
Review and summarize key concepts from each class.

Read 'Probabilistic Machine Learning: A Bayesian and Frequentist Perspective'

Show steps

Strengthen your theoretical foundation in probabilistic machine learning through a comprehensive book that covers both Bayesian and frequentist approaches.

View Machine Learning on Amazon

Show steps

Read chapters on probability distributions, Bayesian inference, and generative models.

Explore Bijectors and Normalizing Flows

Show steps

Deepen your knowledge of bijectors and normalizing flows, enhancing your understanding of generative models.

Show steps

Follow a tutorial on implementing a RealNVP flow model.
Experiment with different bijector transformations.

Five other activities

Expand to see all activities and additional details

Show all eight activities

Attend a Workshop on TensorFlow Probability

Show steps

Engage with experts and fellow learners in a workshop dedicated to TensorFlow Probability, enhancing your practical skills.

Show steps

Research and identify relevant workshops.
Attend the workshop and actively participate.

Complete TensorFlow Probability Exercises

Show steps

Reinforce your understanding of TensorFlow Probability's core concepts through hands-on exercises.

Show steps

Implement a Bayesian neural network for the MNIST dataset.
Build a variational autoencoder for image generation.

Build a Generative Model for a Custom Dataset

Show steps

Apply your skills to create a generative model for a dataset of your choice, demonstrating your mastery of building and training probabilistic models.

Browse courses on Generative Models

Show steps

Collect or create a custom image dataset.
Train a variational autoencoder on the dataset.
Evaluate the model's performance and generate new samples.

Participate in a Probabilistic Deep Learning Competition

Show steps

Challenge yourself and showcase your skills by participating in a competition focused on probabilistic deep learning, gaining valuable experience.

Show steps

Identify and register for a relevant competition.
Develop and implement a probabilistic deep learning solution.
Submit your solution and evaluate your performance.

Develop a Tutorial on Probabilistic Deep Learning with TensorFlow

Show steps

Solidify your understanding by creating a tutorial that explains probabilistic deep learning concepts with TensorFlow, sharing your knowledge with others.

Show steps

Choose a specific topic within probabilistic deep learning to focus on.
Write clear and concise explanations of the concepts.
Include code examples and practical exercises.

Career center

Learners who complete Probabilistic Deep Learning with TensorFlow 2 will develop knowledge and skills that may be useful to these careers:

Machine Learning Researcher

As a Machine Learning Researcher, you will need a strong understanding of probability and statistics. This course can help you build a foundation in these areas, as well as provide you with the skills to develop probabilistic deep learning models. These models are becoming increasingly important in a variety of fields, such as autonomous vehicles and medical diagnoses. By taking this course, you will be well-prepared for a career in Machine Learning Research.

See salaries and explore the career path for Machine Learning Researcher

Data Scientist

As a Data Scientist, you will need to be able to develop and interpret probabilistic models. This course can help you build the skills needed to do this, as well as provide you with an understanding of the TensorFlow Probability library. TensorFlow Probability is a powerful tool that can be used to develop a variety of probabilistic models, including Bayesian neural networks and normalising flows. By taking this course, you will be well-prepared for a career in Data Science.

See salaries and explore the career path for Data Scientist

Software Engineer

As a Software Engineer, you may be required to develop probabilistic models. This course can help you build a foundation in probability and statistics, as well as provide you with the skills to develop these models in TensorFlow. TensorFlow is a popular deep learning library that is used in a variety of industries, including finance, healthcare, and manufacturing. By taking this course, you will be well-prepared for a career in Software Engineering.

See salaries and explore the career path for Software Engineer

Quantitative Analyst

As a Quantitative Analyst, you will need to be able to develop and interpret probabilistic models. This course can help you build the skills needed to do this, as well as provide you with an understanding of the TensorFlow Probability library. TensorFlow Probability is a powerful tool that can be used to develop a variety of probabilistic models, including Bayesian neural networks and normalising flows. By taking this course, you will be well-prepared for a career in Quantitative Analysis.

See salaries and explore the career path for Quantitative Analyst

Risk Analyst

As a Risk Analyst, you will need to be able to develop and interpret probabilistic models. This course can help you build the skills needed to do this, as well as provide you with an understanding of the TensorFlow Probability library. TensorFlow Probability is a powerful tool that can be used to develop a variety of probabilistic models, including Bayesian neural networks and normalising flows. By taking this course, you will be well-prepared for a career in Risk Analysis.

See salaries and explore the career path for Risk Analyst

Actuary

As an Actuary, you will need to be able to develop and interpret probabilistic models. This course can help you build the skills needed to do this, as well as provide you with an understanding of the TensorFlow Probability library. TensorFlow Probability is a powerful tool that can be used to develop a variety of probabilistic models, including Bayesian neural networks and normalising flows. By taking this course, you will be well-prepared for a career in Actuarial Science.

See salaries and explore the career path for Actuary

Statistician

As a Statistician, you will need to be able to develop and interpret probabilistic models. This course can help you build the skills needed to do this, as well as provide you with an understanding of the TensorFlow Probability library. TensorFlow Probability is a powerful tool that can be used to develop a variety of probabilistic models, including Bayesian neural networks and normalising flows. By taking this course, you will be well-prepared for a career in Statistics.

See salaries and explore the career path for Statistician

Data Analyst

As a Data Analyst, you will need to be able to interpret probabilistic models. This course can help you build the skills needed to do this, as well as provide you with an understanding of the TensorFlow Probability library. TensorFlow Probability is a powerful tool that can be used to develop a variety of probabilistic models, including Bayesian neural networks and normalising flows. By taking this course, you will be well-prepared for a career in Data Analysis.

See salaries and explore the career path for Data Analyst

Business Analyst

As a Business Analyst, you may be required to work with probabilistic models. This course can help you build a foundation in probability and statistics, as well as provide you with the skills to interpret these models. TensorFlow Probability is a powerful tool that can be used to develop a variety of probabilistic models, including Bayesian neural networks and normalising flows. By taking this course, you will be well-prepared for a career in Business Analysis.

See salaries and explore the career path for Business Analyst

Financial Analyst

As a Financial Analyst, you may be required to work with probabilistic models. This course can help you build a foundation in probability and statistics, as well as provide you with the skills to interpret these models. TensorFlow Probability is a powerful tool that can be used to develop a variety of probabilistic models, including Bayesian neural networks and normalising flows. By taking this course, you will be well-prepared for a career in Financial Analysis.

See salaries and explore the career path for Financial Analyst

Operations Research Analyst

As an Operations Research Analyst, you may be required to work with probabilistic models. This course can help you build a foundation in probability and statistics, as well as provide you with the skills to develop and interpret these models. TensorFlow Probability is a powerful tool that can be used to develop a variety of probabilistic models, including Bayesian neural networks and normalising flows. By taking this course, you will be well-prepared for a career in Operations Research.

See salaries and explore the career path for Operations Research Analyst

Product Manager

As a Product Manager, you may be required to work with probabilistic models. This course can help you build a foundation in probability and statistics, as well as provide you with the skills to interpret these models. TensorFlow Probability is a powerful tool that can be used to develop a variety of probabilistic models, including Bayesian neural networks and normalising flows. By taking this course, you will be well-prepared for a career in Product Management.

See salaries and explore the career path for Product Manager

Project Manager

As a Project Manager, you may be required to work with probabilistic models. This course can help you build a foundation in probability and statistics, as well as provide you with the skills to interpret these models. TensorFlow Probability is a powerful tool that can be used to develop a variety of probabilistic models, including Bayesian neural networks and normalising flows. By taking this course, you will be well-prepared for a career in Project Management.

See salaries and explore the career path for Project Manager

Consultant

As a Consultant, you may be required to work with probabilistic models. This course can help you build a foundation in probability and statistics, as well as provide you with the skills to develop and interpret these models. TensorFlow Probability is a powerful tool that can be used to develop a variety of probabilistic models, including Bayesian neural networks and normalising flows. By taking this course, you will be well-prepared for a career in Consulting.

See salaries and explore the career path for Consultant

Technical Writer

As a Technical Writer, you may be required to work with probabilistic models. This course can help you build a foundation in probability and statistics, as well as provide you with the skills to interpret these models. TensorFlow Probability is a powerful tool that can be used to develop a variety of probabilistic models, including Bayesian neural networks and normalising flows. By taking this course, you will be well-prepared for a career in Technical Writing.

See salaries and explore the career path for Technical Writer