We may earn an affiliate commission when you visit our partners.
Course image
Yan Yan and Gady Agam

An introduction to the field of deep learning, including neural networks, convolutional neural networks, recurrent neural networks, transformers, generative models, neural network compression and transfer learning. This course will benefit students’ careers as a machine learning engineer or data scientist.

Enroll now

What's inside

Syllabus

Module 1: Neural Networks
Welcome to Deep Learning! In module 1, we will give an introduction to deep learning. Deep learning is a branch of machine learning which is based on artificial neural networks. It is capable of learning complex patterns and relationships within data. Particularly, we will discuss feed-forward deep neural network. We will also discuss backpropagation – the way to optimize deep neural networks.
Read more
Module 2: Convolutional Neural Networks (CNNs)
In module 2, we will discuss Convolutional Neural Networks (CNNs). A CNN, also known as ConvNet, is a specialized type of deep learning algorithm mainly designed for tasks that necessitate object recognition, including image classification, detection, and segmentation. Particularly, we will discuss the important layers in CNNs, such as convolution, pooling. We will also show different CNN applications.
Module 3: Deep Learning Tips
In module 3, we will provide important practical deep learning tips including activation function chosen, adaptive gradient descent learning methods, regularization and dropout.
Module 4: Recurrent Neural Networks (RNNs)
In module 4, we will discuss Recurrent Neural Networks (RNNs) which are used for sequential data. RNN is a type of Neural Network where the output from the previous step is fed as input to the current step. Particularly we will discuss Vanila version RNNs and Long Short-term Memory (LSTM). We will also discuss the learning problems on RNNs.
Module 5: Generative Models (GANs) and Diffusion Models (DMs)
In module 5, we will discuss the generative models. Particularly, Generative Adversarial Networks (GANs) and Diffusion Models (DMs). GANs are a way of training a generative model by framing the problem as a supervised learning problem with two sub-models: the generator model that we train to generate new examples, and the discriminator model that tries to classify examples as either real or fake. DMs are Markov chain of diffusion steps to slowly add random noise to data and then learn to reverse the diffusion process to construct desired data samples from the noise.
Module 6: Self-attention and Transformers
In module 6, we will discuss a powerful deep learning model - transformer. The transformer is a neural network component that can be used to learn useful representations of sequences or sets of data-points. The transformer has driven recent advances in natural language processing, computer vision, and spatio-temporal modelling.
Module 7: Neural Network Compression
In module 7, we will discuss neural network compression. Model compression reduces the size of a neural network without compromising accuracy. This size reduction is important because bigger neural networks are difficult to deploy on resource-constrained devices.
Module 8: Transfer Learning
In module 8, we will discuss transfer learning. Transfer learning is a machine learning technique that reuses a completed model that was developed for one task as the starting point for a new model to accomplish a new task. Particularly, we will discuss fine-tuning, multitask learning, domain adverbial training and zero-shot learning.
Summative Course Assessment
This module contains the summative course assessment that has been designed to evaluate your understanding of the course material and assess your ability to apply the knowledge you have acquired throughout the course.

Good to know

Know what's good
, what to watch for
, and possible dealbreakers
Teaches deep learning and machine learning methods used for object recognition
Instructed by experts in deep learning and machine learning
Covers foundational material in deep learning, including foundational and advanced topics
Suitable for learners with no prior knowledge in deep learning
Provides practical, applicable knowledge and skills
May require access to additional resources, which could incur costs

Save this course

Save Deep Learning to your list so you can find it easily later:
Save

Activities

Be better prepared before your course. Deepen your understanding during and after it. Supplement your coursework and achieve mastery of the topics covered in Deep Learning with these activities:
Review 'Deep Learning' by Yoshua Bengio
Build a strong foundation by reading the seminal textbook on Deep Learning
View Deep Learning on Amazon
Show steps
  • Read and summarize Chapter 1: Introduction
  • Read and complete exercises for Chapter 2: Feedforward Neural Networks
  • Read and summarize Chapter 3: Convolutional Neural Networks
Solve practice problems on backpropagation
Strengthen your foundation in how neural networks learn
Browse courses on Backpropagation
Show steps
  • Solve 10 practice problems on backpropagation
  • Debug your code or approach with a peer or TA
Attend weekly study group for discussion and Q&A
Deepen your understanding through peer collaboration and exchange of ideas
Browse courses on Neural Networks
Show steps
  • Regularly attend study group sessions
  • Actively participate in discussions and ask questions
  • Prepare questions or topics to present to the group
Five other activities
Expand to see all activities and additional details
Show all eight activities
Review 'Recurrent Neural Networks' by Alex Graves
Expand your knowledge of RNNs and their applications
Show steps
  • Read and summarize Chapter 1: Introduction to RNNs
  • Read and complete exercises for Chapter 2: LSTM Networks
  • Read and summarize Chapter 3: Applications of RNNs
Build a neural network model for image classification
Gain practical experience in applying neural networks to real-world problems
Browse courses on Neural Networks
Show steps
  • Collect or find a dataset of images
  • Build a neural network model using a framework like PyTorch or TensorFlow
  • Train and evaluate your model
  • Present your results to peers or instructors for feedback
Follow a tutorial on Generative Adversarial Networks
Gain exposure to advanced and emerging techniques in Deep Learning
Show steps
  • Find a comprehensive tutorial on GANs
  • Follow the tutorial step-by-step and implement your own GAN model
  • Share your results with the community or apply them to a project
Contribute to an open-source deep learning library
Gain practical experience and network with the deep learning community
Browse courses on Deep Learning
Show steps
  • Identify a suitable open-source project
  • Fork the project and make a contribution
  • Submit a pull request and engage with the project maintainers
Start a personal project on neural network compression
Enhance your understanding of advanced topics and develop your problem-solving abilities
Browse courses on Deep Learning
Show steps
  • Define the scope and goals of your project
  • Research existing techniques and algorithms
  • Implement and test your own compression methods
  • Evaluate and compare your results against baselines

Career center

Learners who complete Deep Learning will develop knowledge and skills that may be useful to these careers:

Reading list

We haven't picked any books for this reading list yet.

Share

Help others find this course page by sharing it with your friends and followers:

Similar courses

Here are nine courses similar to Deep Learning.
Implementing Multi-layer Neural Networks with TFLearn
Neural Networks Demystified for Data Professionals
Build, Train, and Deploy Your First Neural Network with...
Neural Networks for Data Professionals: A Comprehensive...
Using Neural Networks for Image and Voice Data Analysis
Physics Informed Neural Networks (PINNs)
The Complete Neural Networks Bootcamp: Theory,...
Introduction to Deep Learning & Neural Networks with Keras
Neural Networks and Deep Learning
Our mission

OpenCourser helps millions of learners each year. People visit us to learn workspace skills, ace their exams, and nurture their curiosity.

Our extensive catalog contains over 50,000 courses and twice as many books. Browse by search, by topic, or even by career interests. We'll match you to the right resources quickly.

Find this site helpful? Tell a friend about us.

Affiliate disclosure

We're supported by our community of learners. When you purchase or subscribe to courses and programs or purchase books, we may earn a commission from our partners.

Your purchases help us maintain our catalog and keep our servers humming without ads.

Thank you for supporting OpenCourser.

© 2016 - 2024 OpenCourser