Improving Deep Neural Networks

ike usual andrew ng perfect explanation simple go to essential stuff.the minus points some troubles with notebookbig thanks for andrew ng's team.

Course if full of rare intuitions you could get only from someone like Andrew Ng.

宝贵的超参数调试经验，谢谢分享 Prof. Andrew Ng is fantastic at explaining complex ideas in a systematic, easy to understand way.

Great course, Andrew Ng is just the best teacher for NN and machine learning.

Andrew Ng does a GREAT job of breaking things down and making it easy.

just astonishingly brilliant course by andrew ng and crew Course was concise and assignments were well guided.

Really well taught by Professor Andrew Ng.

Thank you Such a wonderful course, no one can the material simpler than Andrew Ng.

Andrew Ng and the teaching assistants' team of this class are obviously very very determined not to leave any single major subject in deep learning without coverage.

Thank you Andrew Ng.

Andrew Ng is really an excellent teacher, perfect pace and great course overall!

As always Prof Andrew Ng is brilliant in elucidating complex concepts and techniques in simple and intuitive language.

The course make sense of all you learned previously on deep neural networks.

It is really great and it help you to get starting to Tensorflow True to the claimed learning objectives, the course Improving Deep Neural Networks shows some of the magic behind deep learning algorithms.

Awesome course by awesome teacher :)) Great Course and great learning 好 Very informative course on tuning the deep neural networks.

Having introduced the building blocks of deep neural networks, in this course Andrew teaches more advanced and practical concepts - like: regularization, advanced optimization techniques, batch-normalization, etc - that can significantly improve the implementation of the models we build.Also, in this course we get to learn TensorFlow, a widely used and wonderful deep learning framework.I highly recommend this course.Thank you Andrew & Co. :-) Good demonstration It was very helpful to grasp the differences in the concept of 'Normalization, Regularization and Optimization' Thank you for clarifying the most relevant techniques for improving the methods.

Excellent course and explanations on fundamental concepts for improving deep neural networks.

Very useful guidelines to achieve successful results developing Deep Neural Networks Excellent course, even using intuitions Prof. Andrew Ng is able to communicate the very details of the different regularization approaches, as well how to do a good hyper-parameter search.

I this course I learned how to improve Deep Neural Networks by applying different methods that help to speed up the convergence and to reduce overfitting.

Awesome Course Very good course about more critical concepts when building deep neural networks.

Very very useful tips and tricks about the most frequently used techniques for improving the performance of deep neural networks.

Highly recommended if you know deep neural networks and willing to dive deeper into them.

A solid course in working with deep neural networks.

good but would have been great if tensorflow is covered more It is amazingly rewarding to learn from Andrew, who is able to articulate so much insights into so many complicated refinements of Deep Neural Networks from so many different research papers.

Covers batch norm and optimizers nicely.

Like I could not imagine how backward propagation should be implemented in batch norm.

Batch Norm blew my mind.

Good overview of batch normalization.

batch normalization, one-hot encoding, softmax classification) with synthetic data on the third week.

One star was taken off, as I would like to see more in-depth info on Batch Norm and a bit more discussion on how to compute gradients in case that is used.

I never had this deep understanding of tuning hyperparameters, batch normalization and regularization before taking this course, though I went through several online material.

Just one minor point imo that the tutorial on TensorFlow may need to go deeper for those techniques mentioned previously in this course, for instance implementing batch norm.

Gained insight into many things like Batch Normalization and L2 regularization!

well explained concepts on hyper-parameter tuning batch normalization and programming frameworks You could have focussed more on Tensor Flow.Concepts are explained very well.I loved this curse.

Also, my understanding of batch norm improved.

Really helped me gain a detailed understanding of optimization techniques such as RMSprop and Adam, as well as the inner workings of batch normalization.

The class should include more introduction on the current ml frameworks such as tensor flow etc.

But anyway, this course is already good enough A very nice course providing intuitions and concepts for tuning the hyper parameters in a neural network.Also, provides a taste of using Tensor Flow (Neural Network Framework) in a comprehensive manner.

this course is very good it gives good practical ways to implement neural networks in python and with Tensor Flow, i like it very much I REALLY ENJOYED IT !!!!

nice I would like to have a brief introduction to Tensor Flow or a simple beginners tutorial (at least to have it clearer the usage of variables, constants and placeholders) Practical with lots of helpful tips.

Nice introduction to hyper-parameter tuning and tensor flow.

Exceptional Course, the Hyper parameters explanations are excellent every tip and advice provided help me so much to build better models, I also really liked the introduction of Tensor Flow Thanks.

Tensor flow tutorial is excellent.

The instructions, tips made Tensor flow coding section to be easy .

Cleared up a lot of my confusion about tensor flow.

I, however have one suggestion, the Introduction to Tensor Flow looked quite fast and could have been done in a better way by giving more slides about TensorFlow and then going on to the examples.

Useful material and good teacher but the grading system has some serious issues This course was excellent, however the Tensor flow at the end feels a little bit like the ML field is quickly being overtaken by the frameworks, and the Tensor flow section is a little bit tacked onto this course, maybe in a hurry.

Tensor flow is a very important tool and its inclusion in this course is a plus.

Batch Normalization4).

Some more advanced topics are presented that students don't typically learn on coursera courses, such as improvements to gradient descent, batch normalization, and dropout.

Contains very good understanding of Hyperparameters and their tuning process.Secondly, teaches very well the mathematics of optimizers such as GD, SGD, GD with Momentum, GD with RMSProp and ADAM.Finally, a small glimpse of Batch Normalization.Highly Recommended!!!!!!

Great Very good course, although it'd be awesome if Andrew went over the backprop associated with Batch Normalization and perhaps a programming example of using Batch norm on my test set.

A very well curse, For me the information of batch normalization is very important Content great!

This course is a depository of tools that helps your NN be more perfect.Batch normalization is pretty sophisticated topic.

However, as I am currently not utilizing large datasets, the material on Batch Normalization and Hyper-parameter tuning is not useful to me ( now and in the foreseeable future).

we didn't try to implement the batch normalization ourselves and to incorporate batch normalization with other parameters etc.

It would be nice to include more details about the implementation of batch normalization.

In this course I learned or reviewed the following items in enough depth to perform in a job with them:InitializationRegularizationBatch NormalizationOptimizersTensorFlow Really well structured course.

week 2 was extremely boring I particularly benefited from the explanations of dropout, batch normalization and the RMSProp/Adam optimisers.

Super good course, would be greater if the programming assignments can cover batch normalization part instead of just TensorFlow.

Looking forward to some more great learning!

Looking forward to do more courses from the team.

Looking forward to the next course This course gives me a deep understanding of how to tune hyper parameter, how to implement regularization and optimization.

I'm looking forward to start with course 3.

非常棒的课程。 Looking forward to Convolutional Neural Networks and Sequence Models.

Looking forward to advance my knowledge and experience with the next courses!

I am looking forward for the complete series.

Looking forward to the next course!

Looking forward to the next courses.

Looking forward to complete specialization.

I'm very much looking forward to the remaining courses in the Specialization.

Looking forward to immediately learn the next course as I implement the knowledge.

I look forward to learning more in the remaining courses of the Deep Learning Specialization!

Again a very good course in the deep learning specialization.

I am looking forward to finish Deep Learning specialization.

This course contains a bit more interesting topics and I did not feel it was as overlapping to the Ng Machine Lerning course as the first course in the Deep Learning specialization was.

A continuation of the Deep Learning specialization, this course actually teaches many of the latest ideas in hyperparameter optimization and builds up the ideas nicely.

Simply awesome In the second course of the Deep Learning specialization Andrew gets deeper into the different subjects of Neural Networks.

Great course, which is part of an amazing Deep Learning specialization.

The best deep learning specialization ever with simple and clear explanation.

Many many thanks for putting this great deep learning specialization together!!

very useful also for experts All the courses in the Deep Learning Specialization are very good and met my expectations.

This course is a big part of the meat of the Deep Learning specialization.

Muchas Gracias... !The course is very good, particularly I am very grateful to COURSERA, for giving me the opportunity to do the five courses of the Deep Learning Specialization with financial aid and allowing me to have access to this type of training and certification.

It also provides good explanation for different optimization algorithms (enhancements to stochastic gradient descent).

I've learnt much from course including preprocessing (mini-batch, regularization, normalization), gradient descent algorithm (batch gradient descent, stochastic gradient descent, mini-batch gradient descent) and the variants (momentum, RMSProp, Adam).

Some useful addition to the Stanford Course are briefs on Gradient Descent With Momentum, RMSdrop and Adam as well as elementary practices on Tensorflow.

Very good course in terms of material and explanation.The autograder for grading the problems is not very good:- it fails a lot due to "technical difficulties",- it sometimes fails even though the solution is correct, e.g., a = a + b succeeds but a += b fails,- It sometimes passes even though the solution is incorrect (I used gradient descent instead of Adam, but it still passed with a 100% score).There were also quite some typos and other errors in the last assignment, so it seems like it was made in a bit of a hurry.

4.5/5 A diferencia del primer curso que es una continuacion del de Machine Learning de Andrew Ng , aqui vemos una evolución del contenido , se pasa a ver miniBatch Gradient Descent, Regularizacion , Momentum , Adam , y un inicio a tensorflowrealmente un MUY BUEN Curso Maybe this course can merge with the 1st one.

Covers optimization algorithms, Minibatch Gradient Descent, with Momentum, Adam, Xavier initialization, etc.

Sigmoid, Tangenth, activations, and so forth, this will help you understand terms such as L2 regularization, gradient descent with momentum, RMSProp, Adam, Exponentially weighted averages, and many others.

Going beyond gradient descent, types of regularization, hyperparameter searching we get to a set of robust tools that quickly find good solutions in extremely high dimensional spaces.

Excellent course, updated my knowledge of gradient descent optimization techniques, introduced me to tensorflow.

the gradient descent, the chain rule ) are quite easy-understanding and clear to most people, how to choose the hyperparameter and how to effectively carry out the projects are real essence.

Highly recommended for an beginner deep learning practitioner I got a very good understanding about how to what are the parameters I can tune, regularization methods, and different gradient descent alternatives which can be used through this course.

Yet another amazing course Recommended course for understanding the importance of hyperparameters in Neural Networks and understanding the structure of the optimizers used for training (gradient descent to ADAM) NICE COURSE!It takes my a lot of time, but it indeed deserve our effort!

As this course has helped me learn about following topics.Bias/Variance tradeoff, Different types of regularization methods, Code optimization techniques to speed up learning weights, Different types of weight optimization algorithms , About Hyper parameter tuning, Method for normalizing activation as batch norm, About Multi class classification and An introduction to Tensorflow This is a great course and you get to do real programming and training of a Deep Neural network.

Detailed instruction on optimization, hyper parameter tuning, batch normalization and deep learning framework Very informative but got some issues with the last programming assignment.

Thank you for your teaching :) Excellent course, pretty useful learn about hyper parameter tuning... and the INTUITION ( :D ) can be applied into other ML algorithms :) .

This is very well designed course to understand the hyper parameter tuning in a systematic manner other to convege the model faster.

A very good course to know more about Optimization techniques and Hyper parameter tuning.

This course teaches you about the Hyper parameter tuning, Regularization and Optimization.

The focus on hyper parameter tuning is instructive.

hyper parameter tuning, and yet there were no exercises to grasp how we can tune (more than one) hyper parameters through programming exercise.

Very important course for understanding hyper parameter tuning and optimization A very good course.

There is very much piece of information on hyper parameter tuning that is difficult to self-teach.The introduction to TensorFlow in notebook is wery well done.I will soon continue with next course.

A project component can also be added to make it even better Provides a good understanding of hyper parameter tuning Again... it was a great course.

Great course on Hyper parameter tuning with all the low level details needed.

With step by step teaching us a lot of useful skills to train our model much faster, Andrew starts to put more attention on practical field, and rather than giving us many equations, he as before likes to use some vivid examples for giving us an intuition, which I think is very helpful to understand those scientific words of computer science.

The tutorial of Tensorflow and coding assignment are step by step, smooth to follow.

Once again programming excercise is rather easy to pass as you are guided step by step so there is no space for serious mistakes.

The course structure is very well defined, with step by step to build technical foundations in the beginning and later using open source deep learning framework to connect all the pieces together.

This time , I finished Regularzation, I think this is a interesting experience, for you can implement your alg step by step, I get some magic(not black magic) alg, like RMS, momentum and Adam.

At last, the most fascinating is to construct Tensorflow, just like a pipeline, step by step , and every step was made by only one line, from forward (without backward) to the model, Tensorflow is really black magic.

The assignments are well designed to make the step by step understanding and exercise of the learning.

Very Good Course to understand Step by Step Hyperparameter tuning, Regularization and Optimization to improve Deep Neuaral Networks & Practical Assignments !

The right balance between theory and practice with good hands-on examples you can exercise without boring details of language syntax...

Wery usefull and clear Excellent Course It will help me to find solutions in ANN implementations it was a very good content to start from scratch Very well balance between theory and hands-on assignments.

I thought it was a good balance between theory and practice.

Good balance between theory and practice, focusing on the impact of hyperparameters across the whole solution.

Very good course to understand the nuts and bolts behind the deep learning great journey into deep learning world Content was good.But the system that checks our submitted our code checks wrongly even when I wrote it correctly.In week 2 assignment, when I submitted the code, it gave many functions as wrong coded.

So, the blame is on me not coursera.Hopefully I would fit more in the Deep Learning world by finishing up the course ;) Very practical Excellent introduction to hyperparameter tuning and tensorflow A useful class delving into the nuts and bolts of building a reliable nn.

The topics were advanced and practical, I am impressed This is an extremely important course, as it deals with lots best practices and nuts and bolts of Deep Learning that is the result of years of expertise and hard to find elsewhere Exceptionally awesome course!