We may earn an affiliate commission when you visit our partners.
Michel Bierlaire
Introduction to unconstrained nonlinear optimization, Newton’s algorithms and descent methods.
Register for this course and see more details by visiting:
OpenCourser.com/course/jqcnpv/optimization
What's inside
Learning objectives
- Formulation: you will learn from simple examples how to formulate, transform and characterize an optimization problem.
- Objective function: you will review the mathematical properties of the objective function that are important in optimization.
- Optimality conditions: you will learn sufficient and necessary conditions for an optimal solution.
- Solving equations, newton: this is a reminder about newton's method to solve nonlinear equations.
- Newton's local method: you will see how to interpret and adapt newton's method in the context of optimization.
- Descent methods: you will learn the family of descent methods, and its connection with newton's method.
- The course is structured into 6 sections:
- Formulation: you will learn from simple examples how to formulate, transform and characterize an optimization problem.
- Objective function: you will review the mathematical properties of the objective function that are important in optimization.
- Optimality conditions: you will learn sufficient and necessary conditions for an optimal solution.
- Solving equations, newton: this is a reminder about newton's method to solve nonlinear equations.
- Newton's local method: you will see how to interpret and adapt newton's method in the context of optimization.
- Descent methods: you will learn the family of descent methods, and its connection with newton's method.
- The course is structured into 6 sections:
Good to know
Good to know
Know what's good ,
what to watch for , and
possible dealbreakers
Combines theory and practice, leading to a holistic understanding of optimization
Provides a strong foundation in the fundamentals of optimization
Employs clear and concise explanations, making the concepts accessible to learners
Covers a range of optimization methods, providing learners with a broad understanding
Requires a strong mathematical background, which may limit accessibility for some learners
May not be suitable for learners seeking a more practical approach to optimization
Save this course
Save Optimization: principles and algorithms - Unconstrained nonlinear optimization to your list so you can find it easily later:
Save
Save
Activities
Be better prepared
before
your course. Deepen your understanding
during
and
after
it. Supplement your coursework and achieve mastery of the topics covered
in Optimization: principles and algorithms - Unconstrained nonlinear optimization with these
activities:
Review prerequisite material: calculus, linear algebra
Show steps
Ensure you are comfortable with these mathematical foundations
Browse courses on
Linear Algebra
Show steps
-
Review lecture notes and textbooks
-
Practice solving problems
-
Seek help from a math tutor or online resources if needed
Attend a study group meeting with your classmates
Show steps
Collaborate with peers to discuss course concepts and solve problems
Show steps
-
Form or join a study group with classmates
-
Meet regularly to review lectures, work on assignments, and discuss problems
-
Take turns explaining concepts and leading discussions
Complete practice exercises on Newton's method
Show steps
Develop fluency in applying Newton's method to solve optimization problems
Browse courses on
Newton's Method
Show steps
-
Find practice problems online or in a textbook
-
Solve the problems using Newton's method
-
Check your answers against provided solutions
Three other activities
Expand to see all activities and additional details
Show all six activities
Solve optimization problems in different domains
Show steps
Gain experience applying optimization techniques to real-world problems
Browse courses on
Optimization
Show steps
-
Find optimization problems related to fields like finance, engineering, or data science
-
Formulate the problem mathematically
-
Solve the problem using optimization methods learned in the course
Attend a workshop on practical optimization techniques
Show steps
Gain practical insights and hands-on experience in optimization
Browse courses on
Optimization Techniques
Show steps
-
Find a workshop on practical optimization techniques
-
Register for the workshop and attend the sessions
-
Actively participate in discussions and exercises
Develop a visual representation of gradient descent
Show steps
Enhance your understanding and visualize the concept
Browse courses on
Gradient Descent
Show steps
-
Identify a visualization tool, e.g., Python's Matplotlib or GeoGebra
-
Plot the gradient descent algorithm for a given function and initial point
-
Use color or animation to highlight the path taken by the algorithm
Review prerequisite material: calculus, linear algebra
Show steps
Ensure you are comfortable with these mathematical foundations
Browse courses on
Linear Algebra
Show steps
Show steps
Show steps
- Review lecture notes and textbooks
- Practice solving problems
- Seek help from a math tutor or online resources if needed
Attend a study group meeting with your classmates
Show steps
Collaborate with peers to discuss course concepts and solve problems
Show steps
Show steps
Show steps
- Form or join a study group with classmates
- Meet regularly to review lectures, work on assignments, and discuss problems
- Take turns explaining concepts and leading discussions
Complete practice exercises on Newton's method
Show steps
Develop fluency in applying Newton's method to solve optimization problems
Browse courses on
Newton's Method
Show steps
Show steps
Show steps
- Find practice problems online or in a textbook
- Solve the problems using Newton's method
- Check your answers against provided solutions
Three other activities
Expand to see all activities and additional details
Show all six activities
Solve optimization problems in different domains
Show steps
Gain experience applying optimization techniques to real-world problems
Browse courses on
Optimization
Show steps
Show steps
Show steps
- Find optimization problems related to fields like finance, engineering, or data science
- Formulate the problem mathematically
- Solve the problem using optimization methods learned in the course
Attend a workshop on practical optimization techniques
Show steps
Gain practical insights and hands-on experience in optimization
Browse courses on
Optimization Techniques
Show steps
Show steps
Show steps
- Find a workshop on practical optimization techniques
- Register for the workshop and attend the sessions
- Actively participate in discussions and exercises
Develop a visual representation of gradient descent
Show steps
Enhance your understanding and visualize the concept
Browse courses on
Gradient Descent
Show steps
Show steps
Show steps
- Identify a visualization tool, e.g., Python's Matplotlib or GeoGebra
- Plot the gradient descent algorithm for a given function and initial point
- Use color or animation to highlight the path taken by the algorithm
Career center
Learners who complete Optimization: principles and algorithms - Unconstrained nonlinear optimization will develop knowledge and skills
that may be useful to these careers:
Quantitative Analyst
Quantitative Analyst
Quantitative Analysts use mathematical and statistical modeling to analyze financial data and make investment recommendations. This course can help you develop the skills needed to succeed in this role by providing a strong foundation in optimization techniques, which are essential for developing and evaluating financial models. You will learn how to formulate and solve optimization problems, as well as how to use descent methods and Newton's method to find optimal solutions.
Data Scientist
Data Scientist
Data Scientists use machine learning and other statistical methods to analyze data and extract insights. This course can help you develop the skills needed to succeed in this role by providing a strong foundation in optimization techniques, which are essential for developing and evaluating machine learning models. You will learn how to formulate and solve optimization problems, as well as how to use descent methods and Newton's method to find optimal solutions.
Machine Learning Engineer
Machine Learning Engineer
Machine Learning Engineers design and build machine learning models. This course can help you develop the skills needed to succeed in this role by providing a strong foundation in optimization techniques, which are essential for developing and evaluating machine learning models. You will learn how to formulate and solve optimization problems, as well as how to use descent methods and Newton's method to find optimal solutions.
Operations Research Analyst
Operations Research Analyst
Operations Research Analysts use mathematical and analytical methods to improve the efficiency and effectiveness of business operations. This course can help you develop the skills needed to succeed in this role by providing a strong foundation in optimization techniques, which are essential for developing and evaluating operations research models. You will learn how to formulate and solve optimization problems, as well as how to use descent methods and Newton's method to find optimal solutions.
Financial Analyst
Financial Analyst
Financial Analysts use financial data to make investment recommendations. This course can help you develop the skills needed to succeed in this role by providing a strong foundation in optimization techniques, which are essential for developing and evaluating financial models. You will learn how to formulate and solve optimization problems, as well as how to use descent methods and Newton's method to find optimal solutions.
Actuary
Actuary
Actuaries use mathematical and statistical methods to assess risk and uncertainty. This course can help you develop the skills needed to succeed in this role by providing a strong foundation in optimization techniques, which are essential for developing and evaluating actuarial models. You will learn how to formulate and solve optimization problems, as well as how to use descent methods and Newton's method to find optimal solutions.
Statistician
Statistician
Statisticians use statistical methods to analyze data and draw conclusions. This course can help you develop the skills needed to succeed in this role by providing a strong foundation in optimization techniques, which are essential for developing and evaluating statistical models. You will learn how to formulate and solve optimization problems, as well as how to use descent methods and Newton's method to find optimal solutions.
Economist
Economist
Economists use economic theory and data to analyze economic issues. This course can help you develop the skills needed to succeed in this role by providing a strong foundation in optimization techniques, which are essential for developing and evaluating economic models. You will learn how to formulate and solve optimization problems, as well as how to use descent methods and Newton's method to find optimal solutions.
Mathematician
Mathematician
Mathematicians develop and apply mathematical theories and techniques to solve problems in a wide range of fields. This course can help you develop the skills needed to succeed in this role by providing a strong foundation in optimization techniques, which are essential for developing and evaluating mathematical models. You will learn how to formulate and solve optimization problems, as well as how to use descent methods and Newton's method to find optimal solutions.
Computer Scientist
Computer Scientist
Computer Scientists design and develop computer systems and applications. This course can help you develop the skills needed to succeed in this role by providing a strong foundation in optimization techniques, which are essential for developing and evaluating computer algorithms. You will learn how to formulate and solve optimization problems, as well as how to use descent methods and Newton's method to find optimal solutions.
Software Engineer
Software Engineer
Software Engineers design, develop, and maintain software systems. This course can help you develop the skills needed to succeed in this role by providing a strong foundation in optimization techniques, which are essential for developing and evaluating software algorithms. You will learn how to formulate and solve optimization problems, as well as how to use descent methods and Newton's method to find optimal solutions.
Data Analyst
Data Analyst
Data Analysts use data to identify trends and patterns. This course can help you develop the skills needed to succeed in this role by providing a strong foundation in optimization techniques, which are essential for developing and evaluating data analysis algorithms. You will learn how to formulate and solve optimization problems, as well as how to use descent methods and Newton's method to find optimal solutions.
Business Analyst
Business Analyst
Business Analysts use data and analysis to improve business processes. This course can help you develop the skills needed to succeed in this role by providing a strong foundation in optimization techniques, which are essential for developing and evaluating business analysis models. You will learn how to formulate and solve optimization problems, as well as how to use descent methods and Newton's method to find optimal solutions.
Project Manager
Project Manager
Project Managers plan and execute projects to achieve specific goals.
For more career information including salaries, visit:
OpenCourser.com/course/jqcnpv/optimization
Reading list
We've selected 13 books
that we think will supplement your
learning. Use these to
develop background knowledge, enrich your coursework, and gain a
deeper understanding of the topics covered in
Optimization: principles and algorithms - Unconstrained nonlinear optimization.
Save
Comprehensive treatment of nonlinear optimization, a branch of optimization that deals with problems where the objective function or constraints are nonlinear. It is written by leading experts in the field, and it is known for its clarity and rigor.
Comprehensive and up-to-date treatment of optimization, a branch of mathematics that deals with finding the best possible solution to a given problem. It is written by leading experts in the field, and it is known for its clarity and rigor.
Comprehensive treatment of nonlinear optimization, a branch of optimization that deals with problems where the objective function or constraints are nonlinear. It is written by a leading expert in the field, and it is known for its clarity and rigor.
Comprehensive and up-to-date treatment of convex optimization, a powerful technique for solving a wide range of optimization problems. It is written by a leading expert in the field, and it is known for its clarity and rigor.
Classic textbook on nonlinear programming, a branch of optimization that deals with problems where the objective function or constraints are nonlinear. It comprehensive and well-written book that is suitable for both students and practitioners.
Save
Provides an accessible introduction to optimization, with a focus on data analysis. It covers both theoretical concepts and practical algorithms, and it is written in a clear and engaging style.
Concise and well-written introduction to optimization, a branch of mathematics that deals with finding the best possible solution to a given problem. It is suitable for both students and practitioners.
Provides a comprehensive treatment of optimization theory and algorithms.
Is an introduction to stochastic optimization, a branch of optimization that deals with problems where the objective function or constraints are random. It is written by a leading expert in the field, and it is known for its clarity and rigor.
Comprehensive reference for numerical optimization.
Provides a comprehensive treatment of nonlinear programming.
Provides a thorough treatment of convex optimization.
Save
Provides a practical introduction to optimization for data science.
For more information about how these books relate to this course, visit:
OpenCourser.com/course/jqcnpv/optimization
Share
Similar courses
Here are nine courses similar to
Optimization: principles and algorithms - Unconstrained nonlinear optimization.
Introduction to optimization on smooth manifolds: first order methods
OpenCourser.com/course/ac0mrk/introduction
Introduction to optimization on smooth manifolds: first...
Most relevant
Operations Research (2): Optimization Algorithms
OpenCourser.com/course/hp4fi7/operations
Operations Research (2): Optimization Algorithms
Most relevant
Optimization with Python: Solve Operations Research Problems
OpenCourser.com/course/ot0wkq/optimization
Optimization with Python: Solve Operations Research...
Most relevant
Mathematical Optimization for Engineers
OpenCourser.com/course/m7ytp3/mathematical
Mathematical Optimization for Engineers
Most relevant
Discrete Optimization
OpenCourser.com/course/m5ujjj/discrete
Discrete Optimization
Most relevant
(Optional) Optimization Problems
OpenCourser.com/course/w2yjz8/optional
(Optional) Optimization Problems
Calculus for Machine Learning and Data Science
OpenCourser.com/course/25mnt3/calculus
Calculus for Machine Learning and Data Science
Lightweight Design
OpenCourser.com/course/31fg54/lightweight
Lightweight Design
Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization
OpenCourser.com/course/34q7py/improving
Improving Deep Neural Networks: Hyperparameter Tuning,...
Effort
6 to 8 hours per week for 6 weeks
Level
Introductory
Via
edX
Institution
École Polytechnique Fédérale de Lausanne
Instructor
Michel Bierlaire
Language
English
Transcript
English
Good to know
Combines theory and practice, leading to a holistic understanding of optimization
Provides a strong foundation in the fundamentals of optimization
Employs clear and concise explanations, making the concepts accessible to learners
Covers a range of optimization methods, providing learners with a broad understanding
Requires a strong mathematical background, which may limit accessibility for some learners
May not be suitable for learners seeking a more practical approach to optimization
Our mission
OpenCourser helps millions of learners each year. People visit us to learn workspace skills, ace their exams, and nurture their curiosity.
Our extensive catalog contains over 50,000 courses and twice as many books. Browse by search, by topic, or even by career interests. We'll match you to the right resources quickly.
Find this site helpful? Tell a friend about us.
Affiliate disclosure
We're supported by our community of learners. When you purchase or subscribe to courses and programs or purchase books, we may earn a commission from our partners.
Your purchases help us maintain our catalog and keep our servers humming without ads.
Thank you for supporting OpenCourser.
© 2016 - 2024 OpenCourser