We may earn an affiliate commission when you visit our partners.

Sensor fusion

David Silver, Thomas Hossler, Antje Muntzinger, Andreas Haja, Aaron Brown, Munir Jojo Verge, and Mathilde Badoual

Besides cameras, self-driving cars rely on other sensors with complementary measurement principles to improve robustness and reliability, using sensor fusion. You will learn about the lidar sensor, different lidar types, and relevant criteria for sensor selection. Also, you will learn how to detect objects in a 3D lidar point cloud using a deep-learning approach, and then evaluate detection performance using a set of metrics. In the second half of the course, you will learn how to fuse camera and lidar detections and track objects over time with an Extended Kalman Filter. You will get hands-on experience with multi-target tracking, where you will initialize, update and delete tracks, assign measurements to tracks with data association techniques, and manage several tracks simultaneously.

Enroll now

What's inside

Syllabus

Get started with sensor fusion and perception, why they are important, and the history of their development in self-driving cars.

Learn about the lidar sensor, capable of capturing important 3D data in point clouds.

Detect objects from the 3D data coming in from a lidar sensor.

Use the Waymo dataset to detect 3D objects in the surrounding environment.

Learn from the best! Sebastian Thrun will walk you through the usage and concepts of a Kalman Filter using Python.

Build an Extended Kalman Filter that's capable of handling data from multiple sources.

Get your tracking skills ready for the real world by learning how to track multiple targets simultaneously.

Use the Waymo dataset, along with sensor fusion, to track multiple 3D objects in the surrounding environment.

Good to know

Know what's good

, what to watch for

, and possible dealbreakers

Develops sensor fusion and perception, which are core skills for autonomous driving

Examines lidar sensors, which are highly relevant to autonomous vehicle development

Taught by David Silver, Thomas Hossler, Antje Muntzinger, Andreas Haja, Aaron Brown, Munir Jojo Verge, and Mathilde Badoual, who are recognized for their work in autonomous driving

Uses the Waymo dataset, which is highly relevant to autonomous vehicle development

Offers hands-on labs and interactive materials

Save this course

Save Sensor fusion to your list so you can find it easily later:

Save

Activities

Coming soon We're preparing activities for Sensor fusion. These are activities you can do either before, during, or after a course.

Career center

Learners who complete Sensor fusion will develop knowledge and skills that may be useful to these careers:

Data Scientist

Data Scientists use data to extract meaningful insights, and sensor fusion and perception play a vital role in this process. Those in this role need to fully understand the concepts behind sensor fusion and perception to successfully perform in their jobs. This course can help Data Scientists build a foundation in sensor fusion and perception, a skill which will enable them to better analyze, interpret, and extract meaning from data.

See salaries and explore the career path for Data Scientist

Perception Engineer

Perception Engineers develop and maintain software and systems that allow self-driving cars to perceive and understand their surroundings using sensor fusion. This course can help Perception Engineers hone their skills in sensor fusion and perception, enabling them to improve the accuracy, reliability, and safety of self-driving cars.

See salaries and explore the career path for Perception Engineer

Computer Vision Engineer

Computer Vision Engineers apply computer vision techniques to develop software and systems that allow self-driving cars to recognize and understand objects in their surroundings using sensor fusion. This course can help Computer Vision Engineers enhance their skills in sensor fusion and perception, enabling them to create more sophisticated and accurate vision systems for self-driving cars.

See salaries and explore the career path for Computer Vision Engineer

Robotics Engineer

Robotics Engineers design, develop, and maintain robots and robotic systems using sensor fusion. This course can help Robotics Engineers build a foundation in sensor fusion and perception, enabling them to develop more advanced and autonomous robots.

See salaries and explore the career path for Robotics Engineer

Mechatronics Engineer

Mechatronics Engineers combine mechanical, electrical, and computer engineering to design and develop products and systems using sensor fusion. This course can help Mechatronics Engineers enhance their skills in sensor fusion and perception, enabling them to create more innovative and efficient products and systems.

See salaries and explore the career path for Mechatronics Engineer

Autonomous Vehicle Engineer

Autonomous Vehicle Engineers design, develop, and test autonomous vehicles using sensor fusion. This course can help Autonomous Vehicle Engineers build a foundation in sensor fusion and perception, enabling them to develop safer and more reliable autonomous vehicles.

See salaries and explore the career path for Autonomous Vehicle Engineer

Automotive Engineer

Automotive Engineers design, develop, and test vehicles and automotive systems using sensor fusion. This course can help Automotive Engineers enhance their skills in sensor fusion and perception, enabling them to develop more advanced and efficient vehicles.

See salaries and explore the career path for Automotive Engineer

Software Engineer

Software Engineers develop and maintain software and systems that use sensor fusion. This course can help Software Engineers build a foundation in sensor fusion and perception, enabling them to develop more robust and reliable software.

See salaries and explore the career path for Software Engineer

Electrical Engineer

Electrical Engineers design, develop, and maintain electrical and electronic systems that use sensor fusion. This course can help Electrical Engineers build a foundation in sensor fusion and perception, enabling them to develop more advanced and efficient systems.

See salaries and explore the career path for Electrical Engineer

Mechanical Engineer

Mechanical Engineers design, develop, and maintain mechanical systems that use sensor fusion. This course can help Mechanical Engineers build a foundation in sensor fusion and perception, enabling them to develop more innovative and effective systems.

See salaries and explore the career path for Mechanical Engineer

Aerospace Engineer

Aerospace Engineers design, develop, and maintain aerospace systems that use sensor fusion. This course can help Aerospace Engineers build a foundation in sensor fusion and perception, enabling them to develop safer and more efficient aerospace systems.

See salaries and explore the career path for Aerospace Engineer

Materials Engineer

Materials Engineers develop and test materials used in sensor fusion systems. This course can help Materials Engineers build a foundation in sensor fusion and perception, enabling them to develop new and innovative materials for use in sensor fusion systems.

See salaries and explore the career path for Materials Engineer

Chemical Engineer

Chemical Engineers design and develop chemical processes that use sensor fusion. This course can help Chemical Engineers build a foundation in sensor fusion and perception, enabling them to develop more efficient and sustainable chemical processes.

See salaries and explore the career path for Chemical Engineer

Biomedical Engineer

Biomedical Engineers design and develop medical devices and systems that use sensor fusion. This course can help Biomedical Engineers build a foundation in sensor fusion and perception, enabling them to develop more effective and patient-centric medical devices and systems.

See salaries and explore the career path for Biomedical Engineer

Environmental Engineer

Environmental Engineers design and develop systems to protect the environment using sensor fusion. This course can help Environmental Engineers build a foundation in sensor fusion and perception, enabling them to develop more effective and efficient environmental protection systems.

See salaries and explore the career path for Environmental Engineer

Reading list

We've selected six books that we think will supplement your learning. Use these to develop background knowledge, enrich your coursework, and gain a deeper understanding of the topics covered in Sensor fusion.

Computer Vision

Save

Provides a comprehensive overview of computer vision algorithms and techniques. It valuable resource for anyone interested in learning about computer vision, including sensor fusion and perception systems.

Concurrent NumPy in Python

Save

Provides a comprehensive overview of deep learning for computer vision tasks, including object detection and tracking. It valuable resource for anyone interested in learning about deep learning and its applications to computer vision.

Concurrent NumPy in Python: Faster NumPy With BLAS,...

Paperback

Concurrent NumPy in Python: Faster NumPy With BLAS,...

Kindle Edition

Circuits, Signals, and Speech and Image Processing

Save

Provides a comprehensive overview of Kalman filtering algorithms and techniques. It valuable resource for anyone interested in learning about Kalman filtering, including sensor fusion and perception systems.

Circuits, Signals, and Speech and Image Processing

Paperback

Check price

Circuits, Signals, and Speech and Image Processing

Kindle Edition

Check price

Probabilistic Robotics

Save

Provides a comprehensive overview of robot perception, including sensor fusion and perception systems. It valuable resource for anyone interested in learning about robot perception.

Probabilistic Robotics (Intelligent Robotics and...

Hardcover

$$$

Probabilistic Robotics (Intelligent Robotics and...

Kindle Edition

$$$

FastSLAM

Save

Provides a comprehensive overview of SLAM algorithms and techniques. It valuable resource for anyone interested in learning about SLAM, including sensor fusion and perception systems.

State Estimation for Robotics

Save

Provides a comprehensive overview of state estimation algorithms and techniques. It valuable resource for anyone interested in learning about state estimation, including sensor fusion and perception systems.

State Estimation for Robotics

Paperback

Check price

State Estimation for Robotics

Kindle Edition

Check price

Help others find this course page by sharing it with your friends and followers:

Facebook

Copy Link

Similar courses

Here are nine courses similar to Sensor fusion.

Localization

Most relevant

Sensor Fusion and Non-linear Filtering for Automotive Systems

Sensor Fusion and Non-linear Filtering for Automotive...

Most relevant

Computer Vision

Unmanned Aerial Systems (UAS): Fundamentals

Fundamentals of Remote Sensing and Geospatial Analysis

Learn To DJ With Just Your Laptop: No DJ Equipment Needed

CPS solution for Industries

Tracking Objects in Video with Particle Filters

Multi-Object Tracking for Automotive Systems

Time

40320 hours

Level

Advanced

Via

Udacity

Instructors

David Silver

Thomas Hossler

Antje Muntzinger

Andreas Haja

Aaron Brown

Munir Jojo Verge

Mathilde Badoual

Language

English

Good to know

Develops sensor fusion and perception, which are core skills for autonomous driving

Examines lidar sensors, which are highly relevant to autonomous vehicle development

Taught by David Silver, Thomas Hossler, Antje Muntzinger, Andreas Haja, Aaron Brown, Munir Jojo Verge, and Mathilde Badoual, who are recognized for their work in autonomous driving

Uses the Waymo dataset, which is highly relevant to autonomous vehicle development

Offers hands-on labs and interactive materials

Share and help others discover this course

Facebook

Link

Our mission

OpenCourser helps millions of learners each year. People visit us to learn workspace skills, ace their exams, and nurture their curiosity.

Our extensive catalog contains over 50,000 courses and twice as many books. Browse by search, by topic, or even by career interests. We'll match you to the right resources quickly.

Find this site helpful? Tell a friend about us.

Affiliate disclosure

We're supported by our community of learners. When you purchase or subscribe to courses and programs or purchase books, we may earn a commission from our partners.

Your purchases help us maintain our catalog and keep our servers humming without ads.

Thank you for supporting OpenCourser.