Sensor Fusion Engineer

Online Course

Udacity

Go to Udacity

Start Learning

What is the course about?
Prerequisites & Facts
Cost, Certificate & Degree
Reviews & Experiences

What is the course about?

Sensor Fusion Engineer

The course Sensor Fusion Engineer is an online class provided by Udacity. It may be possible to receive a verified certification or use the course to prepare for a degree.

Learn to fuse lidar point clouds, radar signatures, and camera images using Kalman Filters to perceive the environment and detect and track vehicles and pedestrians over time.

Course description

Sensor Fusion Engineer
4 Months (10 hours/week)

Learn to detect obstacles in lidar point clouds through clustering and segmentation, apply thresholds and filters to radar data in order to accurately track objects, and augment your perception by projecting camera images into three dimensions and fusing these projections with other sensor data. Combine this sensor data with Kalman filters to perceive the world around a vehicle and track objects over time.
Learn to fuse data from three of the primary sensors that robots use: lidar, camera, and radar.
You should have intermediate C++ knowledge, and be familiar with calculus, probability, and linear algebra. See detailed requirements.
Process raw lidar data with filtering, segmentation, and clustering to detect other vehicles on the road.
Analyze radar signatures to detect and track objects. Calculate velocity and orientation by correcting for radial velocity distortions, noise, and occlusions.
Fuse camera images together with lidar point cloud data. You’ll extract object features, classify objects, and project the camera image into three dimensions to fuse with lidar data.
Fuse data from multiple sources using Kalman filters, and build extended and unscented Kalman filters for tracking nonlinear movement.
We recommend the Intro to Self-Driving Cars Nanodegree program. This program will teach you the skills you need to be successful in this program, including C++, linear algebra, calculus, and statistics.
We recommend the Intro to Self-Driving Cars Nanodegree program. This program will teach you the skills you need to be successful in this program, including C++, linear algebra, calculus, and statistics.

Lidar
Process raw lidar data with filtering, segmentation, and clustering to detect other vehicles on the road.
Lidar Obstacle Detection
Radar
Analyze radar signatures to detect and track objects. Calculate velocity and orientation by correcting for radial velocity distortions, noise, and occlusions.
Radar Obstacle Detection
Cameras
Fuse camera images together with lidar point cloud data. You’ll extract object features, classify objects, and project the camera image into three dimensions to fuse with lidar data.
Camera and Lidar Fusion
Kalman Filters
Fuse data from multiple sources using Kalman filters, and build extended and unscented Kalman filters for tracking nonlinear movement.
Unscented Kalman Filters
You should have intermediate C++ knowledge, and be familiar with calculus, probability, and linear algebra.

Sensor fusion engineering is one of the most important and exciting areas of robotics.
Sensors like cameras, radar, and lidar help self-driving cars, drones, and all types of robots perceive their environment. Analyzing and fusing this data is fundamental to building an autonomous system.
In this Nanodegree program, you will work with camera images, radar signatures, and lidar point clouds to detect and track vehicles and pedestrians. By graduation, you will have an impressive portfolio of projects to demonstrate your skills to employers.
As a Sensor Fusion Engineer, you’ll be equipped to bring value to a wide array of industries and be eligible for many roles.
Your opportunities might include roles such as an:
If you’re interested in learning about lidar, radar, and camera data and how to fuse it together, this program is right for you.
Sensors and sensor data are used in a wide array of applications — from cell phones to robots and self-driving cars — giving you a wide array of fields you could enter or advance a career in after this program.

Start Learning

Prerequisites & Facts

Sensor Fusion Engineer

Course Topic

Computer Science, Sensor Fusion

University, College, Institution

Udacity

Course Skill Level

see course summary

Course Language

English

Place of class

Online, self-paced (see curriculum for more information)

Degree

Certificate

Start Learning

Degree & Cost

Sensor Fusion Engineer

To obtain a verified certificate from Udacity you have to finish this course or the latest version of it, if there is a new edition. The class may be free of charge, but there could be some cost to receive a verified certificate (399 USD) or to access the learning materials. The specifics of the course may have been changed, please consult the provider to get the latest quotes and news.

Udacity

Sensor Fusion Engineer

provided by Udacity

Start Learning