Simultaneous Localization and Mapping (Slam)

Your constantly-updated definition of Simultaneous Localization and Mapping (Slam) and collection of videos and articles

What is Simultaneous Localization and Mapping (Slam)?

SLAM (simultaneous localization and mapping) is the method computers use to perceive their environment. In user experience (UX) design, it is most relevant to AR (Augmented Reality).

Video copyright info

Copyright holder: KEE JOON HONG Appearance time: 0:15 - 0:26 Copyright license and terms: CC BY Link: https://www.youtube.com/watch?v=dlZRGJx4g8A&ab_channel=KEEJOONHONG

Copyright holder: SpectreXR Appearance time: 0:26 - 0:38 Copyright license and terms: CC BY Link: https://www.youtube.com/watch?v=-zysckX_AOg&ab_channel=SpectreXR

Cameras and laser sensors perceive distance and surfaces to project holograms on an AR display as if they were in real space. SLAM’s other applications include self-driving vehicles, drones and other technologies.

How Does SLAM Work?

An illustration depicting the three stages of how an AR app works. Step one: sensing. The phone sees a flower with the camera. Step two: Recognition. The phone recognizes the flower as a specific flower by comparing against other flowers. Step three: Display. The Phone screen shows an animated bee flying near the flower with a speech bubble that says

© Interaction Design Foundation, CC BY-SA 4.0

SLAM's exact process might vary from device to device, as some are not equipped with distance-sensing lasers or dual cameras.

However, the essential function of SLAM is to identify surfaces using a camera and image recognition software. Devices with lasers can judge the distance using focal lengths and can also judge distance by triangulating from multiple perspectives. This is identical to the depth-perceiving binocular vision that humans have. However, as the human eye can be fooled, so can SLAM.

SLAM Errors

SLAM errors must be handled correctly to ensure an excellent overall user experience. When SLAM fails, it should be easy for users to recalibrate the sensor or a UI prompt should instruct them to move around the area or reposition the sensors for a better look. The visual design should communicate the error and how to correct it.

A product or service should also be aware of situations where SLAM cannot perceive something, like a dark or shiny surface that reflects a lot of light. This can be relatively simple for lower-stakes interactions like AR entertainment, as it will be evident to the user that something is not mapped correctly.

© Interaction Design Foundation, CC BY-SA 4.0

However, this can be a more severe issue for other situations like self-driving cars and drones.

SLAM in Augmented Reality

SLAM is the foundation of augmented reality (AR.) It allows AR devices like AR glasses or mobile phones to perceive the world in three dimensions. AR apps can then identify objects or images in the real-world environment and project virtual content on the AR displays so it appears in the real world.

SLAM also provides the necessary information for the display to match the surfaces, positioning and perspective needed for the object to look natural.

Sophisticated SLAM technologies can recognize human faces by applying virtual filters or makeup. AR headsets often have a way of warning the user if they are too distracted to notice a wall or object they might run into.

Information overlays like Google Lens use SLAM and AI software to identify text, translate it, and display it in AR.

What are some other applications of SLAM besides AR?

In the case of drones and self-driving cars, ensuring that the interface notifies the user to take manual control when SLAM malfunctions or cannot perceive surfaces correctly is even more critical.

Even though virtual reality (VR) uses virtual environments, VR headsets often use SLAM sensors to let players know where they can walk in VR without walking into real walls or chairs. This becomes especially true for mixed reality (MR) or extended reality (XR) programs as well.

More experimental applications of SLAM include photogrammetry, which uses SLAM sensors to scan real objects as 3D models.

Learn More About SLAM

Take our course on UX Design for Augmented Reality.

Show Hide video transcript
  1. Transcript loading...

To discover even more about SLAM, read this in-depth article: Basics of AR: SLAM – Simultaneous Localization and Mapping

Literature on Simultaneous Localization and Mapping (Slam)

Here’s the entire UX literature on Simultaneous Localization and Mapping (Slam) by the Interaction Design Foundation, collated in one place:

Learn more about Simultaneous Localization and Mapping (Slam)

Take a deep dive into Simultaneous Localization and Mapping (Slam) with our course UX Design for Augmented Reality .

Augmented reality has emerged as a transformative technology, allowing us to blend the digital and physical worlds to enhance our daily lives. However, the path to create seamless and intuitive user experiences in AR presents unique challenges. This course equips you with the knowledge and skills to overcome these challenges and unlock the full potential of AR.

UX Design for Augmented Reality is taught by UX expert Frank Spillers, CEO and founder of the renowned UX consultancy Experience Dynamics. Frank is an expert in AR and VR and has 22 years of UX experience with Fortune 500 clients, including Nike, Intel, Microsoft, HP, and Capital One.

In this course, you will explore the entire design process of AR, along with the theory and guidelines to determine what makes a good AR experience. Through hands-on exercises and discussions, you will explore and discuss topics such as safety in AR, how to determine whether AR is the right platform for your idea, and what real-world spaces have potential as stages for AR experiences.

In lesson 1, you will learn the origins of AR, what makes it unique, and its colossal impact on human-computer interaction.

In lesson 2, you will dive into user research practices tailored to AR and its unique characteristics.

In lesson 3, you will dig into how to prototype for AR and create low-fi but testable prototypes.

In lesson 4, you will learn the heuristics and guidelines to test your designs and ensure they are practical and user-friendly.

Throughout the course, you'll get practical tips to apply in real-life projects. In the Portfolio projects, you'll build a foundation of an AR product. This will allow you to create a portfolio case study to entice recruiters or developers to make your dream a reality.

Use your industry-recognized Course Certificate on your resume, CV, LinkedIn profile, or website.

All open-source articles on Simultaneous Localization and Mapping (Slam)

Please check the value and try again.

Open Access - Link to us!

We believe in Open Access and the democratization of knowledge. Unfortunately, world class educational materials such as this page are normally hidden behind paywalls or in expensive textbooks.

If you want this to change, , link to us, or join us to help democratize design knowledge!