Blindness and moderate-to-severe visual impairment affect an estimated 340 million people worldwide, transforming an ordinary walk through a neighborhood into a complex exercise in perception, memory and risk management. For many people with blindness or visual impairment, outdoor travel requires combining a white cane, guide dog, smartphone mapping tools, environmental knowledge and assistance from other people. Yet these tools do not always work together seamlessly. A new study published in Nature Biomedical Engineering presents Mobilio, an artificial-intelligence-driven smartphone application designed to combine route planning, path guidance and obstacle detection in a single navigation system. The researchers say the technology could offer a more accessible and personalized way for people with blindness or visual impairment to move independently through outdoor environments.
The work began with a survey of 112 people with blindness or moderate-to-severe visual impairment. Their responses identified three features as central to an effective outdoor navigation aid: turn-by-turn directions, guidance that helps users remain on a walkable path and the ability to detect and avoid obstacles. Existing technologies commonly provide only part of this package. A white cane offers immediate information about nearby ground-level hazards but does not provide satellite-based route instructions. Guide dogs can help users avoid obstacles and follow routes, but they require extensive training and can be costly or unavailable. Conventional electronic travel aids and smartphone mapping applications may deliver location information while offering limited support for the physical details of the environment directly ahead.
Mobilio was developed to address these gaps through a smartphone-based system that uses machine-learning models, multiple onboard sensors and personalized audio feedback. Rather than treating navigation as a single problem, the application divides it into several connected tasks. Satellite positioning and digital maps can indicate where a person is located and which direction a route should take. Motion sensors, including accelerometers and gyroscopes, can help estimate how the phone and user are moving. The smartphone camera can provide visual information about the surroundings, while other sensors contribute data about orientation and movement. Sensor-fusion algorithms combine these streams, helping the system produce a more stable estimate of the user’s position, heading and immediate navigation context than any one sensor could provide alone.
The distinction between route planning and real-time guidance is crucial. A map can determine that a user should turn left at a particular intersection, but it cannot by itself guarantee that the person is aligned with the correct sidewalk or has avoided a tree, signpost or other object. Mobilio therefore combines broader route instructions with localized path guidance and obstacle detection. Machine-learning models interpret sensor and camera data to identify elements of the walking environment, while the application translates the results into spoken or otherwise audible cues. The researchers designed those cues to be personalized, adjusting how information is delivered so that users receive useful guidance without being overwhelmed by a constant stream of alerts.
Personalization is particularly important for audio-based navigation. A system that speaks too often can mask environmental sounds, increase mental workload or make it difficult to distinguish urgent warnings from routine directions. A system that speaks too rarely may leave users uncertain about whether they are still on course. Mobilio’s audio feedback was evaluated with participants who had blindness or visual impairment, allowing the researchers to examine whether the instructions were understandable and intuitive in practice rather than merely accurate in laboratory tests. The application was intended to communicate the direction and timing of navigation actions while also warning users about obstacles and changes in the path ahead.
Before testing the application with users, the researchers conducted engineering experiments in representative navigation scenarios. These tests assessed the reliability of the smartphone sensors and the machine-learning models that Mobilio depends on. Such testing is important because outdoor navigation systems operate in conditions that can disrupt positioning and perception. Satellite signals may become less precise near buildings, sensor readings can drift as a phone moves, and streets contain an enormous variety of obstacles, surfaces and layouts. Reliable navigation therefore requires algorithms that can combine imperfect measurements and respond quickly when the environment differs from what a digital map predicts.
The user experiments involved 14 participants with blindness or visual impairment. In one assessment, participants used Mobilio together with a white cane to navigate an outdoor community path. Their performance was compared with a conventional arrangement involving Google Maps and a white cane. When using Mobilio, participants completed the route in 13 ± 3 percent less time and made 41 ± 5 percent fewer contacts with environmental objects. These contacts can include brushing against or striking objects in the walking environment, and reducing them may indicate that the system helped participants anticipate hazards more effectively. The results suggest that adding real-time, AI-supported guidance to an established mobility tool can improve both efficiency and physical interaction with the environment.
The researchers also evaluated Mobilio on an obstacle course and compared its performance with navigation supported by a human guide. In the reported experiments, the application achieved outdoor navigation reliability similar to that of the guide. That finding does not mean a smartphone can replace every form of human assistance, nor does it remove the need for established mobility skills. Instead, it indicates that the system was able to provide consistent guidance across the tested situations while allowing users to control their own movement. Participant surveys further reported that Mobilio was easy to use, imposed a low perceived workload and delivered audio feedback that felt intuitive.
Despite the promising findings, the study represents an early evaluation rather than a complete demonstration of universal reliability. The participant group was relatively small, and the experiments took place in specific outdoor settings and controlled obstacle-course conditions. Real-world travel can involve severe weather, crowded sidewalks, construction zones, unusual road layouts, inconsistent pavement, bicycles and vehicles, as well as temporary obstacles that are not represented on maps. Smartphone-based systems also depend on battery life, sensor availability, data processing and the quality of the user’s device. Future research will need to test Mobilio with larger and more diverse populations, across cities and environmental conditions, while examining how performance changes during long journeys and unexpected events.
Even with those limitations, the study highlights a shift in assistive technology: smartphones are increasingly becoming platforms that can interpret the physical world rather than simply display information about it. By combining machine learning with sensor fusion and adaptive audio, Mobilio attempts to bridge the gap between a digital map and the immediate realities of walking outdoors. For people with blindness or visual impairment, the potential benefit is not only faster travel but greater confidence and independence. The researchers’ results suggest that a carefully designed AI navigation assistant, used alongside tools such as a white cane, could make outdoor journeys safer, more efficient and less demanding, turning a widely available consumer device into a sophisticated mobility aid.
Subject of Research: AI-driven smartphone navigation for people with blindness and moderate-to-severe visual impairment
Article Title: Improving outdoor navigation for people with blindness using an AI-driven smartphone application and personalized audio guidance
Article References: Liu, R., Slade, P. Improving outdoor navigation for people with blindness using an AI-driven smartphone application and personalized audio guidance. Nature Biomedical Engineering (2026). https://doi.org/10.1038/s41551-026-01772-x
Image Credits: AI Generated
DOI: https://doi.org/10.1038/s41551-026-01772-x
Keywords: blindness, visual impairment, outdoor navigation, artificial intelligence, machine learning, sensor fusion, smartphone application, assistive technology, personalized audio guidance, obstacle detection
