Augmented reality glasses may help people with low vision better navigate their environment

Glasses enhance mobility and function in patients who have difficulty with peripheral vision or seeing in low light

IMAGE

Credit: Scott Song for USC Roski Eye Institute

LOS ANGELES – Nearly one in 30 Americans over the age of 40 experience low vision — significant visual impairment that can’t be corrected with glasses, contact lenses, medication or surgery.

In a new study of patients with retinitis pigmentosa, an inherited degenerative eye disease that results in poor vision, Keck School of Medicine of USC researchers found that adapted augmented reality (AR) glasses can improve patients’ mobility by 50% and grasp performance by 70%.

“Current wearable low vision technologies using virtual reality are limited and can be difficult to use or require patients to undergo extensive training,” said Mark Humayun, MD, PhD, director of the USC Dr. Allen and Charlotte Ginsburg Institute for Biomedical Therapeutics, codirector of the USC Roski Eye Institute and University Professor of Ophthalmology at the Keck School.

“Using a different approach — employing assistive technology to enhance, not replace, natural senses — our team adapted AR glasses that project bright colors onto patients’ retinas, corresponding to nearby obstacles,” Humayun said.

Patients with retinitis pigmentosa wore adapted AR glasses as they navigated through an obstacle course based on a U.S. Food and Drug Administration-validated functional test. Using video of each test, researchers recorded the number of times patients collided with obstacles, as well as the time taken to complete the course. Patients averaged 50% fewer collisions with the adapted AR glasses.

Patients also were asked to grasp a wooden peg against a black background — located behind four other wooden pegs — without touching the front items. Patients demonstrated a 70% increase in grasp performance with the AR glasses.

“Patients with retinitis pigmentosa have decreased peripheral vision and trouble seeing in low light, which makes it difficult to identify obstacles and grasp objects. They often require mobility aids to navigate, especially in dark environments,” said Anastasios N. Angelopoulos, study project lead in Humayun’s research laboratory at the Keck School.

“Through the use of AR, we aim to improve the quality of life for low vision patients by increasing their confidence in performing basic tasks, ultimately allowing them to live more independent lives,” Angelopoulos says.

How the AR system works

The AR system overlays objects within a 6-foot wireframe with four bright, distinct colors. In doing so, the glasses provide visual color cues that help people with constricted peripheral vision interpret complex environments, such as avoiding obstacles in dimly lit environments.

To accomplish this, researchers used a process called simultaneous location and mapping, allowing the AR glasses to fully render the 3D structure of a room in real time. The glasses then translated this information into a semitransparent colored visual overlay, which highlighted potential obstacles with bright colors to help patients with spatial understanding and depth perception. This technology can work on commercially available devices.

According to Humayun, while major cost and technical issues remain, this type of assistive technology could eventually become more practical for everyday use in the near future.

###

About the Keck School of Medicine of USC

Founded in 1885, the Keck School of Medicine of USC is among the nation’s leaders in innovative patient care, scientific discovery, education and community service. The school has more than 1,850 full-time faculty members and voluntary faculty numbering more than 2,400 physicians. These faculty direct the education of approximately 800 medical students and 1,000 students pursuing graduate and postgraduate degrees. The school trains more than 900 resident physicians in more than 50 specialty or subspecialty programs and is the largest educator of physicians practicing in Southern California. Keck School faculty also lead research and education within 26 research-oriented basic science and clinical departments, and 17 research institutes across USC’s Health Sciences Campus.

The Keck School was ranked No. 30 in research in the 2020 U.S. News & World Report “Best Graduate Schools” rankings.

For more information, visit keck.usc.edu.

Media Contact
Mary Dacuma
mary.dacuma@med.usc.edu

Related Journal Article

http://dx.doi.org/10.1038/s41598-019-47397-w

Comments