The future of lunar exploration is taking shape within the walls of a seemingly ordinary office at the University of Colorado Boulder. Amidst gray carpeting and lacking windows, a robot, affectionately dubbed “Armstrong,” glides across the floor on three wheels. Its purpose is simple yet profound: it utilizes a claw-equipped arm to lift and place plastic blocks on the ground. While Armstrong’s current functions are far from the harsh realities of moon missions, this robotic endeavor signifies a shift towards a collaborative approach, where fleets of robots work side by side with humans to construct habitats and scientific stations on the lunar surface.
Xavier O’Keefe, a fresh graduate with a bachelor’s degree in aerospace engineering sciences, meticulously maneuvers Armstrong from a nearby room. With virtual reality goggles strapped to his head, he is transported into the realm of the robot, gaining an immersive perspective through a camera mounted atop the machine. O’Keefe expresses his amazement at this blend of virtual reality technology with robotics: “It’s impressively immersive. The first couple of times I used the VR, the robot was sitting in the corner, and it was really weird to see myself using it.”
Driven by this immersive training experience, O’Keefe is part of an innovative research team comprised of both current and former undergraduate students. Their central question revolves around how to train astronauts and operators on Earth to handle robotic equipment on the treacherous lunar surface, where gravity is only one-sixth of what it is on Earth and permanent darkness engulfs many craters. This inquiry reflects a significant aspect of NASA’s Artemis Program, which seeks to combine human ingenuity with robotic assistance to explore and potentially inhabit the moon.
In a revealing study, the team shared their findings surrounding “digital twins,” a term used to describe hyper-realistic virtual environments that can serve as simulations for training. These digital counterparts offer a non-destructive way for participants to learn the intricacies of operating robots, substantially reducing the risks associated with handling valuable, complex equipment on the moon. Funded in part by NASA and the company Lunar Outpost, this project is a testament to the future of space exploration where virtual and physical realms converge.
The momentum of the research has also garnered attention within the realm of academia. Jack Burns, an astrophysics professor emeritus, leads the broader effort to design a sophisticated scientific observatory on the moon, aptly named FarView. This ambitious project envisions a network of 100,000 antennas spread across a sprawling 77 square-mile section of the lunar landscape. In this perspective, Burns underscores the evolution of lunar exploration: “Unlike the Apollo program where human astronauts did all the heavy lifting on the moon, NASA’s 21st-century Artemis Program will combine astronauts and robotic rovers working in tandem.”
The researchers’ foremost task was to establish a digital twin of Armstrong, which involved recreating their office in a video game engine called Unity. Attention to detail was paramount; researchers aimed to replicate every aspect of their actual environment, from the beige walls to the drab carpeting. They meticulously timed Armstrong’s movements over a one-yard distance, correlating these findings with its virtual counterpart to ensure consistency between the two realms. This comprehensive approach underscores the significance of accurately reflecting real-world dynamics in virtual training scenarios.
Subsequently, the research team initiated an experiment that gathered 24 participants to control Armstrong in real-time from a distance, donning VR goggles that immersed them into the robotic world. The participants engaged in the task of manipulating a plastic block designed to symbolize one of the antennas planned for the FarView project. Half of these participants were granted the opportunity to practice the same task within the digital twin prior to their hands-on experience with the actual robot. The findings were striking, revealing that those with prior exposure to the digital twin completed the task approximately 28% faster than their counterparts who only interacted with the physical robot.
Beyond the raw numbers, the psychological benefits of this training approach are equally noteworthy. Participants who practiced in the digital environment reported feeling less stressed during the task. O’Keefe remarked on the broader implications of this technology for lunar exploration training: “That’s what is really exciting about this—you’re able to simulate everything in the environment, from the shadows to the texture of the dirt, and then train operators on conditions that are as close to real as possible.”
The practical aspects of this research not only contribute to future lunar missions but also equip students like McCutchan, who graduated with her master’s degree in aerospace engineering sciences in 2025, with valuable real-world problem-solving experiences. Throughout the project’s progression, the team encountered unexpected challenges that highlighted the complexities of human-robot interactions. For example, participants initially struggled with the task of retrieving the fake antennas, often flipping the blocks unintentionally—an oversight that the team had not anticipated.
As these young researchers develop their digital twin technology, they remain focused on recreating the significantly more complex lunar surface environment. Currently, the team is collaborating with Lunar Outpost to create a digital twin of a lunar rover, through which they hope to simulate real lunar operational conditions more accurately. One of the critical challenges they face is mimicking the behavior of lunar dust, which can obscure essential sensors and cameras when disturbed. This endeavor encapsulates the extent to which creating an accurate training environment can influence the effectiveness of robotic operations on the moon.
The importance of this research extends beyond the immediate training of operators; it revolves around a larger vision for sustainable lunar exploration. As humanity prepares to return to the moon, this revolutionary approach to training is laying the groundwork for future missions that will see the convergence of human skills and robotic precision. O’Keefe expresses excitement for being part of this pivotal moment in space exploration: “It’s awesome to be part of this, even if it is a small part of getting people on the moon.”
As researchers continue to refine their simulations and prepare for the next stage of exploration, it becomes clear that the intersection of technology and human capability will be a cornerstone of our return to the lunar landscape. The contributions from universities like CU Boulder symbolize a new era of discovery, where the collaboration between humans and robots can redefine our approach to space exploration.
The world watches closely as these technological advancements unfold, with the potential to revolutionize how we explore not only the moon but eventually Mars and beyond. The steps being taken today are not merely practical considerations; they signify a fundamental shift in understanding the complexities of extraterrestrial environments and how to effectively operate within them. In this high-stakes arena, the blend of virtual reality and robotics promises to unlock new potentials in the quest for knowledge beyond our planet, illuminating a future rich with possibility.
Subject of Research: Training for lunar robotic operations using digital twin technology
Article Title: Practice makes perfect: A study of digital twin technology for assembly and problem-solving using lunar surface telerobotics
News Publication Date: 19-May-2025
Web References: Example Reference
References: Various research articles and studies on telerobotics and VR training
Image Credits: CU Boulder imaging and rendering of the Armstrong robot used in experiments
Keywords
lunar exploration, robotics, digital twin, NASA, virtual reality, training, CU Boulder, aerospace engineering, Artemis Program
