Augmented reality technology may help guide plastic and reconstructive surgery
August 25, 2017 – A plastic surgery research group has developed an augmented reality system that enables them to create 3D simulations of the desired results of facial reconstructive procedures and project them over the patient's face during surgery, reports a study in Plastic and Reconstructive Surgery–Global Open®, the official open-access medical journal of the American Society of Plastic Surgeons (ASPS).
Koichi Ueda, MD, PhD, Daisuke Mitsuno, MD, and colleagues of Osaka Medical College, Japan, report the development and initial experience with an augmented reality (AR) system for evaluation of improvements of the body surface, a key consideration in plastic surgery. Initial experience in eight cases suggests that augmented reality could be a useful guide to planning, performing and evaluating the results of facial reconstruction and other procedures.
Development and Initial Experience of Augmented Reality for Plastic Surgery
"Augmented reality is a technology that combines computer-generated images on a screen with a real object or scene," Drs. Ueda and Mitsuno said. "We sought to develop a sophisticated yet simple and modifiable AR technique for use during plastic and reconstructive surgery."
The researchers used a high-definition digital camera to capture 3D image of the facial surface and computed tomography scans to obtain digital information on the underlying facial bones for each patient. These digital data were then manipulated to create 3D simulations of the ideal final results. For example, in a patient with a fractured cheekbone, the reconstruction was simulated by obtaining and reversing an image of the opposite, uninjured bone.
Using a pair of commercially available smart glasses, the surgeon was able to superimpose the 3D digital simulation image of the desired appearance over the patient's face during surgery. The group used free, open source software products to solve various technical problems, including manipulating and displaying the 3D simulations and lining them up (registration) with the surgical field.
The researchers describe their preliminary experience with AR system in eight patients undergoing reconstructive facial surgery. The AR system helped in planning and confirming reconstruction of the underlying facial bones, for example, in a patient with a congenital bone development disorder and another patient with a complex facial fracture. In all cases, the 3D simulation of the body surface provided a visual reference of the final facial appearance.
With each new case, the group made additional technical refinements to address limitations of the AR system. Although the experimental system was not actually used to guide surgery in this initial experience, it helped in visualizing the planned correction and confirming the final outcome.
"In all cases in this study, the body surface contour after the procedure and the ideal postoperative image almost coincided," Dr. Ueda said.
The group plans further studies to confirm the benefits of using the AR system during plastic and reconstructive surgery and to refine the display method for comparing before and after images. Future innovations may include the ability to quantitatively evaluate the improvements in body surface and even to enable simple navigation of internal organs.
Drs. Ueda and Mitsuno believe AR technology could become a useful tool for teaching surgical skills.
They said, "Our findings are not only useful for body surface evaluation but also for effective evaluation of AR technology in the field of plastic surgery."
Click here to read "Intraoperative Evaluation of Body Surface Improvement by an Augmented Reality System That a Clinician Can Modify."
Article: "Intraoperative Evaluation of Body Surface Improvement by an Augmented Reality System That a Clinician Can Modify" (doi: 10.1097/GOX.0000000000001432)
Plastic and Reconstructive Surgery–Global Open® is published by Wolters Kluwer.
About Plastic and Reconstructive Surgery
For more than 70 years, Plastic and Reconstructive Surgery® (http://www.prsjournal.com/) has been the one consistently excellent reference for every specialist who uses plastic surgery techniques or works in conjunction with a plastic surgeon. The official journal of the American Society of Plastic Surgeons, Plastic and Reconstructive Surgery® brings subscribers up-to-the-minute reports on the latest techniques and follow-up for all areas of plastic and reconstructive surgery, including breast reconstruction, experimental studies, maxillofacial reconstruction, hand and microsurgery, burn repair and cosmetic surgery, as well as news on medico-legal issues.
The American Society of Plastic Surgeons is the largest organization of board-certified plastic surgeons in the world. Representing more than 7,000 physician members, the society is recognized as a leading authority and information source on cosmetic and reconstructive plastic surgery. ASPS comprises more than 94 percent of all board-certified plastic surgeons in the United States. Founded in 1931, the society represents physicians certified by The American Board of Plastic Surgery or The Royal College of Physicians and Surgeons of Canada.
About Wolters Kluwer
Wolters Kluwer N.V. (AEX: WKL) is a global leader in information services and solutions for professionals in the health, tax and accounting, risk and compliance, finance and legal sectors. We help our customers make critical decisions every day by providing expert solutions that combine deep domain knowledge with specialized technology and services.
Wolters Kluwer reported 2016 annual revenues of €4.3 billion. The company, headquartered in Alphen aan den Rijn, the Netherlands, serves customers in over 180 countries, maintains operations in over 40 countries and employs 19,000 people worldwide.
Wolters Kluwer shares are listed on Euronext Amsterdam (WKL) and are included in the AEX and Euronext 100 indices. Wolters Kluwer has a sponsored Level 1 American Depositary Receipt program. The ADRs are traded on the over-the-counter market in the U.S. (WTKWY).
Wolters Kluwer Health is a leading global provider of information and point of care solutions for the healthcare industry. For more information about our products and the organization, visit http://www.wolterskluwer.com/, follow @WKHealth or @Wolters_Kluwer on Twitter, like us on Facebook, follow us on LinkedIn, or follow WoltersKluwerComms on YouTube.
For more information about Wolters Kluwer's solutions and organization, visit http://www.wolterskluwer.com, follow us on Twitter, Facebook, LinkedIn, and YouTube.