Non-invasive eye imaging technologies have revolutionized ophthalmic diagnostics, offering an unprecedented three-dimensional microscopic view of the retina and adjacent ocular structures without causing patient discomfort. Among these modalities, optical coherence tomography (OCT) stands out as an indispensable clinical tool worldwide, generating hundreds of cross-sectional images in a single, rapid scan. These detailed images grant physicians the ability to discern subtle pathological changes within the myriad layers of retinal tissue, essential for diagnosing a spectrum of sight-threatening conditions. However, the sheer volume and complexity of the images present a formidable challenge, often requiring exhaustive manual review by experts, a process susceptible to human error and inefficiency.
Addressing this bottleneck, researchers from Washington University School of Medicine in St. Louis, in tandem with collaborators at the University of Washington in Seattle and the biotech firm Genentech, have developed an advanced artificial intelligence (AI) system to automate and enhance the interpretation of these voluminous eye scans. Dubbed OCTCube-M, this experimental AI framework comprises a triad of models engineered to assimilate and analyze three-dimensional OCT data alongside additional imaging modalities, thereby expediting diagnostic workflows and enabling earlier detection of retinal diseases.
In a landmark study recently published in Nature Biomedical Engineering, the investigative team demonstrated the superior diagnostic acumen of OCTCube-M compared to preceding 2D-based AI models. The system exhibited markedly improved accuracy in identifying eight distinct retinal pathologies, notably including age-related macular degeneration (AMD), the foremost cause of blindness among individuals over 50. Additionally, OCTCube-M outperformed current benchmarks in forecasting the progression rate of geographic atrophy, a severe variant of AMD characterized by retina deterioration.
This pioneering research articulates a transformative vision for ophthalmic care. “Today’s imaging technologies deliver high-resolution glimpses into ocular microstructures, yet the deluge of generated images exceeds the practical review capacity of clinicians,” stated Dr. Aaron Lee, Arthur W. Stickle Distinguished Professor and head of ophthalmology at Washington University. “Our AI system empowers physicians to navigate this vast data landscape more swiftly and accurately, tailoring interventions and optimizing clinical trials for novel treatments.”
Beyond ocular applications, the study uncovered the AI model’s remarkable potential to infer systemic health risks. By analyzing retinal vasculature patterns, OCTCube-M demonstrated capabilities in predicting major cardiovascular incidents—including heart attacks and strokes—as well as renal failure. Given that the retina’s microvascular architecture mirrors that of the kidneys and shares pathogenic pathways with cerebral and cardiac vessels, retinal images serve as a window into broader vascular health.
The global burden of vision impairment remains staggering, with the World Health Organization estimating over 2.2 billion affected individuals. OCT’s emergence as a diagnostic standard has profoundly impacted glaucoma, diabetic retinopathy, and macular degeneration management by providing rapid acquisition of volumetric retinal data. However, leveraging this wealth of information has historically been constrained by the limitations of manual image analysis.
Recent advances in AI, especially deep learning, have sought to bridge this gap. Notably, prior models focusing exclusively on 2D retinal images have shown promise in enhancing diagnostic precision. Building upon this, the OCTCube-M team hypothesized that integrating volumetric (3D) data would capture disease manifestations extending beyond planar slices, particularly critical in evaluating the fovea—a crucial retinal region responsible for high-acuity vision.
To train OCTCube-M, the researchers compiled an unprecedented dataset exceeding 26,000 3D OCT scans, constituting approximately 1.62 million individual retinal slices. This vast dataset enabled the model to learn intricate spatial features and disease signatures with greater fidelity. Performance assessments revealed that OCTCube-M improved disease detection accuracy by four to six percentage points for six of the eight targeted retinal conditions over 2D models—equating to the identification of approximately 43 to 60 additional affected individuals per thousand scans.
The spectrum of retinal diseases recognized includes those predominantly impacting the retina and optic nerve, which are major causes of irreversible vision loss globally. The model’s robustness was validated across diverse demographic cohorts, imaging platforms, and clinical environments, underscoring its broad applicability.
Further refinement involved augmenting the OCTCube-M framework with multimodal data by integrating infrared retinal imaging and fundus autofluorescence imaging alongside OCT volumes. This holistic approach synthesized complementary imaging information, furnishing a more comprehensive retinal assessment. The tri-modality model excelled in predicting the enlargement kinetics of geographic atrophy lesions, outperforming current state-of-the-art single-modality prognostic models by nearly 50%.
Geographic atrophy, affecting an estimated five million people worldwide, remains a therapeutic enigma with limited intervention options. Accurate prediction of lesion growth rates is pivotal for staging severity and optimizing patient stratification in clinical trials. By furnishing reliable prognostic indicators, OCTCube-M can streamline trial design, reduce participant burden, and accelerate the evaluation of emerging therapies.
Looking ahead, the research consortium intends to scale OCTCube-M’s training regimen with larger, more heterogeneous datasets encompassing broader disease ontologies and additional imaging techniques. Such efforts aim to further enhance diagnostic sensitivity and expand the AI’s clinical utility.
This innovation marks a paradigm shift in ophthalmology, fusing cutting-edge AI with state-of-the-art imaging to transcend traditional diagnostic paradigms. It epitomizes the potential of multimodal deep learning to not only revolutionize specialty care but also to act as a sentinel for systemic diseases, harnessing the eye as a biomarker-rich portal into overall human health.
As OCTCube-M and comparable AI systems progress toward clinical integration, they promise transformative impacts: hastening diagnosis, personalizing therapy, improving trial design efficiency, and ultimately preserving sight for millions at risk worldwide.
Subject of Research: People
Article Title: A 3D multi-modal foundation model for optical coherence tomography.
News Publication Date: 24-Apr-2026
Web References:
https://doi.org/10.1038/s41551-026-01662-2
Keywords: Machine learning, Optical coherence tomography, Retinal imaging, Artificial intelligence, Multimodal imaging, Age-related macular degeneration, Geographic atrophy, Predictive modeling, Vascular health, Deep learning
