Dual-Comb Fiber Imaging With Deep Learning Hits Video-Rate Single-Pixel Views

Minimally invasive imaging has long faced an uncomfortable trade-off: the deeper a physician needs to look inside the body, the smaller the optical probe must be, and the smaller the probe, the harder it becomes to capture sharp, fast images. A collaborative team from NTT Research, the University of California Irvine, and Los Alamos National Laboratory now reports a way out of this bind. In a paper published in Light: Science & Applications, the researchers demonstrate a fiber-based imaging system that pairs dual optical frequency combs with a Transformer-based deep learning model, achieving two-dimensional imaging of dynamic targets at beyond-video frame rates using nothing more than a single-core optical fiber and a single-pixel photodetector at the front end.

The clinical motivation is straightforward. Endomicroscopy, which allows in vivo, cellular-level visualization of tissue without a physical biopsy, provides critical pathophysiological information for diagnosing gastrointestinal, pulmonary, and neurological abnormalities. Yet conventional high-resolution endoscopes depend on bulky pixelated detector arrays such as CMOS or CCD sensors, and those arrays cannot be miniaturized down to the hundred-micron scale required to reach highly constrained anatomical regions, including the deep brain, without sacrificing resolution. The result is that some of the most medically valuable imaging sites remain effectively off-limits to high-fidelity, real-time optical imaging.

Optical-fiber-based ghost imaging, also known as single-pixel imaging, has long been considered theoretically ideal for these photon-starved, size-constrained environments. Instead of a camera with millions of pixels, the approach projects a sequence of known light patterns onto a scene and records only the total reflected or transmitted intensity with a single detector. Correlating the known patterns with the measured intensities reconstructs an image computationally. In principle, the optical front end can be as simple as one fiber and one detector, which is exactly what a minimally invasive probe demands.

In practice, however, ghost imaging has been held back by several stubborn technical challenges, chief among them a fundamental speed bottleneck. Conventional implementations require slow, sequential pattern projection, either through spatial light modulators that display one pattern at a time or through wavelength sweeps that step through illumination colors sequentially. That serial approach caps the achievable frame rate and introduces severe motion artifacts whenever the target moves, which is precisely the situation in living tissue. Classical reconstruction algorithms add a second problem: substantial computational latency that makes real-time, video-rate image reconstruction impractical for clinical use.

The new system resolves both bottlenecks through a hardware-software co-design. On the hardware side, the researchers leveraged highly stabilized dual optical frequency combs, devices that generate spectra composed of many precisely spaced, phase-coherent lines. Each individual comb line is mapped to a mutually uncorrelated speckle pattern, meaning that many distinct illumination patterns are effectively generated and detected in parallel rather than one after another. Wavelength-division multiplexing, the same technology that carries many data channels through a single optical communications fiber, combines with dual-comb interferometry and ghost imaging to create a minimally invasive optical front end.

The detection step is equally elegant in its compression. After the comb light interacts with the target, the system optically measures the bucket sum of each comb-line power, essentially a hyperspectral multiply-accumulate, or MAC, operation performed in parallel across the spectral channels. In a single photodetection step, the hypercube of data containing two-dimensional spatial information is physically compressed into a one-dimensional analog temporal electrical voltage signal. All of the spatial detail survives only implicitly, encoded in how each speckle pattern weighted the light that reached the detector.

Recovering an image from such a highly compressed snapshot is fundamentally an inverse optimization problem, and this is where the software half of the co-design takes over. The team developed an application-specific deep-learning Transformer model that learns the complex correlations between the known speckle patterns and the corresponding bucket intensities of the target-encoded light. Once trained, the model reconstructs high-fidelity target images from the compressed measurements, outperforming classical reconstruction algorithms in both raw imaging accuracy and processing speed. The combination of parallel optical pattern generation and fast learned reconstruction is what pushes the system past video rates for dynamic scenes.

Dr. Myoung-Gyun Suh, Senior Scientist and Group Head at NTT Research’s Physics and Informatics Laboratories and lead author of the study, emphasized the significance of the combined approach. By merging the inherent parallelism and precision of optical frequency combs with the reconstruction capabilities of a Transformer-based deep learning model, he noted, the team eliminated the sequential projection bottleneck and significantly improved imaging speed and fidelity. He added that the hardware-software co-design dramatically simplifies the optical front end, making high-fidelity dynamic ghost imaging highly viable for size-constrained scenarios such as single-use endomicroscopic probes.

The implications extend well beyond the laboratory bench. Because the entire optical front end consists of a single-core fiber and a single-pixel detector, the architecture is naturally compatible with the narrow, flexible probes that endomicroscopy requires, and one example application highlighted by the researchers is neurosurgical endomicroscopy, where a minimally invasive optical probe must reach deep, confined anatomy. The same properties also suit portable sensing in other constrained environments where cameras and scanning optics cannot fit. By demonstrating the concept experimentally on dynamic targets, the team has moved ghost imaging a significant step toward practical deployment in real-world biomedical applications, freeing the technique from the optical table and bringing it closer to clinical neurosurgical and diagnostic use.

Subject of Research: Dual-comb ghost imaging with deep learning reconstruction for minimally invasive fiber-based endomicroscopy

Article Title: Breakthrough in optical-fiber-based minimally invasive imaging using optical frequency combs and deep learning

Article References: Breakthrough in optical-fiber-based minimally invasive imaging using optical frequency combs and deep learning. (n.d.). Original publication

Image Credits: AI Generated

DOI: Not provided

Keywords: ghost imaging, optical frequency combs, deep learning, Transformer model, endomicroscopy, single-pixel imaging, dual-comb interferometry, wavelength-division multiplexing, hyperspectral imaging, computational imaging, biomedical optics, minimally invasive imaging