Evolutionary Algorithms Turn Each Camera Pixel Into Sixteen Sub-Pixels

Every digital camera faces a hard physical ceiling: the smallest detail it can record is set by the size of its pixels. Once light has been funneled into a single photosensitive square, everything that happens within that square is collapsed into one number, and fine structure finer than the pixel pitch is simply lost. For decades, engineers have tried to cheat this limit with software. Deep-learning super-resolution tools can make images look sharper, but they are essentially guessing, hallucinating plausible detail that was never measured. A team of researchers in China now reports a different route, one that claims to beat the pixel limit physically rather than cosmetically, by treating each pixel not as a monolithic detector but as a mosaic of sixteen independently characterized sub-regions.

The study, published in Communications Engineering, was led by Jinchao Liang and Ze Zhang of the Aerospace Information Research Institute at the Chinese Academy of Sciences, together with colleagues from the University of Chinese Academy of Sciences, Aerospace Information University, and partner institutions. Their method, which they call pixel-segmenting imaging, rests on a deceptively simple observation: a pixel does not respond uniformly to light across its area. Quantum efficiency, the probability that an incoming photon generates an electron that the readout circuit can count, varies from point to point within each pixel because of the way microlenses, color filters, and silicon doping are laid down during fabrication. If those variations can be mapped precisely, each pixel becomes a tiny array of detectors with different sensitivities, and the raw sensor output becomes a mixture that can be mathematically unscrambled.

Unscrambling that mixture requires knowing the sensitivity map with high accuracy, and this is where the team’s custom optical system and evolutionary algorithms come in. The researchers illuminate the sensor with carefully designed optical patterns and measure how each pixel responds, then use an evolutionary optimization procedure to infer the intra-pixel quantum efficiency distribution. Evolutionary algorithms, which mimic natural selection by breeding candidate solutions and keeping the fittest, are well suited to this kind of inverse problem because the search space of possible sensitivity maps is enormous, nonlinear, and resistant to conventional gradient-based fitting. By iterating through generations of candidate maps and refining them against measured responses, the algorithm converges on a physical characterization of the sensor that would be extremely difficult to obtain by direct measurement alone.

Once the intra-pixel sensitivity map is known, the imaging model changes fundamentally. The light falling on a single pixel is no longer summed into one value; instead, the measured output is treated as a weighted combination of the intensities reaching each of the sixteen sub-regions, with the weights given by the measured quantum efficiencies. With a custom optical system that projects appropriately structured illumination onto the sensor, the team can solve for those sub-region intensities, effectively reconstructing the scene at a resolution sixteen times finer in area than the native pixel grid. The minimal sampling unit drops from one pixel to one-sixteenth of a pixel, which means the sensor can recover high-frequency spatial information that the original images, under conventional sampling, could not contain.

The performance numbers reported in the paper are striking. At a cut-off frequency of 25 line pairs per millimetre, a standard benchmark for imaging sharpness, the modulation transfer function of the reconstructed images reaches 2.3 times that of the original images. The structural similarity index measure, a metric that captures how faithfully an image preserves perceptually meaningful structure, improves by a factor of 3.1 relative to the originals. These are not marginal gains; they represent a substantial recovery of information that conventional sampling theory would suggest is unrecoverable from a given sensor.

What makes the result particularly notable from an engineering standpoint is that it requires no modification of the sensor hardware itself. The pixel-segmenting approach works with the original device structure intact, relying on a custom optical system in front of the sensor and computational reconstruction behind it. This stands in contrast to strategies that shrink pixels, stack them in three dimensions, or add micromirror arrays, all of which demand expensive changes to fabrication processes. Because the method characterizes the sensor as it is, it could in principle be applied to existing cameras, turning a software-and-optics upgrade into a resolution upgrade.

The distinction between this approach and deep-learning super-resolution is worth emphasizing. Neural-network upscalers are trained on large datasets and learn statistical priors about what natural images look like; when they add detail, they are generating plausible content rather than measuring it. The pixel-segmenting method, by contrast, derives its extra resolution from a physical property of the sensor, the spatial variation of quantum efficiency within each pixel, that is measured and verified for the specific device in use. The recovered high-frequency information is therefore grounded in actual photon measurements rather than in learned expectations, which matters for scientific and security applications where fabricated detail is worse than no detail at all.

The implications reach across several domains. In remote sensing, where satellite and aerial cameras are weight- and power-constrained and cannot simply carry larger sensors, squeezing more resolution out of existing pixels could sharpen Earth-observation imagery without new hardware. In microscopy and industrial inspection, where the finest resolvable feature often determines what can be detected, a sixteen-fold increase in effective sampling density could reveal structures previously blurred away. Consumer imaging could benefit as well, since smartphone cameras are already pushing against the physical limits of pixel miniaturization; a computational layer that extracts sub-pixel information would let manufacturers improve sharpness without the penalty of smaller, noisier pixels.

There are, of course, practical considerations that will shape adoption. The method depends on an accurate intra-pixel quantum efficiency map, which must be measured for each sensor or sensor type, and the evolutionary optimization procedure requires computational resources and careful optical calibration. The custom optical system that structures the illumination must also be integrated into the imaging path, which may be straightforward for dedicated instruments but more challenging for mass-market devices. How the approach performs under real-world conditions, with varying illumination, motion, and noise, will determine whether the laboratory gains translate into field performance. The published work demonstrates the principle and quantifies the improvement under controlled conditions, providing the foundation on which such engineering questions can now be addressed.

For a field that has largely assumed the pixel is an indivisible unit of measurement, the study reframes the problem in a way that is likely to attract attention well beyond optical engineering. By showing that the sampling constraint is not the pixel boundary but the uniformity assumption within it, the researchers have opened a path that combines precision optical characterization, evolutionary computation, and image reconstruction into a single pipeline. If the approach proves robust across sensor types and imaging conditions, the humble pixel, the workhorse of digital imaging for half a century, may turn out to have been hiding sixteen detectors in plain sight all along.

Subject of Research: Sub-pixel imaging using intra-pixel quantum efficiency measurement to exceed pixel-level sampling limits in digital image sensors

Article Title: Pixel-segmenting imaging physically exceeds pixel-level sampling constraints via intra-pixel quantum-efficiency measurement enabled by evolutionary algorithms

Article References: Liang, J., Xue, H., Zhang, C., Guan, M., Xiao, H., Sun, C., Liu, Y., Liu, X., Gao, L., & Zhang, Z. (2026). Pixel-segmenting imaging physically exceeds pixel-level sampling constraints via intra-pixel quantum-efficiency measurement enabled by evolutionary algorithms. Communications Engineering. https://doi.org/10.1038/s44172-026-00773-7

Image Credits: AI Generated

DOI: 10.1038/s44172-026-00773-7

Keywords: digital image sensors, super-resolution, quantum efficiency, evolutionary algorithms, pixel-segmenting imaging, modulation transfer function, optical engineering, computational imaging, sampling constraints, high-frequency recovery, Communications Engineering, image reconstruction