AI Fills the Gaps When Brain Scans Are Missing Their Best Sequences

Brain tumor segmentation has become one of the most consequential tasks in modern radiology, and it depends on something surprisingly fragile: the assumption that every patient arrives with a complete set of MRI sequences. Radiologists routinely rely on four complementary acquisitions — T1-weighted, contrast-enhanced T1-weighted, T2-weighted, and FLAIR — each illuminating a different facet of tumor biology. In the real world, however, one or more of these sequences is frequently absent, whether because of heterogeneous acquisition protocols, patient-related constraints, or incomplete historical records. A new deep learning architecture called MALCNet, described in BMC Medical Imaging, tackles this gap head-on by teaching an artificial intelligence to mentally reconstruct what the missing scans would have contributed.

The problem is more than an inconvenience. When a segmentation model trained on complete four-modality inputs encounters a patient with only two or three sequences, the statistical distribution of the data shifts dramatically, and performance degrades substantially. This distribution shift is the central obstacle in incomplete multi-modal learning, and it has frustrated researchers for years. The team behind MALCNet — led by Mingzhe Zhang, Huijian Chen, and Yang Song, with corresponding authors Muzhen He and Mingping Ma at Fujian Medical University’s Shengli Clinical Medical College — argues that the solution lies not in patching images at the pixel level, but in completing missing information deep inside the network, in the latent space where the machine’s internal representation of anatomy lives.

MALCNet’s design rests on three interlocking technical components. The first is a shared-weight encoder equipped with an adaptive modality-specific correction unit. This encoder extracts hierarchical features that remain anatomy-consistent across modalities while still preserving modality-sensitive cues — the subtle signal differences that distinguish, say, enhancing tumor tissue from surrounding edema on a contrast-enhanced sequence. By sharing weights across modalities yet correcting them adaptively, the encoder avoids the trap of either collapsing all sequences into a bland average or treating each modality as an unrelated island of information.

The second component is the modality-aware imputation transformer, the heart of the latent completion strategy. Operating at the network’s bottleneck, this transformer initializes each missing modality with learnable semantic priors — essentially, learned guesses about what that sequence typically contributes — and then refines those initializations through cross-modal attention. Attention mechanisms allow the model to weigh which available sequences carry the most relevant information for reconstructing the absent one, borrowing structure and semantics from the scans that do exist. The result is a completed latent representation that preserves both anatomical coherence and the modality-specific tumor cues that radiologists depend on.

The third component, an attention-guided multi-scale propagation module, addresses a subtler challenge: completed high-level semantics are useful, but segmentation ultimately demands fine-grained spatial detail at the pixel level. This module transfers the completed high-level information back down to shallow feature maps, propagating reconstructed semantics across multiple scales so that fine spatial details — the precise boundaries of the whole tumor, the tumor core, and the enhancing tumor — are recovered rather than blurred away. It is a deliberate echo of how human vision integrates global context with local detail.

Training MALCNet involves a dual-branch consistency optimization strategy that aligns predictions and internal features between complete-modality and incomplete-modality inputs. In practice, the network learns from both branches simultaneously, forcing the representations derived from partial data to stay consistent with those derived from full data. This consistency constraint is what allows the model to behave reliably no matter which of the fifteen non-empty modality configurations it faces — from a single sequence all the way up to the full four-modality set.

The evaluation is unusually thorough. The team tested MALCNet separately on two public BraTS releases, BraTS2019 and BraTS2020, under all fifteen non-empty modality configurations. On BraTS2019, the model achieved average Dice similarity coefficients of 86.68 percent for whole tumor, 76.73 percent for tumor core, and 63.60 percent for enhancing tumor. On BraTS2020, the corresponding values rose to 87.86 percent, 79.59 percent, and 64.10 percent. The Dice coefficient, a standard measure of overlap between predicted and ground-truth segmentations, is the gold standard for judging segmentation accuracy, and these figures represent strong performance across the board.

What makes the results particularly compelling is the statistical rigor. In subject-level paired comparisons against six existing incomplete-modality methods, MALCNet showed statistically significant differences for all tumor regions on both releases, with all P-values at or below 0.002. In a field where incremental improvements often hover within the margin of noise, this level of statistical significance across every region and every configuration is a clear signal that the latent completion approach delivers genuine gains rather than marginal tweaks.

The clinical implications are significant. Accurate, automated tumor segmentation supports treatment planning, surgical navigation, and longitudinal monitoring of tumor growth and response to therapy. If a model can maintain reliable performance even when a patient’s scan is missing the contrast-enhanced sequence — often the most informative for identifying actively enhancing tumor tissue — then hospitals with limited imaging resources, retrospective archives with incomplete records, and patients who cannot tolerate contrast agents all stand to benefit. The approach effectively future-proofs segmentation pipelines against the messiness of real-world data acquisition.

There are broader lessons here for medical AI as a whole. The field has long been dominated by models that assume pristine, complete inputs, an assumption that collapses the moment data meets clinical reality. MALCNet’s philosophy — complete missing information in the latent space, preserve anatomical coherence, and enforce consistency between full and partial data — offers a template that could extend beyond brain tumors to other organs, other imaging modalities, and other tasks where incompleteness is the norm rather than the exception. As deep learning matures, the winners may not be the models with the most parameters, but the ones designed to survive the gaps in the data they are asked to interpret.

Subject of Research: Deep learning network MALCNet completes missing MRI modality information in the latent space for robust brain tumor segmentation

Article Title: MALCNet: modality-aware latent completion network for brain tumor segmentation with incomplete MRI modalities

Article References: Zhang, M., Chen, H., Song, Y., Lin, Y., Dai, X., He, M., & Ma, M. (2026). MALCNet: modality-aware latent completion network for brain tumor segmentation with incomplete MRI modalities. BMC Medical Imaging. https://doi.org/10.1186/s12880-026-02726-0

Image Credits: AI Generated

DOI: 10.1186/s12880-026-02726-0

Keywords: brain tumor segmentation, MRI modalities, deep learning, latent space imputation, medical imaging, MALCNet, incomplete multi-modal learning, BMC Medical Imaging, modality-aware, latent, completion, network