AI Learns the Heart’s Anatomy to Measure Pumping Power Across Hospitals

Ejection fraction, the percentage of blood the left ventricle pumps out with each beat, is one of the most consequential numbers in cardiology. It guides decisions about heart failure therapy, screens patients before chemotherapy, and determines eligibility for implantable defibrillators. Yet the measurement, typically derived from ultrasound videos of the heart, is notoriously reader-dependent: two sonographers looking at the same clip can disagree by several percentage points, and the disagreement widens when images come from different machines, different protocols, or different hospitals. A new study from researchers at Julius-Maximilians University of Würzburg tackles a problem that has quietly undermined many artificial intelligence efforts in echocardiography: models that perform brilliantly on the dataset they were trained on often falter when shown videos acquired anywhere else.

The research, published in BMC Medical Imaging by Adrian Krenzer, Viktoria Wieser, and Tobias Friedetzki, introduces a pipeline called CAFEx, short for contrastive-augmented feature extraction. The central idea is deceptively simple. Instead of letting a neural network learn whatever features it finds convenient in the raw pixel data, the authors force the model to pass through an anatomical bottleneck: it must first segment the left ventricle, then derive explicit anatomical features from that segmentation mask, and only then regress the ejection fraction over time. This architectural constraint, they hypothesized, would make the learned representation less sensitive to the idiosyncrasies of any single dataset and more anchored to the actual physics and geometry of the beating heart.

The training strategy is what the authors call weakly supervised. Fully annotating echocardiography videos, tracing the endocardial border of the left ventricle frame by frame at end-diastole and end-systole, is expensive and time-consuming, which is precisely why large public datasets such as EchoNet-Dynamic provide only video-level ejection fraction labels for most clips. CAFEx was trained on EchoNet-Dynamic using these coarse video-level labels, with only a limited set of dense segmentation annotations reserved for the anatomical component of the pipeline. A contrastive learning component augments the feature extraction, encouraging the network to learn representations that are stable under the kinds of transformations ultrasound images actually undergo, such as changes in gain, cropping, and probe positioning, rather than superficial texture cues.

Echocardiography-specific augmentation played a crucial role in this design. Generic image augmentations borrowed from natural image benchmarks, such as aggressive color shifts or random erasure, can destroy clinically meaningful information in ultrasound data. The Würzburg team instead applied transformations tailored to the modality, preserving the relationship between the ventricular cavity and the surrounding myocardium while simulating realistic variation in acquisition. The goal was to teach the model that a heart is a heart, whether it was imaged on a high-end scanner at a university hospital or a portable machine in a community clinic.

The true test, and the most scientifically interesting part of the study, was external validation. The researchers trained their models on EchoNet-Dynamic, a large dataset of apical two-chamber and four-chamber videos curated under one set of imaging and annotation conventions, and then evaluated them on CAMUS, the Cardiac Acquisitions for Multi-structure Ultrasound Segmentation dataset, which was acquired under entirely different conditions. Before any model saw the external data, the authors performed careful harmonization: images were preprocessed to reduce domain shift, and the ejection fraction endpoint was recalculated as an apical-four-chamber monoplane measurement so that the target variable itself was defined consistently across both datasets. This step matters because much of the apparent failure of cross-dataset models in prior literature may reflect mismatched definitions of the quantity being predicted rather than genuine degradation of learned features.

The results showed a clear pattern. Anatomically constrained models degraded less when moving from the training dataset to the external one than direct video-regression baselines, which attempt to predict ejection fraction straight from raw video without any segmentation intermediate. The authors reproduced a broad set of competing approaches for comparison, including segmentation-based pipelines, direct regression networks, graph-based methods, transformer architectures, and other feature-extraction designs, and evaluated all of them with three metrics: Dice score for segmentation quality, mean absolute error for ejection fraction accuracy, and the coefficient of determination, R-squared, for how much of the variance in true ejection fraction the model explains.

CAFEx achieved a Dice score of 90.73 percent on the external CAMUS dataset, indicating that the anatomical component generalized well to unseen acquisition conditions. More importantly for clinical relevance, it improved ejection fraction prediction on CAMUS over the strongest reproduced feature-extraction baseline, raising R-squared from 0.38 to 0.54 and reducing the mean absolute error from 7.89 to 6.70 percentage points. In practical terms, the average prediction error of the model shrank by more than a full percentage point, and the proportion of variance it captured rose substantially, though an R-squared of 0.54 still leaves considerable room for improvement before such a system could stand in for a cardiologist.

The study is equally candid about where the approach struggles. Poor-quality videos remained a persistent challenge, as did extreme ejection fraction values at both ends of the clinical spectrum. This is a familiar pattern in medical AI: the bulk of the data clusters around mid-range values where models learn the statistics of the population well, while the severely impaired and hyperdynamic hearts that matter most for triage are underrepresented and harder to characterize. The authors note that quality-control mechanisms, calibration, and further prospective validation are needed before any clinical deployment, a caution that distinguishes this work from the more breathless claims that sometimes accompany medical deep learning papers.

Why does an anatomical bottleneck help generalization? The intuition is that raw-pixel regression models can latch onto dataset-specific artifacts, such as the particular layout of on-screen overlays, the depth settings common in one lab, or the texture signature of one ultrasound vendor. These shortcuts work well in-distribution but collapse when the imaging environment changes. A model that must first outline the left ventricle and compute features from that outline is forced to encode geometry, cavity area change over the cardiac cycle, and ventricular shape, quantities that are physically meaningful and therefore more portable across scanners and protocols. The limited dense annotations act as scaffolding: a small investment in expert tracings steers the entire representation toward anatomy rather than artifact.

The broader significance of the study lies less in the specific numbers than in its methodological stance. The authors argue for controlled external validation under explicit image and target harmonization, a practice that remains rare in a field where many papers report impressive metrics on a single held-out split of a single dataset. As deep learning systems for cardiac imaging move toward real-world use, the question that matters is not how well a model performs on data that looks like its training set, but how gracefully it degrades when confronted with the messy diversity of clinical practice. By showing that weak supervision plus anatomical structure can narrow that gap with only a modest annotation budget, the Würzburg team offers a practical template for building echocardiography AI that travels, and a reminder that the path to trustworthy medical AI runs through other hospitals’ data, not around it.

Subject of Research: Weakly supervised anatomical deep learning for cross-dataset estimation of cardiac ejection fraction from echocardiography videos

Article Title: Weakly supervised anatomical feature learning for cross-dataset ejection fraction estimation from echocardiography videos

Article References: Krenzer, A., Wieser, V., & Friedetzki, T. (2026). Weakly supervised anatomical feature learning for cross-dataset ejection fraction estimation from echocardiography videos. BMC Medical Imaging, 26(1), Article 470. https://doi.org/10.1186/s12880-026-02781-7

Image Credits: AI Generated

DOI: 10.1186/s12880-026-02781-7

Keywords: echocardiography, ejection fraction, weak supervision, deep learning, left ventricle segmentation, cross-dataset evaluation, contrastive learning, medical image analysis, cardiology, EchoNet-Dynamic, CAMUS, heart failure