<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>methodological rigor in AI chest X-ray research &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/methodological-rigor-in-ai-chest-x-ray-research/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Sat, 12 Sep 2026 18:43:45 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>methodological rigor in AI chest X-ray research &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>AI Reads Chest X-Rays Well in the Lab, but a New Review Warns the Clinic Is Another Story</title>
		<link>https://scienmag.com/ai-reads-chest-x-rays-well-in-the-lab-but-a-new-review-warns-the-clinic-is-another-story/</link>
		
		<dc:creator><![CDATA[Ophelia Keating]]></dc:creator>
		<pubDate>Sat, 12 Sep 2026 18:43:45 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[AI chest X-ray diagnostic accuracy]]></category>
		<category><![CDATA[Artificial Intelligence]]></category>
		<category><![CDATA[challenges]]></category>
		<category><![CDATA[chest X-ray]]></category>
		<category><![CDATA[clinical relevance of AI models for pneumonia and tuberculosis]]></category>
		<category><![CDATA[Clinical validation]]></category>
		<category><![CDATA[clinical validation of AI in radiology]]></category>
		<category><![CDATA[convolutional neural networks]]></category>
		<category><![CDATA[COVID-19]]></category>
		<category><![CDATA[critical review of AI performance in COVID-19 diagnosis]]></category>
		<category><![CDATA[deep learning]]></category>
		<category><![CDATA[evidence quality in AI-driven chest X-ray analysis]]></category>
		<category><![CDATA[imaging-specific considerations in medical AI validation]]></category>
		<category><![CDATA[limitations of AI for thoracic disease detection]]></category>
		<category><![CDATA[Medical Imaging]]></category>
		<category><![CDATA[methodological rigor in AI chest X-ray research]]></category>
		<category><![CDATA[pneumonia detection]]></category>
		<category><![CDATA[reproducibility]]></category>
		<category><![CDATA[reproducibility challenges in medical AI studies]]></category>
		<category><![CDATA[standardized evaluation frameworks for AI in radiology]]></category>
		<category><![CDATA[technical validity issues in AI-based thoracic imaging]]></category>
		<category><![CDATA[thoracic disease classification]]></category>
		<category><![CDATA[transfer learning]]></category>
		<category><![CDATA[tuberculosis]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=197544</guid>

					<description><![CDATA[A comprehensive review of 81 studies finds that AI models for classifying thoracic diseases on chest X-rays show impressive lab performance but suffer from dataset limitations, inconsistent methodology and scarce clinical validation.]]></description>
										<content:encoded><![CDATA[<p>Artificial intelligence has spent the past half-decade learning to read chest X-rays with astonishing fluency, and the published record is full of models that appear to rival radiologists at spotting pneumonia, tuberculosis, COVID-19, pneumothorax and other thoracic diseases. But a sweeping new review argues that the field&#8217;s headline numbers conceal a more troubling reality: most of the evidence supporting these systems is thinner, less standardized and less clinically validated than the near-perfect accuracy scores suggest. In a comprehensive critical analysis published in Neural Computing and Applications, researchers from the National Engineering School of Sfax at the University of Sfax in Tunisia examined 81 studies of AI-based thoracic disease classification published between 2020 and 2025, and their verdict is a sobering reality check for one of medical AI&#8217;s most active frontiers.</p>
<p>The review, led by Yosra Didi together with Ahlem Walha and Ali Wali, does not simply catalog architectures and accuracy figures. Instead, the authors organize the literature through a structured five-dimensional qualitative analytical framework covering methodological rigor, clinical relevance, technical validity, reproducibility evidence and imaging-specific considerations. Crucially, the team is transparent that this framework is a lens for structured qualitative comparison rather than a quantitative scoring system, a deliberate choice that reflects how difficult it is to compare studies whose experimental designs differ so widely. By attending explicitly to methodological context, the review aims to explain why results that look comparable on paper may not be comparable in practice.</p>
<p>Technically, the field the authors survey is dominated by convolutional neural networks, the deep learning family that has become the workhorse of medical image analysis. The reviewed studies trace a clear evolutionary arc: early work relied on classic backbones such as VGG, ResNet, Inception and Xception, typically fine-tuned on ImageNet pre-trained weights through transfer learning, while more recent efforts embrace efficient architectures like MobileNet and EfficientNet for deployment-friendly inference, capsule networks for preserving spatial hierarchies, and vision transformers such as the Swin transformer that replace convolutional inductive biases with attention-based global context. Ensemble methods, which combine predictions from multiple networks to squeeze out additional accuracy, appear repeatedly, as do hybrid pipelines that pair deep feature extractors with classical classifiers such as support vector machines, k-nearest neighbors and random forests.</p>
<p>Alongside pure classification, the review documents a substantial strand of work built on segmentation networks, including U-Net and V-Net, that first delineate lungs, heart borders or lesion regions before classification proceeds. Studies of cardiomegaly detection, tuberculosis localization and COVID-19 severity assessment illustrate why this matters: segmenting the anatomical structure of interest can focus a model&#8217;s attention on clinically relevant tissue and reduce the risk that a network learns shortcuts from irrelevant image regions. Attention mechanisms and explainable AI overlays, such as probability maps and saliency-based visualizations, are increasingly bolted onto these pipelines in an effort to make black-box predictions legible to clinicians, though the review notes that interpretability claims are rarely tested against actual radiologist reasoning.</p>
<p>The data underpinning all of this is a familiar roster of public benchmark datasets: ChestX-ray8 and its successors, CheXpert, PadChest, MIMIC-CXR, VinDr-CXR, the Montgomery and Shenzhen tuberculosis collections, the Kaggle pneumonia archives, and a wave of COVID-19 repositories assembled during the pandemic, including the COVID-19 Radiography Database, BIMCV-COVID-19+, and the RSNA Ricord releases. The authors find that studies evaluated on a single dataset report systematically more optimistic performance than those subjected to multi-dataset evaluation regimes, a pattern consistent with models overfitting to the imaging characteristics, label conventions and patient populations of one institution. When the same architecture is tested across hospitals, scanners and countries, performance differences between datasets emerge that single-cohort experiments never reveal.</p>
<p>Underlying dataset limitations compound the problem. Many widely used chest X-ray corpora carry labels derived automatically from radiology reports rather than from independent expert adjudication, introducing label noise that caps achievable accuracy in ways rarely quantified. Class imbalance, uncertain and missing labels, and demographic and geographic skew all recur across the reviewed corpus, and the reviewers highlight that such weaknesses directly affect diagnostic reliability. Data augmentation, including generative approaches based on convolutional GANs and techniques such as CLAHE contrast enhancement, is frequently deployed to compensate, but the review observes that augmentation choices are rarely ablated systematically, leaving it unclear how much of a reported gain comes from the model and how much from the preprocessing recipe.</p>
<p>Perhaps the most damning findings concern experimental hygiene. Across a substantial share of the 81 studies, the reviewers document inconsistent experimental design choices, non-standardized preprocessing pipelines and limited ablation reporting, making it genuinely difficult to determine which technical innovations actually drive performance. Preprocessing steps ranging from resizing and normalization to lung cropping and denoising vary from paper to paper, sometimes within evaluations of the same architecture, and hyperparameter details are often underreported. The reproducibility picture is similarly uneven: code and trained weights are infrequently released, and the review points to established reporting standards, such as the CLAIM checklist for artificial intelligence in medical imaging, as tools that remain underused despite being designed precisely to address these gaps.</p>
<p>The scarcity of external clinical validation emerges as the review&#8217;s central concern. Very few of the surveyed systems have been tested on data from institutions absent from training, and fewer still have been evaluated in genuine clinical workflows with radiologists in the loop. The authors draw an implicit contrast with landmark analyses, such as the widely cited Nature Machine Intelligence study cataloging common pitfalls in COVID-19 machine learning research, which documented how data leakage and flawed study design produced models that collapsed outside their original datasets. Against that backdrop, the pattern the Tunisian team identifies, apparent performance differences between single-dataset and multi-dataset regimes paired with limited external validation, reads as a warning that laboratory excellence has not yet translated into deployable trust.</p>
<p>Still, the review is constructive rather than dismissive. Based on architectural cross-comparisons and a qualitative audit of reproducibility practices, the authors consolidate recommendations for the field: adopt multi-dataset and external validation as the default rather than the exception, standardize preprocessing and reporting so that results can be meaningfully compared, report ablations that isolate the contribution of each design choice, and design studies around clinical relevance from the outset, including the disease prevalence, co-morbidities and imaging conditions of the intended deployment setting. They also flag the open challenges that will define the next phase of the field, chief among them generalization across populations and scanners, evaluation standardization, and the practical integration of these models into radiology workflows.</p>
<p>The stakes could hardly be higher. Chest radiography remains one of the most performed imaging examinations in the world, and in many health systems, particularly in low- and middle-income countries where the review&#8217;s tuberculosis-focused literature is concentrated, a reliable AI triage tool could extend diagnostic capacity where radiologists are scarce. The review&#8217;s authors, who report no funding and no conflicts of interest, analyzed only publicly available published studies and generated no new datasets of their own. Their message to the community is ultimately one of disciplined optimism: the technical machinery for AI-assisted chest X-ray interpretation is mature and improving rapidly, but the evidence base must be rebuilt on foundations of external validation, transparent reporting and standardized evaluation before these systems can responsibly share the reading room with human experts.</p>
<p><strong>Subject of Research:</strong> AI-driven thoracic disease classification in chest radiography</p>
<p><strong>Article Title:</strong> AI-driven techniques for thoracic disease classification in chest radiography: A comprehensive review and critical analysis</p>
<p><strong>Article References:</strong> Didi, Y., Walha, A., &amp; Wali, A. (2026). AI-driven techniques for thoracic disease classification in chest radiography: A comprehensive review and critical analysis. <em>Neural Computing and Applications, 38</em>(17), Article 737. <a href="https://doi.org/10.1007/s00521-026-12457-6" rel="noopener noreferrer">https://doi.org/10.1007/s00521-026-12457-6</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s00521-026-12457-6" rel="noopener noreferrer">10.1007/s00521-026-12457-6</a></p>
<p><strong>Keywords:</strong> artificial intelligence, deep learning, chest X-ray, thoracic disease classification, convolutional neural networks, medical imaging, pneumonia detection, tuberculosis, COVID-19, transfer learning, clinical validation, reproducibility</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">197544</post-id>	</item>
	</channel>
</rss>
