<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>clinical data &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/clinical-data/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Sun, 11 Oct 2026 21:53:40 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>clinical data &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>AI That Reads Brain Scans and Medical Records Boosts Alzheimer&#8217;s Diagnosis</title>
		<link>https://scienmag.com/ai-that-reads-brain-scans-and-medical-records-boosts-alzheimers-diagnosis/</link>
		
		<dc:creator><![CDATA[Cassandra Pierce]]></dc:creator>
		<pubDate>Sun, 11 Oct 2026 21:53:40 +0000</pubDate>
				<category><![CDATA[Medicine]]></category>
		<category><![CDATA[AI accuracy in disease staging]]></category>
		<category><![CDATA[AI-powered medical diagnostics]]></category>
		<category><![CDATA[Alzheimer's disease]]></category>
		<category><![CDATA[Alzheimer's disease diagnosis]]></category>
		<category><![CDATA[brain MRI scan analysis]]></category>
		<category><![CDATA[clinical data]]></category>
		<category><![CDATA[combining clinical records and imaging data]]></category>
		<category><![CDATA[deep learning]]></category>
		<category><![CDATA[deep learning in medical imaging]]></category>
		<category><![CDATA[DenseNet]]></category>
		<category><![CDATA[early detection of dementia]]></category>
		<category><![CDATA[early diagnosis]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[medical imaging research in China]]></category>
		<category><![CDATA[Mild Cognitive Impairment]]></category>
		<category><![CDATA[mild cognitive impairment classification]]></category>
		<category><![CDATA[MRI]]></category>
		<category><![CDATA[multimodal fusion]]></category>
		<category><![CDATA[neural networks for neurodegenerative diseases]]></category>
		<category><![CDATA[neuroimaging]]></category>
		<category><![CDATA[precision medicine in Alzheimer's]]></category>
		<category><![CDATA[ResNet]]></category>
		<category><![CDATA[routine clinical data integration]]></category>
		<category><![CDATA[SENet]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=263162</guid>

					<description><![CDATA[A multimodal deep learning model combining MRI scans with clinical data classifies Alzheimer's disease stages with up to 95 percent accuracy, offering a promising path toward earlier diagnosis.]]></description>
										<content:encoded><![CDATA[<p>Alzheimer&#8217;s disease is notoriously difficult to pin down in its early stages, when the difference between normal aging, mild cognitive impairment, and full-blown dementia can be frustratingly blurry. Now a team of researchers in China has shown that a deep learning model which combines brain MRI scans with routine clinical information can classify patients across these disease stages with remarkable accuracy, reaching roughly 95 percent accuracy in distinguishing Alzheimer&#8217;s patients from healthy controls. The study, published in BMC Medical Imaging, suggests that the future of dementia diagnosis may lie not in a single perfect test, but in the intelligent fusion of everything doctors already know about a patient.</p>
<p>The research, led by Lemin He, Shuting Liu, Weizhao Lu, Feng He, and Guangyu Zhang, drew on data from the National Alzheimer&#8217;s Coordinating Center, one of the largest publicly available repositories of Alzheimer&#8217;s research data in the world. Participants with complete MRI scans and clinical records were sorted into three groups: those with Alzheimer&#8217;s disease, those with mild cognitive impairment, and normal controls. Mild cognitive impairment is the critical middle ground, a stage where memory and thinking problems are noticeable but not yet disabling, and where early intervention could have the greatest impact.</p>
<p>Technically, the team took a two-track approach. The MRI images were first standardized through preprocessing pipelines to ensure that differences in scanners, protocols, and image quality would not confound the results. The cleaned images were then fed into three different convolutional neural network architectures, each a well-established workhorse of modern computer vision: ResNet, DenseNet, and SENet. ResNet, or residual network, uses shortcut connections that allow information to skip layers, solving the problem of vanishing gradients that once made very deep networks impossible to train. DenseNet goes further, connecting each layer to every other layer in a feedforward fashion, which encourages feature reuse and keeps parameter counts manageable.</p>
<p>The third architecture, SENet, turned out to be the most interesting of the three. Squeeze-and-excitation networks add a mechanism that lets the model dynamically reweight the importance of different feature channels, effectively teaching it to pay attention to the most informative patterns in the image and suppress the noise. In the context of Alzheimer&#8217;s disease, where the earliest signs may be subtle changes in regions like the hippocampus rather than dramatic structural damage, this attention mechanism proved its worth. The study found that SENet showed particular sensitivity in distinguishing Alzheimer&#8217;s disease from mild cognitive impairment, arguably the hardest and most clinically valuable classification task of all.</p>
<p>But the real innovation was not in the image analysis alone. Alongside the imaging features, the researchers standardized a set of clinical variables drawn from patient records and fused them with the imaging features at the feature level, meaning the two streams of information were merged into a single representation before the final classification decision was made. This is a deliberate design choice: rather than running two separate models and averaging their votes, the network learns how imaging findings and clinical context interact. A shrunken hippocampus means something different in an 85-year-old with years of education than in a 65-year-old with neuropsychiatric symptoms, and feature-level fusion lets the model capture those nuances.</p>
<p>The results were striking. Adding clinical features to the MRI-based models pushed the accuracy of distinguishing Alzheimer&#8217;s disease from normal controls to approximately 0.95, a level of performance that approaches what would be needed in a real clinical setting. For the more challenging tasks involving mild cognitive impairment, the area under the curve, a standard measure of a classifier&#8217;s ability to separate groups across all decision thresholds, rose to between 0.87 and 0.90. These numbers matter because the boundary between mild impairment and dementia is exactly where misclassification is most common and most costly, delaying both treatment and planning for patients and families.</p>
<p>What elevates this study beyond a leaderboard exercise is its attention to interpretability. The researchers examined how the model&#8217;s outputs correlated with established clinical indicators of disease severity, and found meaningful associations with education, age, sex, and neuropsychiatric symptoms. In other words, the network was not just making opaque guesses; its classifications tracked with factors that neurologists genuinely consider when assessing patients. This kind of alignment between machine output and clinical intuition is essential for building trust, because a model that contradicts expert judgment without explanation is unlikely to ever leave the laboratory, no matter how impressive its accuracy figures.</p>
<p>The implications for early detection are considerable. Alzheimer&#8217;s disease pathology, including the accumulation of amyloid plaques and tau tangles, begins years before symptoms appear, and the window for disease-modifying therapies is widely believed to be earliest in the course. Current diagnostic approaches rely on a patchwork of cognitive testing, imaging, cerebrospinal fluid analysis, and increasingly expensive PET tracers, none of which is universally accessible. A model that squeezes maximum diagnostic value out of standard MRI scans and information already sitting in the medical record could democratize early assessment, particularly in regions without access to advanced molecular imaging.</p>
<p>There are, of course, caveats. The study was retrospective, using de-identified data from a research database rather than prospectively recruited patients, and the authors note that no additional ethical approval was required for this secondary analysis. Real-world deployment would require validation on external datasets, across different scanners, populations, and health systems, and the NACC cohort may not fully represent the diversity of patients seen in community clinics. Deep learning models in medicine also face persistent challenges around dataset shift, bias, and the risk of learning shortcuts rather than true disease biology, all of which demand careful scrutiny before clinical adoption.</p>
<p>Still, the study adds to a growing body of evidence that multimodal artificial intelligence can outperform any single source of information in the fight against dementia. By teaching machines to read brain scans and clinical histories together, and by building attention mechanisms that highlight the subtlest disease-related patterns, the researchers have moved the field a step closer to tools that could flag Alzheimer&#8217;s disease earlier, monitor its progression more precisely, and ultimately give patients and their doctors more time to act. The work was supported by the Shandong Provincial Natural Science Foundation and the Youth Fund of Shandong First Medical University, and it is published open access, allowing researchers worldwide to build on its findings.</p>
<p><strong>Subject of Research:</strong> Multimodal deep learning combining MRI and clinical data for Alzheimer&#x27;s disease stage classification</p>
<p><strong>Article Title:</strong> Multi-modal deep learning for Alzheimer’s disease classification using MRI and clinical information</p>
<p><strong>Article References:</strong> He, L., Liu, S., Lu, W., He, F., &amp; Zhang, G. (2026). Multi-modal deep learning for Alzheimer’s disease classification using MRI and clinical information. <em>BMC Medical Imaging</em>. <a href="https://doi.org/10.1186/s12880-026-02803-4" rel="noopener noreferrer">https://doi.org/10.1186/s12880-026-02803-4</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1186/s12880-026-02803-4" rel="noopener noreferrer">10.1186/s12880-026-02803-4</a></p>
<p><strong>Keywords:</strong> Alzheimer&#x27;s disease, deep learning, MRI, multimodal fusion, mild cognitive impairment, early diagnosis, SENet, ResNet, DenseNet, machine learning, neuroimaging, clinical data</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">263162</post-id>	</item>
		<item>
		<title>Machine Learning Framework Boosts Reliable Hepatitis C Diagnosis from Routine Blood Data</title>
		<link>https://scienmag.com/machine-learning-framework-boosts-reliable-hepatitis-c-diagnosis-from-routine-blood-data/</link>
		
		<dc:creator><![CDATA[Ophelia Keating]]></dc:creator>
		<pubDate>Wed, 07 Oct 2026 11:19:29 +0000</pubDate>
				<category><![CDATA[Medicine]]></category>
		<category><![CDATA[AI-based medical diagnostics]]></category>
		<category><![CDATA[Artificial Intelligence]]></category>
		<category><![CDATA[blood test data analysis]]></category>
		<category><![CDATA[BMC Infectious Diseases]]></category>
		<category><![CDATA[class imbalance]]></category>
		<category><![CDATA[clinical data]]></category>
		<category><![CDATA[clinical decision support tools]]></category>
		<category><![CDATA[cross-validation]]></category>
		<category><![CDATA[Diagnostic Accuracy Improvement]]></category>
		<category><![CDATA[diagnostic screening]]></category>
		<category><![CDATA[early detection of liver disease]]></category>
		<category><![CDATA[feature selection]]></category>
		<category><![CDATA[healthcare data stability]]></category>
		<category><![CDATA[hepatitis C]]></category>
		<category><![CDATA[Hepatitis C diagnosis]]></category>
		<category><![CDATA[infectious disease modeling]]></category>
		<category><![CDATA[LightGBM]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[machine learning in healthcare]]></category>
		<category><![CDATA[methodological benchmarking in machine learning]]></category>
		<category><![CDATA[public health hepatitis C screening]]></category>
		<category><![CDATA[Random Forest]]></category>
		<category><![CDATA[routine laboratory data]]></category>
		<category><![CDATA[SMOTE]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=244225</guid>

					<description><![CDATA[A benchmarking study in BMC Infectious Diseases shows that data balancing, feature selection, and hyperparameter tuning make machine learning models markedly more reliable for diagnosing hepatitis C from routine blood tests.]]></description>
										<content:encoded><![CDATA[<p>Hepatitis C virus (HCV) infection remains one of the most insidious public health challenges of our time, precisely because it so often announces itself silently. The virus can smolder in the liver for years, progressively damaging tissue, before a patient experiences any symptoms at all. By the time fatigue, jaundice, or abdominal discomfort appear, significant and sometimes irreversible liver damage may already have occurred. Early detection is therefore not merely convenient but decisive: identifying infection before cirrhosis or hepatocellular carcinoma develops allows antiviral therapy to cure the vast majority of patients and interrupts onward transmission. Yet in many clinical settings, particularly where access to molecular testing is limited, diagnosis still depends on interpreting routine laboratory measurements, a task vulnerable to human inconsistency and to the statistical quirks of the data itself.</p>
<p>A new study published in BMC Infectious Diseases tackles this problem head-on, presenting a methodological benchmarking framework designed to make machine learning classifiers for HCV detection both more accurate and, crucially, more stable. Led by Muhammad Uzair Khan of the University of Engineering and Technology in Mardan, Pakistan, together with colleagues at institutions including Princess Nourah bint Abdulrahman University in Riyadh, the work does not claim a novel algorithm. Instead, its contribution lies in rigor: the authors systematically evaluated how standard classifiers behave when the messy realities of clinical data, class imbalance, outliers, and redundant features, are properly addressed before a model is ever trained. The result is a reproducible baseline methodology that future computer-aided screening studies can build upon.</p>
<p>The starting point was a public benchmark dataset of routine biochemical attributes, the kind of measurements any clinical laboratory can produce: liver enzymes and related blood parameters that shift characteristically when the liver is under viral attack. Using such data offers an attractive diagnostic pathway, because it avoids the cost and infrastructure demands of polymerase chain reaction confirmation at the first screening step. But it also carries well-known statistical hazards. In real-world cohorts, infected patients typically form a minority, meaning a naive classifier can achieve deceptively high accuracy simply by predicting that everyone is healthy. Outliers, whether from laboratory error or genuine physiological extremes, can further skew model training, and correlated or irrelevant features can obscure the signal that actually matters.</p>
<p>To confront these hazards, the researchers built their pipeline in three deliberate stages. First, they addressed class imbalance using data balancing techniques, a step reflected in their keyword list by the widely used SMOTE approach, which synthesizes new examples of the minority class rather than simply duplicating existing ones. Second, they applied a decision tree-based recursive feature elimination procedure, an embedded feature selection method that iteratively trains a tree ensemble, ranks predictors by importance, and discards the least informative ones. This retains only the necessary predictors, reducing noise and the risk of overfitting while keeping the final model interpretable enough for clinicians to understand which laboratory values drive a prediction. Third, they tuned the hyperparameters of each candidate model before any testing, ensuring that no classifier was handicapped by default settings.</p>
<p>With this framework in place, the team trained and evaluated a broad roster of machine learning classifiers under a single, consistent experimental protocol: k-nearest neighbors, support vector machine, logistic regression, random forest, naive Bayes, gradient boosting, extreme gradient boosting, and LightGBM. This breadth matters. Many published diagnostic studies showcase a single favored algorithm, leaving readers unable to judge whether its reported performance reflects genuine superiority or merely favorable tuning. By holding preprocessing, feature selection, and evaluation constant across all eight models, the benchmarking design isolates the true differences between learning algorithms and reveals which families of methods are inherently suited to this kind of tabular clinical data.</p>
<p>The headline result came from the random forest classifier. On an independent test cohort, data the model had never seen during training, it achieved 98.38 percent accuracy, a perfect 100 percent precision, and an F1-score of 93.02 percent. In diagnostic terms, perfect precision means that every patient the model flagged as HCV-positive genuinely was infected, an especially valuable property in a screening context where false alarms trigger unnecessary confirmatory testing and patient anxiety. The F1-score, which harmonizes precision and recall into a single figure, indicates that the model maintained this discipline without sacrificing its ability to catch the majority of true infections. Ensemble methods such as random forest are well suited to this task because they aggregate hundreds of decision trees trained on random subsets of the data, averaging away individual errors and resisting the influence of outliers.</p>
<p>Accuracy on a single test split, however, can be a statistical mirage, and the authors were careful not to rest on it. They therefore subjected every model to a stratified 5-fold cross-validation protocol, in which the dataset is partitioned into five folds, each fold serving once as the validation set while the remaining four train the model. Stratification preserves the class balance within every fold, so each validation round mirrors the original disease prevalence. Under this more demanding test, LightGBM, a gradient boosting framework that builds trees leaf-wise for efficiency, delivered the top mean accuracy of 95.77 plus or minus 1.45 percent, with an area under the receiver operating characteristic curve of 0.97 plus or minus 0.02. The small standard deviations are as significant as the means: they demonstrate that performance did not fluctuate wildly depending on which patients happened to land in each fold, a hallmark of genuine generalizability.</p>
<p>Notably, the simpler linear and margin-based models also held their own. Support vector machine and logistic regression classifiers showed stable and competitive results across the cross-validation protocol, suggesting that once the data are properly balanced and the feature space pruned, the HCV signal in routine biochemical measurements is strong enough that even classical methods capture it reliably. This is an encouraging finding for resource-constrained health systems, because logistic regression in particular is transparent, fast, and easy to deploy within existing hospital information systems. The comparison also underscores a recurring lesson in clinical machine learning: thoughtful data engineering often matters more than algorithmic novelty, and the most sophisticated model is not always the most dependable one.</p>
<p>When the authors set their results against previous studies in the literature, the improvements were concrete rather than cosmetic. The proposed models showed enhanced diagnostic sensitivity and stronger overall robustness, particularly in how they handled data imbalance and outliers, the two factors that most often cause published diagnostic models to collapse when moved from a curated dataset to real clinical conditions. Sensitivity, the proportion of true infections correctly identified, is the metric that matters most in screening, since a missed case is a patient who may progress to advanced liver disease. The benchmarking framework&#8217;s insistence on balancing and validation directly targets this vulnerability, and the cross-verified AUC approaching 0.97 indicates an excellent separation between infected and uninfected profiles across the full range of decision thresholds.</p>
<p>The study, published open access on 7 October 2026 and supported by the Princess Nourah bint Abdulrahman University Researchers Supporting Project, used fully anonymized secondary data from the public UCI Machine Learning Repository, so no individual patient consent was required. Its conclusions are measured but consequential: integrating structured data balancing, principled feature elimination, and careful hyperparameter tuning significantly stabilizes classifier performance on routine laboratory data. For clinicians, the work points toward a future in which a standard blood panel, interpreted by a validated algorithm, could flag probable HCV infection at the first point of contact, directing patients promptly to confirmatory testing and curative antiviral therapy. For researchers, it establishes a reliable baseline methodology, a reminder that in the race toward computer-aided diagnosis, the discipline of the pipeline is what turns a promising accuracy figure into a tool a clinic can actually trust.</p>
<p><strong>Subject of Research:</strong> Machine learning benchmarking for hepatitis C virus diagnosis from routine biochemical data</p>
<p><strong>Article Title:</strong> Enhancing the performance of machine learning models for the reliable diagnosis of hepatitis C virus</p>
<p><strong>Article References:</strong> Khan, M. U., Muhammad, F., Khan, J., Awan, D., Khan, S., Idrees, F., &amp; Al-Rasheed, A. (2026). Enhancing the performance of machine learning models for the reliable diagnosis of hepatitis C virus. <em>BMC Infectious Diseases</em>. <a href="https://doi.org/10.1186/s12879-026-14179-5" rel="noopener noreferrer">https://doi.org/10.1186/s12879-026-14179-5</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1186/s12879-026-14179-5" rel="noopener noreferrer">10.1186/s12879-026-14179-5</a></p>
<p><strong>Keywords:</strong> hepatitis C, machine learning, random forest, LightGBM, SMOTE, class imbalance, feature selection, cross-validation, diagnostic screening, clinical data, BMC Infectious Diseases, artificial intelligence</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">244225</post-id>	</item>
		<item>
		<title>Widely Used Data-Cleaning Step in Chronic Disease AI Fails Rigorous Testing</title>
		<link>https://scienmag.com/widely-used-data-cleaning-step-in-chronic-disease-ai-fails-rigorous-testing/</link>
		
		<dc:creator><![CDATA[Denise Maddox]]></dc:creator>
		<pubDate>Thu, 01 Oct 2026 12:18:20 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[best practices for data preparation in healthcare AI]]></category>
		<category><![CDATA[chronic disease data cleaning]]></category>
		<category><![CDATA[chronic disease prediction]]></category>
		<category><![CDATA[class imbalance]]></category>
		<category><![CDATA[clinical data]]></category>
		<category><![CDATA[cross-validation]]></category>
		<category><![CDATA[data leakage]]></category>
		<category><![CDATA[data leakage in clinical machine learning]]></category>
		<category><![CDATA[DBSCAN]]></category>
		<category><![CDATA[density-based clustering]]></category>
		<category><![CDATA[effects of resampling techniques like SMOTE-ENN on model accuracy]]></category>
		<category><![CDATA[evaluation of outlier removal methods in health data]]></category>
		<category><![CDATA[impact of data preprocessing on disease prediction models]]></category>
		<category><![CDATA[influence of data leakage on reported machine learning performance]]></category>
		<category><![CDATA[limitations of common]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[machine learning bias in healthcare]]></category>
		<category><![CDATA[outlier detection]]></category>
		<category><![CDATA[outlier detection in medical datasets]]></category>
		<category><![CDATA[pitfalls of standard data cleaning steps in chronic disease prediction]]></category>
		<category><![CDATA[reproducibility]]></category>
		<category><![CDATA[rigorous testing of clinical data preprocessing pipelines]]></category>
		<category><![CDATA[SMOTE]]></category>
		<category><![CDATA[YadroSeg]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=222606</guid>

					<description><![CDATA[A leakage-free benchmark of ten chronic-disease cohorts finds that no outlier-removal method beats doing nothing, while data-cleaning steps silently delete rare patients and inflated evaluation protocols manufacture up to 61 points of phantom accuracy.]]></description>
										<content:encoded><![CDATA[<p>Machine-learning pipelines that predict diabetes, hypertension, chronic kidney disease and heart disease from routine clinical records often begin with a seductive idea: delete the outliers, balance the classes, and the classifier will see the signal more clearly. A new study in Results in Engineering puts that idea under the microscope and finds it wanting. In a leakage-free benchmark spanning ten public chronic-disease cohorts, twelve outlier detectors, and 6,500 per-fold evaluation records, researchers Rifkat R. Davronov and Fatima T. Adilova report that not one cleaning method significantly outperformed simply doing nothing at all. Worse, the cleaning step preferentially deletes exactly the patients a screening model exists to find.</p>
<p>The paper&#8217;s most striking number concerns how these pipelines have been measured, not how they perform. When feature selection, scaling, outlier removal and the popular SMOTE-ENN resampling technique are all fitted on the full dataset before cross-validation — a practice the authors trace through much of the published literature — reported F1 scores are inflated by an average of 28.9 percentage points, with a range from 0.4 to 61.2 points depending on the cohort. The dominant culprit is resampling before splitting: SMOTE synthesises new minority-class points by interpolating between existing ones, so a test-fold patient can become a near-duplicate of training data, while the accompanying Edited Nearest Neighbours rule deletes borderline majority records using their labels. The evaluation, in effect, grades the model on questions it has already seen.</p>
<p>The inflation is largest precisely where the underlying task is hardest. On a small hypertension cohort of 175 patients, where blood pressure is essentially unpredictable from anthropometric measurements alone, the flawed protocol reports an F1 of 93.75 percent; the corrected protocol yields 35.5 percent, with the area under the ROC curve hovering near chance. On an easy, well-posed chronic kidney disease diagnosis task, the difference between protocols is a mere 0.4 points. Leakage, the authors conclude, does not add a constant bonus — it manufactures performance in proportion to how little genuine signal exists, which is why mid-to-high-nineties accuracy figures on small clinical cohorts deserve deep suspicion.</p>
<p>Under the corrected protocol, with every fitted step confined inside the training fold, the benchmark&#8217;s verdict on outlier removal is unambiguous. Twelve detectors — including tuned DBSCAN, Local Outlier Factor, Isolation Forest, One-Class SVM, robust covariance estimation, HDBSCAN, and the recent distribution-based methods ECOD and COPOD — were compared against a no-cleaning control over 50 folds per cell, using the Nadeau–Bengio corrected resampled t-test with Holm adjustment to account for overlapping training sets. Across all 130 method-by-cohort cells, no detector significantly beat the control. The single statistically significant result in either direction was a loss: HDBSCAN on the diabetic retinopathy cohort, dropping F1 by 9.37 points.</p>
<p>The authors did not merely tune their own detectors carefully and declare victory. To test the objection that poor configuration explains the null result, they granted an oracle: for each cohort, the best of 44 parameter settings of their proposed method was selected with hindsight on the very folds being reported. Even this impossible advantage yielded a mean gain of only 1.24 points — less than the 3.20 points that picking the best of 44 genuinely equivalent settings would produce from fold-to-fold noise alone. On two cohorts, the oracle&#8217;s chosen configuration removed nothing whatsoever. Across all 440 evaluated configurations, F1 correlated negatively with the fraction of data removed on seven of nine informative cohorts, as strongly as r = −0.99. Within this family of methods, removing more is monotonically worse.</p>
<p>If cleaning were merely useless, it would be a wasted step. The study&#8217;s forensic analysis shows it is actively hazardous. Every detector examined removes minority-class records preferentially — the proposed YadroSeg method deleted 32.8 percent of minority-class patients against 18.5 percent of majority-class records, a pattern significant on 8 of 10 cohorts, while Isolation Forest showed the most extreme ratio at 4.4 to 1. Triaging the deleted rows against physiological ranges, only about 15 percent contained impossible values that could be called genuine data errors; roughly 63 percent were rare but clinically plausible patients. The mechanism is not a defect in any particular algorithm: removal correlates strongly with local sparsity in feature space (r between 0.43 and 0.69) and barely at all with label impurity. Density-based detectors find sparse regions, and in clinical data sparse regions are populated by uncommon patients, not corrupted records.</p>
<p>The study is also a remarkable act of scientific self-correction. An earlier version of this work reported that its graph-based detector, YadroSeg, achieved the best F1 on three of five datasets, reaching 98.87 percent — a figure produced by the very leakage the revised paper dissects. The same configuration scores 100.00 under the flawed protocol and 58.51 under the corrected one. The authors pre-registered a series of tests to understand why their density-variation analysis, adapted from image segmentation, failed to transfer to tabular data, and report that two of their own registered explanations were refuted by the experiments designed to check them. The final finding is structural: driving the coring threshold until no core vertex survives leaves the set of removed records bit-identical on all ten cohorts, because the density sequence over a constructed clinical feature graph lacks the small set of dominant boundaries that thresholding presupposes.</p>
<p>What survives the transfer is the density ordering itself. When exposed as a continuous score rather than collapsed into a threshold, the peeling sequence recovered injected corruption better than the published algorithm on ten of ten cohorts, ranking second of nine scorers behind LOF. Measuring this honestly required the authors to correct their own evaluation a second time: their initial comparison scored detectors on the arbitrary masks they emitted, at flag rates differing by more than an order of magnitude. At a matched flag budget, every detector tested ranked corrupted records two to three times above chance — though none exceeded a detection F1 of 0.275, confirming that none of them is a reliable corruption detector, particularly for flipped labels, which leave a record exactly where it was in feature space.</p>
<p>The corrected implementation also brings a scalability lesson. The original formulation required a dense distance matrix that scaled as N to the power 2.67 and became infeasible beyond 32,000 records; the revised version, using radius queries on a spatial index, measures at N to the power 1.48 — competitive with DBSCAN and LOF, though an order of magnitude behind Isolation Forest&#8217;s effectively flat profile. The authors withdraw their earlier claim of O(N log N) scaling as unsupported by measurement, and confirm the exponents on two real clinical registries of over 100,000 and 250,000 records. A large-cohort confirmation arm on those registries, reaching nearly nine times the sample size of the largest primary cohort, reproduced the central null: cleaning never helped, and where differences reached significance they ran against it.</p>
<p>The practical recommendations are pointed. Every fitted preprocessing step should live inside the cross-validation loop, ideally enforced structurally through pipeline tools rather than manual sequencing. Any study adopting outlier removal should include a no-cleaning control and report the class composition of what it deletes. Calibration should be reported alongside discrimination, since resampling is known to damage probability calibration — a property the study observed across all configurations. And for reviewers, the single most informative check on a paper using the cleaning-plus-resampling-plus-ensemble template is whether the resampler is fitted inside or outside the validation loop. On the balance of evidence, the authors recommend against routine density-based outlier removal in clinical tabular prediction: a measurable risk of discarding rare patients, with no measurable benefit in return.</p>
<p><strong>Subject of Research:</strong> Evaluation leakage and outlier removal in machine-learning prediction of chronic diseases from clinical tabular data</p>
<p><strong>Article Title:</strong> Graph-based density-variation outlier removal for chronic disease prediction: A leakage-free benchmark and component-wise ablation</p>
<p><strong>Article References:</strong> Davronov, R. R., &amp; Adilova, F. T. (2026). Graph-based density-variation outlier removal for chronic disease prediction: A leakage-free benchmark and component-wise ablation. <em>Results in Engineering, 32</em>, Article 112842. <a href="https://doi.org/10.1016/j.rineng.2026.112842" rel="noopener noreferrer">https://doi.org/10.1016/j.rineng.2026.112842</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1016/j.rineng.2026.112842" rel="noopener noreferrer">10.1016/j.rineng.2026.112842</a></p>
<p><strong>Keywords:</strong> machine learning, outlier detection, data leakage, chronic disease prediction, SMOTE, class imbalance, DBSCAN, clinical data, cross-validation, YadroSeg, reproducibility, density-based clustering</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">222606</post-id>	</item>
	</channel>
</rss>
