<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>diagnostic validation &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/diagnostic-validation/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Tue, 06 Oct 2026 01:11:18 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>diagnostic validation &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>Smartwatch Sleep Apnea Detection Shows Promise but Faces Clinical Hurdles</title>
		<link>https://scienmag.com/smartwatch-sleep-apnea-detection-shows-promise-but-faces-clinical-hurdles/</link>
		
		<dc:creator><![CDATA[Ophelia Keating]]></dc:creator>
		<pubDate>Tue, 06 Oct 2026 01:11:18 +0000</pubDate>
				<category><![CDATA[Medicine]]></category>
		<category><![CDATA[challenges in clinical validation of wearable sleep monitors]]></category>
		<category><![CDATA[clinical hurdles in wearable sleep disorder diagnosis]]></category>
		<category><![CDATA[consumer smartwatch health monitoring]]></category>
		<category><![CDATA[continuous sleep health assessment]]></category>
		<category><![CDATA[diagnostic validation]]></category>
		<category><![CDATA[FDA clearance]]></category>
		<category><![CDATA[FDA clearance for sleep apnea devices]]></category>
		<category><![CDATA[hypoxic burden]]></category>
		<category><![CDATA[limitations of current wearable sleep diagnostics]]></category>
		<category><![CDATA[obstructive sleep apnea]]></category>
		<category><![CDATA[oximetry]]></category>
		<category><![CDATA[photoplethysmography]]></category>
		<category><![CDATA[photoplethysmography in sleep tracking]]></category>
		<category><![CDATA[polysomnography]]></category>
		<category><![CDATA[role of heart rate tracking in sleep disorder detection]]></category>
		<category><![CDATA[screening]]></category>
		<category><![CDATA[skin pigmentation]]></category>
		<category><![CDATA[sleep apnea detection]]></category>
		<category><![CDATA[sleep apnea monitoring technology advancements]]></category>
		<category><![CDATA[sleep medicine]]></category>
		<category><![CDATA[smartphone-based obstructive sleep apnea detection]]></category>
		<category><![CDATA[smartwatch]]></category>
		<category><![CDATA[wearable sleep disorder diagnostics]]></category>
		<category><![CDATA[wearable technology]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=239806</guid>

					<description><![CDATA[A rigorous validation study of the FDA-cleared Samsung Galaxy Watch shows strong detection of high-risk sleep apnea but reveals specificity, data quality, and population limitations that keep it short of standalone clinical use.]]></description>
										<content:encoded><![CDATA[<p>For decades, the diagnosis of obstructive sleep apnea has required a night wired to electrodes in a sleep laboratory, or at best a home testing kit that many patients never return. Now a consumer smartwatch has formally entered that territory. A new validation study published in the Journal of Clinical Sleep Medicine examined the Samsung Galaxy Watch, which recently received clearance from the US Food and Drug Administration to detect moderate to severe obstructive sleep apnea over a two-night monitoring period. The device relies on photoplethysmography, heart rate tracking, and proprietary sleep pattern information to generate an estimated apnea-hypopnea index, a number that approximates how frequently a sleeper&#8217;s breathing is disrupted. A companion commentary by sleep physicians Rami N. Khayat and Matthew S. Floyd of Pennsylvania State University argues that the study offers a reasonable roadmap for evaluating wearable diagnostics, while cautioning that the technology is not yet ready to stand alone in clinical practice.</p>
<p>The significance of the moment is hard to overstate. Sleep is a quantifiable and clinically rich physiological state, making it a natural target for continuous health monitoring ever since wrist-worn actigraphy was first introduced by Kripke and colleagues in 1978. Yet while wearable hardware has evolved at a breakneck pace, the standards for validating these technologies have lagged far behind. Experts have increasingly called for formal guidelines governing how consumer devices that deliver diagnostic assessments and medical advice should be tested. Adoption, meanwhile, has already crossed a tipping point: more than 40 percent of US adults now use wearable devices. As photoplethysmography and oximetry sensors mature, these gadgets are no longer merely counting steps but making claims once reserved for medical equipment.</p>
<p>The study by Alavi and colleagues put the Galaxy Watch through an unusually rigorous test. The investigators enrolled 147 participants and gathered data on two separate nights, comparing the watch&#8217;s estimated apnea-hypopnea index against full in-lab polysomnography, the gold standard for sleep apnea diagnosis. The two monitored nights were separated by four to ten nights of at-home recording, a design that aligned directly with the FDA-cleared two-night decision framework while also capturing the natural night-to-night variability of the disorder. The researchers benchmarked the watch not only against conventional respiratory event frequency metrics but also against hypoxic burden, an emerging measure of the cumulative oxygen deprivation a patient experiences during sleep.</p>
<p>The headline numbers are striking. Against the polysomnography-derived apnea-hypopnea index scored at a 4 percent oxygen desaturation threshold, the watch&#8217;s estimate achieved an area under the receiver operating characteristic curve of 0.94, with a correlation of 0.87, its strongest diagnostic performance. Even more impressive, among participants classified into the high-risk hypoxic burden stratum, the algorithm achieved 100 percent sensitivity and 100 percent specificity. This suggests that optical photoplethysmography and wrist oximetry are especially discriminative when the cumulative hypoxemic stimulus is large. The performance profile aligns with a hypoxia-based screening approach and hints at reduced discriminatory power for milder disease, where arousals rather than oxygen drops dominate the pathology.</p>
<p>Equally notable was the study&#8217;s attention to a well-known weakness of optical sensing: skin pigmentation. Pulse oximeters measure light absorption through tissue, and darker skin tones have historically degraded their accuracy. The investigators conducted structured subgroup analyses across sex, body mass index, age, ethnicity, and objectively measured skin pigmentation. They found consistent sensitivity above 91 percent and consistent specificity across darker skin tones, addressing a vulnerability that has plagued optical pulse oximetry for generations and that regulators have scrutinized intensely in recent years.</p>
<p>But the commentary authors identify serious caveats that temper the enthusiasm. The study population was enriched for individuals with either a prior diagnosis of moderate-to-severe obstructive sleep apnea or a high pre-test probability, defined by a STOP-Bang score of 3 or greater. Of the 147 participants who completed both laboratory nights, 97 had moderate-to-severe sleep apnea on both nights, while only 29 had an apnea-hypopnea index below 15 on both nights. This spectrum bias artificially inflates positive predictive values, which exceeded 95 percent in the study. In a low-prevalence general screening population, the false positive rate would be substantially higher, a statistical reality that could overwhelm sleep clinics with unnecessary referrals.</p>
<p>The raw performance figures at the manufacturer&#8217;s default threshold tell a more complicated story. At an estimated apnea-hypopnea index cutoff of 15 events per hour, the device showed high sensitivity of 94.1 percent but a notably modest specificity of only 66.7 percent against the 4 percent oxygen desaturation index, and 65.8 percent against the standard apnea-hypopnea index. That figure stands in contrast to the 87.7 percent specificity reported in the FDA De Novo authorization summary. When the investigators shifted the cutoff to a cohort-optimized threshold of 25.95 events per hour, specificity rose to 94.9 percent but sensitivity fell to 82.4 percent. In other words, the device can be tuned to catch most cases or to avoid most false alarms, but not both simultaneously, and clinicians deploying it must understand exactly where that trade-off sits.</p>
<p>Real-world data quality posed another problem. Among the 147 participants who completed both in-lab polysomnography sessions, 57 lacked valid watch data on one or both laboratory nights because of poor signal quality, motion artifact, or inadequate wrist coupling, an invalidation rate of 38.8 percent during attended studies. The researchers supplemented missing data with home recordings for research purposes, but unwitnessed home recordings remain susceptible to unmeasured confounders such as positional therapy, alcohol consumption, sleep fragmentation, or undiagnosed central apnea events. A wearable that fails to produce usable data in nearly four out of ten supervised sessions highlights the ongoing engineering challenge of sensor displacement and optical signal loss in wrist-worn consumer hardware.</p>
<p>The study also excluded patients with significant cardiac disease, chronic pulmonary disease, movement disorders, and comorbid sleep disorders. These are precisely the comorbid conditions that are common among patients referred for sleep evaluation, meaning the algorithm&#8217;s performance in multimorbid populations remains unproven. The US Preventive Services Task Force, moreover, does not currently support screening for obstructive sleep apnea in the absence of symptoms, citing insufficient evidence of screening accuracy and inconsistent evidence on health outcomes. Any wearable-based screening program would therefore operate in a gray zone of preventive medicine, generating findings that guidelines do not yet know how to handle.</p>
<p>The practical implications for clinicians are concrete. Used as a sole screening tool at the default 15 events per hour threshold, the watch would generate a significant number of false positives, burdening downstream sleep clinic resources and confirmatory diagnostic pathways. Confirmatory testing with polysomnography or home sleep apnea testing would still be required before initiating therapy. Yet the commentary authors see genuine value in the device&#8217;s ability to identify high-risk individuals with significant hypoxic burden, positioning it as an accessible triage entry point rather than a diagnostic endpoint. In their view, the work by Alavi and colleagues provides a reasonable roadmap for validating emerging wearable devices and algorithms, and industry&#8217;s willingness to seek FDA approval for clinical claims is itself an encouraging development. Deployment, they conclude, would still require careful appraisal of positive and negative predictive values within each specific population and clinical setting. The smartwatch has crossed a threshold, but it has not yet arrived at its destination.</p>
<p><strong>Subject of Research:</strong> Validation of a consumer smartwatch algorithm for detecting moderate-to-severe obstructive sleep apnea</p>
<p><strong>Article Title:</strong> A smart watch crosses the threshold into clinical practice—or not quite yet?</p>
<p><strong>Article References:</strong> Khayat, R. N., &amp; Floyd, M. S. (2026). A smart watch crosses the threshold into clinical practice—or not quite yet?. <em>Journal of Clinical Sleep Medicine, 22</em>(1), Article 181. <a href="https://doi.org/10.1007/s44470-026-00195-4" rel="noopener noreferrer">https://doi.org/10.1007/s44470-026-00195-4</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s44470-026-00195-4" rel="noopener noreferrer">10.1007/s44470-026-00195-4</a></p>
<p><strong>Keywords:</strong> wearable technology, obstructive sleep apnea, smartwatch, photoplethysmography, sleep medicine, FDA clearance, hypoxic burden, polysomnography, diagnostic validation, screening, oximetry, skin pigmentation</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">239806</post-id>	</item>
		<item>
		<title>Colorimetric LAMP Test Matches PCR for Rapid Mpox Detection in Clinical Validation</title>
		<link>https://scienmag.com/colorimetric-lamp-test-matches-pcr-for-rapid-mpox-detection-in-clinical-validation/</link>
		
		<dc:creator><![CDATA[Ophelia Keating]]></dc:creator>
		<pubDate>Tue, 22 Sep 2026 13:19:29 +0000</pubDate>
				<category><![CDATA[Medicine]]></category>
		<category><![CDATA[B6R gene]]></category>
		<category><![CDATA[clinical validation of mpox tests]]></category>
		<category><![CDATA[colorimetric detection]]></category>
		<category><![CDATA[colorimetric LAMP assay]]></category>
		<category><![CDATA[decentralized mpox detection]]></category>
		<category><![CDATA[diagnostic validation]]></category>
		<category><![CDATA[F3L gene]]></category>
		<category><![CDATA[ICMR-NIV]]></category>
		<category><![CDATA[isothermal amplification]]></category>
		<category><![CDATA[isothermal amplification methods]]></category>
		<category><![CDATA[LAMP assay]]></category>
		<category><![CDATA[molecular diagnostics for mpox]]></category>
		<category><![CDATA[molecular testing in global health]]></category>
		<category><![CDATA[monkeypox virus]]></category>
		<category><![CDATA[mpox]]></category>
		<category><![CDATA[mpox detection]]></category>
		<category><![CDATA[orthopoxvirus]]></category>
		<category><![CDATA[outbreak response testing]]></category>
		<category><![CDATA[PCR vs LAMP for monkeypox]]></category>
		<category><![CDATA[point-of-care mpox testing]]></category>
		<category><![CDATA[point-of-care testing]]></category>
		<category><![CDATA[qPCR]]></category>
		<category><![CDATA[rapid mpox diagnosis]]></category>
		<category><![CDATA[resource-limited laboratory testing]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=205219</guid>

					<description><![CDATA[Researchers at ICMR-NIV in India have developed and clinically validated a colorimetric LAMP assay that matched qPCR with 100 percent agreement for rapid mpox detection.]]></description>
										<content:encoded><![CDATA[<p>Monkeypox virus, now officially known as mpox, has evolved from a largely regional public health problem in Central and West Africa into a sustained global concern. Since the unprecedented multi-country outbreak of 2022, which prompted the World Health Organization to declare a public health emergency of international concern, transmission has been documented in more than 130 countries. According to the World Health Organization, 52,845 confirmed mpox cases and 215 associated deaths were reported globally during 2025 alone, affecting 98 countries, with active transmission persisting particularly in several African nations. Against this backdrop, researchers at the ICMR-National Institute of Virology in Pune, India, have developed and clinically validated a colorimetric isothermal amplification assay that promises to bring rapid, accurate mpox diagnosis to laboratories that lack the sophisticated infrastructure demanded by conventional molecular testing.</p>
<p>The reference method for mpox diagnosis remains real-time quantitative polymerase chain reaction, or qPCR, which offers high sensitivity and specificity. However, qPCR depends on expensive thermocycling instruments, trained personnel, and biosafety-compliant laboratory facilities, all of which limit its accessibility in decentralized laboratories, outbreak settings, and resource-limited regions. Alternative molecular approaches such as restriction fragment length polymorphism analysis and next-generation sequencing are either labor-intensive, costly, or unsuitable for rapid frontline diagnostics. The World Health Organization has repeatedly emphasized the expansion of laboratory diagnostic capacity and the deployment of rapid, reliable, and accessible assays as a core component of its global mpox preparedness and response strategy, creating an urgent need for tools that can operate outside centralized reference laboratories.</p>
<p>The new assay, described in a study published in New Microbes and New Infections, is built on loop-mediated isothermal amplification, commonly known as LAMP. This nucleic acid amplification technique operates under constant-temperature conditions and enables rapid DNA amplification using a set of primers that recognize multiple regions of the target genome. LAMP-based assays require substantially less equipment than qPCR, offer shorter turnaround times, and allow visual interpretation of results. In the colorimetric format used by the Indian team, amplification is read out through a pH-sensitive dye: the reaction mixture starts pink under alkaline conditions and turns yellow when amplification succeeds, a transition that can be judged by eye without any specialized instrumentation.</p>
<p>To design the assay, the researchers retrieved complete and partial genomic sequences of monkeypox virus and other representative orthopoxviruses, including Vaccinia, Variola, Buffalopox, and Camelpox viruses, from the NCBI Virus database. Multiple sequence alignments were analyzed to identify conserved genomic regions suitable for isothermal amplification. Candidate genes evaluated included H2R, encoding a putative viral transmembrane protein; B6R, encoding an envelope protein; F3L, encoding a double-stranded RNA-binding protein; and F8L, encoding DNA polymerase. After preliminary analytical sensitivity testing and temperature optimization, primer sets targeting the orthopoxvirus genus-specific B6R gene and the monkeypox virus species-specific F3L gene were selected for full assay development. Primers were designed with PrimerExplorer V5, optimized for GC contents of approximately 50 to 60 percent, compatible melting temperatures, and minimal secondary structure or primer-dimer formation.</p>
<p>A defining feature of the assay is its dual-target architecture, which incorporates an internal control targeting the human beta-actin gene to verify sample integrity and amplification suitability. Under the predefined interpretation criteria, a specimen is classified as mpox-positive only if both the genus-specific B6R and species-specific F3L reactions yield positive colorimetric results. Specimens that are B6R-positive but F3L-negative are interpreted as non-mpox orthopoxvirus-positive, while specimens negative for both targets are classified as mpox-negative. This design provides two important advantages: reliable identification of monkeypox virus infections and the ability to differentiate mpox from other circulating orthopoxviruses, a capability that is particularly valuable in regions where multiple orthopoxviruses may co-circulate.</p>
<p>Clinical evaluation was performed using a well-characterized panel of 130 specimens obtained retrospectively from suspected mpox cases received for routine diagnostic testing at the Maximum Containment Facility of ICMR-NIV as part of national surveillance activities. The panel comprised 50 mpox-positive and 80 mpox-negative specimens as determined by qPCR, spanning five specimen categories: nasopharyngeal and throat swabs, vesicle swabs, lesion swabs, crust specimens, and lesion fluid specimens. All specimens had previously been tested by real-time qPCR targeting the B6R and F3L genes, which served as the reference standard. Sample processing and nucleic acid extraction were carried out in biosafety level-3 and level-4 containment laboratories in accordance with national biosafety guidelines, and the study received approval from the Institutional Ethics Committee of ICMR-NIV.</p>
<p>The results were striking. The LAMP assay correctly identified all 50 qPCR-positive specimens as positive and all 80 qPCR-negative specimens as negative, achieving complete concordance with the reference method. Sensitivity, specificity, positive predictive value, negative predictive value, and overall percent agreement were each 100 percent, with a Cohen&#8217;s kappa of 1.00 indicating perfect agreement beyond chance. Likelihood ratio analysis yielded a positive likelihood ratio of 160.4 and a negative likelihood ratio of 0.0099, corresponding to a diagnostic odds ratio of approximately 16,261. No discordant results were observed in any specimen category, indicating consistent performance across swabs, crusts, and lesion fluids. Per-target analysis confirmed that both the F3L and B6R assays individually achieved 100 percent sensitivity and 100 percent specificity, underscoring the robustness of the primer design and the dual-target interpretation algorithm.</p>
<p>The assay also demonstrated consistent detection across a broad range of viral loads. Among the 50 qPCR-positive specimens, cycle threshold values ranged from 18.55 to 37.21, with a median of 26.11. The LAMP assay detected every qPCR-positive specimen across this entire range, including the highest Ct specimen evaluated, and maintained 100 percent sensitivity within each Ct category examined, spanning values below 20, between 20 and 25, between 25 and 30, and at or above 30. The authors caution that these Ct-stratified findings should not be interpreted as a formal analytical limit of detection, because quantified monkeypox virus reference material was not available for standardized serial dilution testing. A formal limit of detection assessment will require quantified reference material, replicate testing, and predefined confidence thresholds in future validation studies.</p>
<p>Analytical specificity testing provided further evidence of the assay&#8217;s discriminatory power. A dedicated panel of 64 specimens included samples positive for Vaccinia virus, Buffalopox virus, Herpes simplex virus, and Varicella zoster virus, each represented by 16 specimens. Herpes simplex virus and Varicella zoster virus were included because they are clinically relevant causes of vesicular or pustular lesions that overlap with mpox in the differential diagnosis. As expected, the non-orthopox DNA viruses produced no amplification in either target, while Vaccinia and Buffalopox viruses yielded the characteristic B6R-positive, F3L-negative pattern, confirming that the assay can reliably distinguish monkeypox virus from genetically related orthopoxviruses while showing no cross-reactivity with unrelated viral pathogens.</p>
<p>The study&#8217;s authors note that several LAMP-based assays for mpox detection have been reported previously, but those efforts focused primarily on analytical sensitivity using synthetic templates or limited clinical evaluation sets. In contrast, the present work emphasizes clinical validation using a structured evaluation panel and comprehensive diagnostic accuracy metrics, including likelihood ratios and agreement statistics, in line with current recommendations for reporting diagnostic accuracy studies. The incorporation of uracil-DNA glycosylase in the commercial master mix further guards against carryover contamination, improving reliability in routine diagnostic settings.</p>
<p>Nevertheless, the researchers acknowledge several limitations. The clinical evaluation was retrospective, used archived specimens from a single reference laboratory, and included a limited sample size of 50 positive and 80 negative specimens, so the performance estimates should not be overgeneralized. A formal analytical limit of detection was not determined, the specificity panel did not include all infectious and non-infectious causes of vesiculopustular lesions, and formal reproducibility testing across multiple days, operators, reagent lots, and low-positive specimens was not performed because of limited specimen volume. Future studies incorporating quantified standards, broader specificity panels, multi-site validation, reproducibility assessment, and prospective field evaluations will be needed before wider clinical implementation.</p>
<p>From a public health perspective, the simplicity of the colorimetric LAMP assay, combined with its minimal equipment requirements, rapid turnaround time, and visual readout, makes it a promising tool for expanding mpox diagnostic capacity beyond centralized laboratories. The diagnostic method is covered by an Indian patent application filed in October 2022 and published in April 2024, held by the Indian Council of Medical Research. While qPCR will continue to play a central role in reference and confirmatory testing, the new assay is particularly relevant for outbreak response, surveillance activities, and diagnostic decentralization in resource-limited settings, aligning with recent WHO mpox preparedness and response frameworks. As mpox transmission continues across multiple continents, accessible tools of this kind may prove decisive in closing the diagnostic gap that has long hampered containment efforts.</p>
<p><strong>Subject of Research:</strong> Development and clinical validation of a colorimetric loop-mediated isothermal amplification assay for rapid detection of monkeypox virus</p>
<p><strong>Article Title:</strong> Development and clinical validation of a colorimetric isothermal assay for rapid detection of monkeypox virus</p>
<p><strong>Article References:</strong> Nandi, S. S., Sawant, S. A., Yadav, P., Shete-Aich, A., Majumdar, T. D., Bavkar, K. C., Mukherjee, A., &amp; Deshpande, J. M. (2026). Development and clinical validation of a colorimetric isothermal assay for rapid detection of monkeypox virus. <em>New Microbes and New Infections, 73</em>, Article 101848. <a href="https://doi.org/10.1016/j.nmni.2026.101848" rel="noopener noreferrer">https://doi.org/10.1016/j.nmni.2026.101848</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1016/j.nmni.2026.101848" rel="noopener noreferrer">10.1016/j.nmni.2026.101848</a></p>
<p><strong>Keywords:</strong> mpox, monkeypox virus, LAMP assay, colorimetric detection, isothermal amplification, qPCR, diagnostic validation, orthopoxvirus, B6R gene, F3L gene, ICMR-NIV, point-of-care testing</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">205219</post-id>	</item>
	</channel>
</rss>
