<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>inter-observer agreement &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/inter-observer-agreement/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Sat, 03 Oct 2026 23:40:34 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.2</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>inter-observer agreement &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>Amyloid PET Scans Predict Alzheimer&#8217;s Risk No Matter How Experts Read Them</title>
		<link>https://scienmag.com/amyloid-pet-scans-predict-alzheimers-risk-no-matter-how-experts-read-them/</link>
		
		<dc:creator><![CDATA[Cassandra Pierce]]></dc:creator>
		<pubDate>Sat, 03 Oct 2026 23:40:34 +0000</pubDate>
				<category><![CDATA[Medicine]]></category>
		<category><![CDATA[Alzheimer's disease]]></category>
		<category><![CDATA[Alzheimer's disease prediction]]></category>
		<category><![CDATA[Alzheimer's risk assessment tools]]></category>
		<category><![CDATA[amnestic mild cognitive impairment]]></category>
		<category><![CDATA[amyloid PET]]></category>
		<category><![CDATA[Amyloid PET scan accuracy]]></category>
		<category><![CDATA[Amyloid PET scan clinical validation]]></category>
		<category><![CDATA[Beta-amyloid detection in brain imaging]]></category>
		<category><![CDATA[Biomarkers]]></category>
		<category><![CDATA[Brain imaging in Alzheimer's disease]]></category>
		<category><![CDATA[Cognitive decline early detection]]></category>
		<category><![CDATA[Computer-aided Alzheimer's diagnosis]]></category>
		<category><![CDATA[dementia]]></category>
		<category><![CDATA[inter-observer agreement]]></category>
		<category><![CDATA[Long-term Alzheimer's prognosis]]></category>
		<category><![CDATA[mild cognitive impairment progression]]></category>
		<category><![CDATA[Neuroimaging biomarkers for dementia]]></category>
		<category><![CDATA[nuclear medicine]]></category>
		<category><![CDATA[PET scan interpretation methods]]></category>
		<category><![CDATA[prognosis]]></category>
		<category><![CDATA[reader expertise]]></category>
		<category><![CDATA[SUVR]]></category>
		<category><![CDATA[visual interpretation]]></category>
		<category><![CDATA[z-score maps]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=232410</guid>

					<description><![CDATA[A new eight-year study of 145 memory clinic patients shows that amyloid PET scans reliably predict conversion to Alzheimer's disease whether read visually, with computer assistance, or by quantitative thresholds, though the hardest borderline cases still favor the trained human eye.]]></description>
										<content:encoded><![CDATA[<p>A single brain scan can quietly reveal whether a person with fuzzy memory is standing at the edge of Alzheimer&#8217;s disease, and a new real-world study now shows that the answer holds up no matter how the scan is read. In research published in the European Journal of Nuclear Medicine and Molecular Imaging, a team from Clínica Universidad de Navarra in Pamplona, Spain, followed 145 patients with amnestic mild cognitive impairment for up to eight years and found that a positive amyloid PET scan strongly predicted who would go on to develop Alzheimer&#8217;s dementia, regardless of whether the images were interpreted by expert eyes, with computerized statistical support, or by hard numbers alone.</p>
<p>Amnestic mild cognitive impairment, or aMCI, is widely regarded as the prodromal phase of Alzheimer&#8217;s disease, a stage where memory complaints are measurable but daily function is largely preserved. Not everyone in this stage progresses, however, and clinicians have long sought tools to separate those carrying underlying beta-amyloid pathology from those whose memory problems stem from other causes. Amyloid positron emission tomography answers that question by using fluorine-18-labelled radiotracers that bind to beta-amyloid deposits in the cortex, making the molecular signature of the disease visible in a living brain. Patients whose scans show pathological cortical retention are known to be at substantially higher risk of clinical decline, which is why amyloid PET has become central to diagnosis and, increasingly, to the selection of patients for anti-amyloid therapies.</p>
<p>Yet the way a scan is interpreted has always been a point of debate. Visual reading, the current clinical standard, depends on the trained eye of a nuclear medicine physician comparing grey and white matter contrast against tracer-specific criteria. It is fast and well validated, but it is inherently subjective, and borderline scans with low or intermediate tracer retention can divide even experienced readers. To reduce that subjectivity, imaging platforms now offer semi-quantitative support: standardized uptake value ratios, or SUVRs, that condense tracer signal in composite cortical regions into a single number compared against validated thresholds, and z-score maps that highlight voxels deviating from a normative database of age-matched healthy controls. The updated Appropriate Use Criteria from the Alzheimer&#8217;s Association and the Society of Nuclear Medicine and Molecular Imaging endorse these tools as complements to visual interpretation in selected scenarios, but whether they genuinely improve reproducibility or prognostic power beyond expert reading has remained uncertain.</p>
<p>The Navarra team set out to answer that question directly in a routine memory clinic setting. Between October 2013 and March 2021, they enrolled 145 patients diagnosed with aMCI after comprehensive neurological, neuropsychological, laboratory and MRI workups, excluding anyone over 85, those with depression, abnormal laboratory findings, or alternative brain injuries such as lacunar infarcts. Three different fluorinated amyloid tracers were used in clinical practice: florbetapir in 79 patients, flutemetamol in 46, and florbetaben in 20, all acquired on the same Biograph mCT PET/CT scanner with time-of-flight and point-spread-function reconstruction. Patients were then followed clinically until January 2022, with progression defined by the National Institute on Ageing–Alzheimer&#8217;s Association 2011 criteria for Alzheimer&#8217;s disease dementia.</p>
<p>Two certified nuclear medicine physicians, one with more than 30 years of experience and one with five, independently read every scan twice: first with conventional structured visual interpretation, and then with assistance from the syngo.via MI Neuro Cortical Analysis software, which overlays voxel-wise z-score statistics and SUVR values onto the images. As a third method, scans were classified purely by SUVR thresholds validated in prior literature, above 1.17 for florbetapir, above 1.35 for florbetaben and above 0.60 for flutemetamol. Agreement between and within readers was quantified with Cohen&#8217;s kappa, a statistic in which values above 0.81 conventionally signal excellent agreement.</p>
<p>The reliability results were striking. Inter-observer agreement reached a kappa of 0.877 for structured visual reading and 0.904 for assisted interpretation, while intra-observer consistency between the two approaches was 0.860 for the senior reader and 0.892 for the junior one. When consensus ratings were established with the assisted method, agreement climbed to 0.936, near the statistical ceiling. Reader 1 classified 94 scans as amyloid-positive on visual reading and 101 with assistance; Reader 2 classified 96 and 97 respectively. In other words, experienced readers agreed with themselves and with each other at a level that leaves very little room for chance, confirming that standardized visual interpretation of amyloid PET is far more reproducible than its subjective reputation might suggest.</p>
<p>Reproducibility, however, is only half the story; the real question is whether a positive scan predicts what happens next. Using Cox proportional hazards models adjusted for age, sex and education, the researchers found that amyloid positivity significantly increased the risk of conversion to Alzheimer&#8217;s dementia under all three interpretation methods. Assisted visual interpretation produced the strongest signal: PET-positive patients had a 3.23-fold higher risk of progression than PET-negative patients, with a hazard ratio of 3.23 and a 95 percent confidence interval of 1.94 to 5.38. SUVR quantification yielded a hazard ratio of 2.19, and conventional visual reading, 1.83. Kaplan–Meier survival curves separated significantly between positive and negative groups for every method, with log-rank tests all significant below the 0.001 level. Over the follow-up period, 75 patients converted to Alzheimer&#8217;s dementia, while 41 remained clinically stable.</p>
<p>The most intriguing findings came from the scans where readers disagreed. Eighteen of the 145 studies, 12.4 percent, showed discordance across at least one interpretative condition, and in this small, exploratory subgroup the hierarchy of methods flipped. When clinical progression was used as the pragmatic reference standard, conventional visual reading outperformed assisted interpretation for both readers: the senior reader correctly classified 9 of 18 discordant cases visually versus only 2 with assistance, and SUVR binary classification matched clinical outcome in 11 of 18 cases, the best of all. A detailed re-evaluation showed the disagreements were not random. Most involved florbetapir scans, and cortical atrophy was flagged as a contributing factor in four, while other cases reflected reduced image quality, subtle or borderline tracer uptake, or atypical regional distribution. Disagreement, in short, clustered in technically and biologically challenging images rather than revealing a flaw in either human or machine reading.</p>
<p>The authors are careful to frame these subgroup findings as descriptive rather than definitive, given the small sample, and they acknowledge that the higher hazard ratio for assisted interpretation at the cohort level may seem at odds with its weaker performance on the hardest cases. Their resolution is nuanced: quantitative tools appear to sharpen prognostic stratification across a whole clinic population, likely by nudging borderline calls toward the correct side, but they offer little incremental value for expert readers confronting genuinely ambiguous scans. This mirrors prior multicentre work showing that disagreement in amyloid PET concentrates in scans with low or borderline amyloid burden, and earlier trials demonstrating that trained visual readers detect beta-amyloid pathology with high sensitivity and specificity, including autopsy-validated correlations between florbetapir signal and plaque density.</p>
<p>The implications reach well beyond the reading room. As anti-amyloid immunotherapies move into routine practice, amyloid PET is no longer an academic exercise; it gates treatment decisions and, increasingly, therapeutic monitoring, with a growing trend toward reporting Centiloid values that harmonize quantification across tracers. The product characteristics of all three radiotracers already recommend quantitative analysis as a complement to visual assessment, and this study supports that framework while adding a caution: software overlays and machine-learning classifiers now emerging for automated amyloid classification should be treated as decision-support tools, not replacements for expert oversight, especially when atrophy, motion, or borderline uptake complicate the picture. The study&#8217;s limitations, including the absence of autopsy confirmation, the use of tracer-specific thresholds rather than Centiloid conversion, and a single institutional reconstruction protocol, leave room for refinement. But the core message is clear and reassuring: in the real world, a positive amyloid PET scan in a patient with amnestic mild cognitive impairment is a robust, method-independent warning of Alzheimer&#8217;s disease on the horizon, and the trained human eye remains an indispensable part of reading it.</p>
<p><strong>Subject of Research:</strong> Prognostic value of amyloid PET interpretation methods for predicting Alzheimer&#x27;s disease conversion in amnestic mild cognitive impairment</p>
<p><strong>Article Title:</strong> Prognostic value of Amyloid PET in Real-World Amnestic MCI: Influence of reader experience and interpretation method</p>
<p><strong>Article References:</strong> Echeveste, B., Guillén, E. F., Prieto, E., Hirschmüller, K. C. E., Riverol, M., &amp; Arbizu, J. (2026). Prognostic value of Amyloid PET in Real-World Amnestic MCI: Influence of reader experience and interpretation method. <em>European Journal of Nuclear Medicine and Molecular Imaging</em>. <a href="https://doi.org/10.1007/s00259-026-08159-9" rel="noopener noreferrer">https://doi.org/10.1007/s00259-026-08159-9</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s00259-026-08159-9" rel="noopener noreferrer">10.1007/s00259-026-08159-9</a></p>
<p><strong>Keywords:</strong> Alzheimer&#x27;s disease, amnestic mild cognitive impairment, amyloid PET, visual interpretation, SUVR, z-score maps, inter-observer agreement, reader expertise, prognosis, nuclear medicine, biomarkers, dementia</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">232410</post-id>	</item>
		<item>
		<title>AI Helps Pathologists Count Tumor Cell Divisions Faster and More Consistently in Dogs</title>
		<link>https://scienmag.com/ai-helps-pathologists-count-tumor-cell-divisions-faster-and-more-consistently-in-dogs/</link>
		
		<dc:creator><![CDATA[Nathaniel Bowman]]></dc:creator>
		<pubDate>Fri, 02 Oct 2026 08:33:11 +0000</pubDate>
				<category><![CDATA[Cancer]]></category>
		<category><![CDATA[AI-assisted tumor cell counting]]></category>
		<category><![CDATA[AI-based image analysis in veterinary medicine]]></category>
		<category><![CDATA[Artificial Intelligence]]></category>
		<category><![CDATA[artificial intelligence in veterinary diagnostics]]></category>
		<category><![CDATA[automated tumor grading]]></category>
		<category><![CDATA[canine cancer]]></category>
		<category><![CDATA[canine cancer prognosis]]></category>
		<category><![CDATA[convolutional neural networks]]></category>
		<category><![CDATA[deep learning]]></category>
		<category><![CDATA[deep learning in veterinary oncology]]></category>
		<category><![CDATA[digital pathology]]></category>
		<category><![CDATA[digital pathology for tumor analysis]]></category>
		<category><![CDATA[histopathology]]></category>
		<category><![CDATA[improving consistency in tumor cell enumeration]]></category>
		<category><![CDATA[inter-observer agreement]]></category>
		<category><![CDATA[MIDOG++]]></category>
		<category><![CDATA[mitotic count]]></category>
		<category><![CDATA[mitotic count in soft tissue sarcoma]]></category>
		<category><![CDATA[neural networks for cancer detection]]></category>
		<category><![CDATA[soft-tissue sarcoma]]></category>
		<category><![CDATA[tumor grading]]></category>
		<category><![CDATA[veterinary oncology]]></category>
		<category><![CDATA[veterinary oncology research]]></category>
		<category><![CDATA[veterinary pathology]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=226626</guid>

					<description><![CDATA[A deep learning system called OncoPetNet helped veterinary pathologists detect roughly twice as many mitotic figures in canine soft tissue sarcomas in half the time, significantly improving inter-pathologist agreement on mitotic counts and tumor scores.]]></description>
										<content:encoded><![CDATA[<p>When a dog is diagnosed with a soft tissue sarcoma, one of the most important numbers on the pathology report is the mitotic count: the number of cells caught in the act of dividing within a standardized patch of tumor tissue. That number feeds directly into the tumor&#8217;s grade, which in turn shapes predictions about recurrence, metastasis, and survival. Yet the way that count is produced has long been a weak link. Pathologists must choose where on a slide to look, and then find and identify dividing cells by eye, a process that is slow, subjective, and notoriously variable from one expert to the next. A new study published in Veterinary Oncology suggests that artificial intelligence can close much of that gap, roughly doubling the number of mitotic figures pathologists detect while cutting the time needed to count them in half.</p>
<p>The research team, led by Luke Borst of Antech Diagnostics and collaborators at Mars Petcare Science and Diagnostics, WALTHAM Petcare Science Institute, and Mars digital technology groups, developed and validated a deep learning system called OncoPetNet. The system is an ensemble of three fully convolutional neural networks built on encoder-decoder architectures with skip connections, a design descended from the U-Net family of image segmentation models. Rather than detecting mitotic figures directly as objects, the model frames the problem as segmentation: it predicts a pixel mask marking candidate dividing cells, and deterministic post-processing steps then convert those masks into coordinates. The encoders draw on EfficientNet-b5, EfficientNet-b3, and SE-ResNext backbones pre-trained on ImageNet, allowing the network to leverage general visual features learned from millions of natural images before fine-tuning on tumor histology.</p>
<p>Deploying such a model in a high-volume diagnostic laboratory required more than a clever network. The team built a production pipeline that runs asynchronously on every whole slide image uploaded to the lab. Each slide first passes through a biopsy slide classifier that decides whether mitotic counting is even appropriate. A non-model tissue detection algorithm then maps the foreground tissue and generates coordinates for the mitotic figure detector, which analyzes overlapping tiles across the entire tumor area. Morphological filters sharpen the predicted masks before a k-d tree based algorithm searches all possible placements of a 2.37 square millimeter square and selects the one containing the most mitotic figures. The final output, delivered to pathologists as annotations on the digital slide, includes both the region of interest and circles around each candidate mitosis.</p>
<p>Validation rested on two ground truth datasets. The first comprised 72 soft tissue sarcomas from the lab&#8217;s routine caseload, each confirmed by three pathologists, with consensus expert opinion establishing which AI-flagged candidates were true mitoses. On this dataset, OncoPetNet achieved an F1 score of 0.86, with recall, or sensitivity, reaching 0.97. The second benchmark was the MIDOG++ dataset, a publicly available multi-domain collection built specifically to test how well mitosis-detection models generalize across scanners, stains, laboratories, and tumor types. On 100 canine soft tissue sarcoma images from that set, the model scored an F1 of 0.70, with precision of 0.81 but recall dropping to 0.62. The authors attribute the difference partly to domain shift, since their model was trained on their own scanners and staining protocols, and partly to the low mitotic density of many MIDOG++ images, where a single missed mitosis can crater the score.</p>
<p>With the model validated, the team ran two evaluation studies. The first mimicked routine diagnostics: a single pathologist graded all 72 tumors three ways, manually, with AI assistance, and using AI alone. The results were striking. The AI-only condition averaged 19.9 mitotic figures per case, the AI-assisted condition 14, and the manual condition just 6.26. In other words, AI assistance allowed the pathologist to find about 2.24 times as many mitoses as unaided observation. The pathologist&#8217;s role shifted from exhaustive searching to verification: rejecting false positives, which the model produced more often than false negatives, and adding back any true mitoses the network missed. Human oversight measurably moderated the AI&#8217;s counts, which is precisely the behavior a safety-conscious deployment would want.</p>
<p>Those increased counts rippled through the grading scheme. Mitotic counts are binned into an ordinal MC score from 1 to 3, which is then summed with scores for tumor necrosis and degree of differentiation to produce the final grade. In the first study, AI-assisted scores migrated upward by one level in 29 percent of cases and by two levels in 6 percent compared with manual counts. Tumor grades followed: 18 percent of tumors moved from grade 1 to grade 2, and 7 percent from grade 2 to grade 3. No tumor migrated two full grades, and no tumor moved downward. The second study, in which nine pathologists organized into three cohorts each reviewed 24 cases both manually and with AI assistance, replicated these findings almost exactly. Across 216 paired observations, AI assistance produced an average of 11.6 mitoses versus 5.31 manually, again a roughly 2.2-fold increase, with grade migration of 15.7 percent from grade 1 to 2 and 5.6 percent from grade 2 to 3.</p>
<p>Efficiency gains were equally consistent. Manual counts took an average of 62.8 seconds per case, while AI-assisted counts took 33.7 seconds, nearly a 1.86-fold reduction. In a busy diagnostic laboratory processing thousands of submissions, halving the time spent on one of the most tedious steps in tumor grading represents a substantial operational improvement. Just as importantly, the AI&#8217;s pre-screening of every slide and field relieves pathologists of the cognitive burden of an unhurried, exhaustive search, a practice the authors note is technically required for accuracy but impractical under real-world workloads.</p>
<p>The most consequential findings concern agreement between pathologists. Using intraclass correlation coefficients, the team compared how consistently the nine pathologists rated the same tumors under manual versus AI-assisted conditions. For raw mitotic counts, AI assistance significantly improved agreement in two of the three pathologist trios and overall, lifting the overall coefficient from 0.94 to 0.98. Agreement on MC scores also improved significantly overall. Agreement on which slide to select, measured with Fleiss&#8217; Kappa, rose in all three groups and reached statistical significance in two, reflecting the fact that AI effectively removes the guesswork about where to count. Agreement on final tumor grade showed a consistent upward trend, including a substantial jump in one group from 0.48 to 0.72, but these gains did not reach statistical significance. The authors attribute this dilution to the two remaining subjective parameters, percent necrosis and degree of differentiation, which AI does not yet assess and which continue to drive inter-pathologist variability.</p>
<p>The study&#8217;s authors are careful about what these results do and do not prove. The clinical significance of the higher, more sensitive counts remains unexplored: it is possible that current MC score thresholds, calibrated on imperfect manual counts, should be adjusted upward now that detection is better, or that AI-assisted grades will ultimately predict biological behavior more accurately. Testing that will require studies correlating AI-assisted grades with patient outcomes, ideally including clinical follow-up and necropsy data. Extending the approach to quantify necrosis and differentiation objectively would complete the standardization picture. There are also inherent limits to ground truth itself, since even expert consensus on what constitutes a mitotic figure carries some subjectivity, and immunohistochemical markers like phosphorylated histone H3 introduce their own interpretive complications.</p>
<p>What the study does establish is a working template for human-AI collaboration in diagnostic pathology. The machine does what machines do best, exhaustively scanning every slide and field without fatigue, while the human does what humans do best, exercising judgment to reject imposters such as apoptotic bodies, pyknotic nuclei, and inflammatory cells that mimic mitoses. The result is a count that is more sensitive, faster, and more reproducible than either party achieves alone. For veterinary oncology, where soft tissue sarcomas are among the most common canine tumors and grading decisions directly guide surgery and follow-up, that combination could mark the beginning of a genuine standardization of tumor grading, one algorithm-assisted count at a time.</p>
<p><strong>Subject of Research:</strong> AI-assisted mitotic counting for standardizing histologic grading of canine soft tissue sarcomas</p>
<p><strong>Article Title:</strong> Artificial intelligence-assisted mitotic counts improve efficiency, accuracy, and inter-pathologist agreement: a method toward canine soft tissue sarcoma grade standardization</p>
<p><strong>Article References:</strong> Borst, L., Bacmeister, C., Yau, W., Aceino, A., Ranck, R., Labelle, P., Ehrensing, G., Oliveira, F., Myers, C., Willcox, J. L., Ellerby, Z., Haydock, R., Taylor, K., Parkinson, M., Fitzke, M., &amp; Gerdin, J. (2025). Artificial intelligence-assisted mitotic counts improve efficiency, accuracy, and inter-pathologist agreement: a method toward canine soft tissue sarcoma grade standardization. <em>Veterinary Oncology, 2</em>(1), Article 19. <a href="https://doi.org/10.1186/s44356-025-00034-3" rel="noopener noreferrer">https://doi.org/10.1186/s44356-025-00034-3</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1186/s44356-025-00034-3" rel="noopener noreferrer">10.1186/s44356-025-00034-3</a></p>
<p><strong>Keywords:</strong> artificial intelligence, deep learning, veterinary oncology, soft tissue sarcoma, mitotic count, tumor grading, digital pathology, inter-observer agreement, canine cancer, convolutional neural networks, histopathology, MIDOG++</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">226626</post-id>	</item>
	</channel>
</rss>
