<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>quality assessment &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/quality-assessment/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Thu, 22 Oct 2026 00:16:15 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>quality assessment &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>Structured prompts improve Chinese LLM radiology impressions in retrospective validation</title>
		<link>https://scienmag.com/structured-prompts-improve-chinese-llm-radiology-impressions-in-retrospective-validation/</link>
		
		<dc:creator><![CDATA[Ophelia Keating]]></dc:creator>
		<pubDate>Thu, 22 Oct 2026 00:16:15 +0000</pubDate>
				<category><![CDATA[Medicine]]></category>
		<category><![CDATA[AI prompt engineering for radiology]]></category>
		<category><![CDATA[Chinese AI]]></category>
		<category><![CDATA[Chinese large language models]]></category>
		<category><![CDATA[clinical prioritization in AI-generated reports]]></category>
		<category><![CDATA[diagnostic impressions]]></category>
		<category><![CDATA[evaluation of LLMs in medical imaging]]></category>
		<category><![CDATA[external validation]]></category>
		<category><![CDATA[impact of prompt structure on radiology AI]]></category>
		<category><![CDATA[improving diagnostic correctness with prompts]]></category>
		<category><![CDATA[large language models]]></category>
		<category><![CDATA[liver MRI]]></category>
		<category><![CDATA[liver MRI diagnostic impressions]]></category>
		<category><![CDATA[multi-dimensional quality assessment in radiology]]></category>
		<category><![CDATA[Multidimensional]]></category>
		<category><![CDATA[optimization]]></category>
		<category><![CDATA[prompt]]></category>
		<category><![CDATA[prompt optimization]]></category>
		<category><![CDATA[pulmonary CT]]></category>
		<category><![CDATA[quality assessment]]></category>
		<category><![CDATA[radiology report quality]]></category>
		<category><![CDATA[radiology reports]]></category>
		<category><![CDATA[retrospective validation of LLMs]]></category>
		<category><![CDATA[semantic coherence in radiology reports]]></category>
		<category><![CDATA[structured prompts in medical AI]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=331203</guid>

					<description><![CDATA[A retrospective study found that structured prompts improved several MDQA measures for Chinese LLMs generating diagnostic impressions from liver MRI findings in primary, external-center and pulmonary CT cohorts.]]></description>
										<content:encoded><![CDATA[<p>Structured prompts improved the quality of diagnostic impressions generated from liver MRI findings by four Chinese large language models in a retrospective validation study. The research included 15,127 primary-center liver MRI reports, with additional evaluation in 1,009 liver MRI reports from an external center and 1,692 pulmonary thin-section CT reports. The study measured report-level performance rather than patient outcomes or the models’ ability to replace radiologists.</p>
<p>Investigators supplied imaging findings, while withholding consensus diagnostic conclusions confirmed by two associate-senior or senior radiologists, to Kimi-K2, DeepSeek-V3, ByteDance-Seed-OSS-36B-Instruct and Qwen3-235B-A22B-Instruct-2507. They compared prompts containing only a role definition or basic task instructions with prompts that varied in structure, composition and number of examples. Generated impressions were assessed with a Multi-Dimensional Quality Assessment framework, or MDQA, covering semantic coherence, diagnostic correctness, clinical prioritization alignment, top-1 matching with the reference conclusion and a composite score.</p>
<p>Structured prompts produced better diagnostic correctness, prioritization and overall MDQA scores than role-only or basic task prompts. Increasing the number of examples had a more selective effect, mainly improving semantic coherence and top-1 matching. The highest composite score reported for the primary cohort was 0.7696 for Kimi-K2 with Prompt 11, while DeepSeek-V3 reached 0.7613 with Prompt 10. These are scores under the study’s MDQA framework, not measures of accuracy against individual patient diagnoses.</p>
<p>In the external-center cohort, a locally adapted Prompt 11 V3 achieved the highest MDQA scores for Kimi-K2 and DeepSeek-V3. The cross-disease analysis applied the approach to pulmonary thin-section CT findings: the MDQA score increased from 0.4773 ± 0.1701 with Prompt 0 to 0.7109 ± 0.1676 with Prompt 10. These results show that the tested prompts and assessment approach were used beyond the original liver MRI dataset, although the external analysis remained retrospective and the pulmonary cohort involved CT rather than MRI.</p>
<p>Radiologist ratings followed trends similar to the MDQA measurements. Together, the findings support structured prompt design and multidimensional evaluation as methods for examining consistency and report-level quality in LLM-generated radiology impressions. The study does not establish that the approach improves clinical decisions, patient care or diagnostic performance in prospective practice. Its conclusions are limited to the tested models, prompts, retrospective report cohorts and evaluation framework, including the transfer from liver MRI to pulmonary CT reports.</p>
<p><strong>Subject of Research:</strong> Evaluation of structured prompts and multidimensional quality assessment for LLM-generated radiology diagnostic impressions</p>
<p><strong>Article Title:</strong> Prompt optimization and multidimensional quality assessment for Chinese large language model-generated diagnostic impressions from liver MRI findings: external-center and cross-disease validation</p>
<p><strong>Article References:</strong> Wang, Q., Sun, X., Chen, Y., Cheng, J., Liu, Y., Zhang, X., Zhang, Z., Liu, C., Li, X., &amp; Chen, W. (2026). Prompt optimization and multidimensional quality assessment for Chinese large language model-generated diagnostic impressions from liver MRI findings: external-center and cross-disease validation. <em>BMC Medical Imaging</em>. <a href="https://doi.org/10.1186/s12880-026-02849-4" rel="noopener noreferrer">https://doi.org/10.1186/s12880-026-02849-4</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1186/s12880-026-02849-4" rel="noopener noreferrer">10.1186/s12880-026-02849-4</a></p>
<p><strong>Keywords:</strong> large language models, prompt optimization, radiology reports, liver MRI, quality assessment, external validation, pulmonary CT, diagnostic impressions, Chinese AI, Prompt, optimization, multidimensional</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">331203</post-id>	</item>
		<item>
		<title>AI Audit of 950 Studies Reveals Most Microplastic Exposure Data Fall Short for Health Risk Assessment</title>
		<link>https://scienmag.com/ai-audit-of-950-studies-reveals-most-microplastic-exposure-data-fall-short-for-health-risk-assessment/</link>
		
		<dc:creator><![CDATA[Denise Maddox]]></dc:creator>
		<pubDate>Fri, 16 Oct 2026 12:00:21 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[AI]]></category>
		<category><![CDATA[air]]></category>
		<category><![CDATA[beverages]]></category>
		<category><![CDATA[food]]></category>
		<category><![CDATA[human exposure]]></category>
		<category><![CDATA[large-scale]]></category>
		<category><![CDATA[microplastics]]></category>
		<category><![CDATA[nanoplastics]]></category>
		<category><![CDATA[quality assessment]]></category>
		<category><![CDATA[risk assessment]]></category>
		<category><![CDATA[standardization]]></category>
		<category><![CDATA[Wageningen University]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=285054</guid>

					<description><![CDATA[The scale of the new analysis is what sets it apart from earlier efforts to grade the microplastics literature. Previous quality screenings typically examined dozens to a few hundred papers, often focused on a single compartment such as drinking water]]></description>
										<content:encoded><![CDATA[<p>The scale of the new analysis is what sets it apart from earlier efforts to grade the microplastics literature. Previous quality screenings typically examined dozens to a few hundred papers, often focused on a single compartment such as drinking water or food, and relied entirely on manual reading by trained assessors. By combining an AI model with scripted logic, the Wageningen team was able to process 950 studies spanning air, food, and beverages in a single consistent framework, something that would have taken a human team months or years to complete with comparable uniformity. The hybrid design matters: the language model performed the labor-intensive extraction of methods information from each paper, while deterministic Python scripts applied the scoring rules, reducing the risk that subjective judgment would vary from one paper to the next.</p>
<p>The verification step deserves particular attention. Because large language models can hallucinate or misread methodological details, the researchers did not simply trust the model&#8217;s output. Instead, they calculated a statistically determined sample of 87 studies in which human assessors independently evaluated the same criteria, allowing them to quantify how often the AI extraction agreed with expert judgment. This kind of validation is increasingly recognized as essential whenever machine learning tools are used in evidence synthesis, and its inclusion here strengthens confidence in the aggregate conclusions even if individual extractions occasionally err.</p>
<p>The scoring system itself builds on criteria that have evolved over several rounds of earlier QA/QC work by the same group and by others in the microplastics field. Each study could earn up to 26 points across 13 criteria, with each criterion scored 2, 1, or 0. A score of 2 signals that the study fully satisfies a reliability requirement, such as confirming particle identity with appropriate spectroscopic methods, reporting blanks, or demonstrating that the sampled matrix actually reflects what people encounter. A score of 1 indicates partial compliance, and a 0 flags a criterion as inadequately addressed. Averaging 12 out of 26 points means the typical study in this corpus satisfied roughly half of the quality expectations, and the finding of about 5 zero scores per study indicates that outright failures were common rather than exceptional.</p>
<p>The pattern of lowest-scoring criteria is scientifically telling. Positive and negative controls, blank correction, and sampling representativeness are precisely the elements that separate a defensible exposure measurement from a potentially contaminated or unrepresentative one. Microplastic analysis is notoriously vulnerable to airborne fiber contamination in the laboratory, to plastic fragments shed from reagents, filters, and sample containers, and to procedural artifacts introduced during digestion and filtration. Without rigorous blanks and controls, an analyst cannot distinguish genuine particles in a food item or an air sample from contamination introduced during handling. The fact that these criteria were among the weakest across 950 studies suggests that contamination control remains the single largest weakness of the exposure literature, echoing concerns raised repeatedly in methodological commentaries over the past decade.</p>
<p>Representativeness is the other recurring failure point, and it has direct consequences for risk assessment. A microplastic concentration measured in a laboratory-prepared food simulant, a single brand of bottled water, or an air sample collected in an unusual microenvironment may not reflect what a typical person inhales or ingests. Human exposure assessment requires data that capture realistic usage conditions: the actual temperatures at which food is stored or heated in plastic packaging, the breathing zones where people spend time, the beverages people actually consume at realistic volumes. When studies fall short on representativeness, downstream risk calculations inherit that bias, potentially underestimating or overestimating true intake. The authors&#8217; observation that food and air data may not adequately represent actual exposure therefore points to a structural gap rather than a marginal one.</p>
<p>It is worth noting what the analysis does and does not claim. A low QA/QC score does not prove that a study&#8217;s reported concentrations are wrong; it means the study did not demonstrate, through documented controls and procedures, that its numbers can be trusted for risk assessment purposes. Some low-scoring studies may still be broadly accurate, while even well-scored studies carry residual uncertainty. The value of the ranking lies in prioritization: by identifying the top-performing studies, the dataset gives risk assessors a defensible starting point for selecting exposure values, and by quantifying the distribution of scores it makes the overall weakness of the evidence base explicit rather than anecdotal.</p>
<p>The use of Gemini 1.5-pro for information extraction also illustrates a broader shift in how environmental evidence is being synthesized. Long-context language models can now ingest full research papers, locate methodological passages, and classify them against a rubric, tasks that previously required exhaustive manual reading. The supplementary materials for this study include the prompts and scoring functions used, which supports reproducibility and allows other groups to adapt the workflow to adjacent questions, such as grading studies of nanoplastics or of microplastics in environmental compartments beyond human exposure. Publishing the search strings, criteria explanations, classification categories, and threshold values alongside the results makes the entire pipeline inspectable, an important safeguard given that AI-assisted evidence assessment is still a young methodology.</p>
<p>For policymakers, the practical output is a curated, ranked inventory of exposure studies. Health evaluations of microplastics have been hampered by the sheer heterogeneity of the literature: concentrations reported in different units, particle size ranges, polymer identifications, and sampling designs are difficult to combine, and quality varies so widely that unweighted pooling can be misleading. A QA/QC ranking offers a principled way to weight or filter studies before they enter exposure models. The identification of the top 10 percent of studies by total score and by zero counts, provided in the supplementary material, gives assessors concrete candidate datasets for intake calculations across the three pathways simultaneously, which the authors note is a first in this field.</p>
<p>The study&#8217;s funding context is also relevant to interpreting its aims. The work was supported by the Netherlands Organization for Health Research and Development&#8217;s Microplastics and Health programme and by Health-Holland&#8217;s Top Sector Life Sciences and Health, under the ATHENA project. That programme was established specifically to build the evidence base on microplastics and human health, including exposure assessment and hazard characterization, so a large-scale quality audit of the exposure literature fits squarely within its mandate. The authors, based in the Aquatic Ecology and Water Quality Management Group at Wageningen University, have been prominent contributors to microplastic exposure and risk methodology, and the analysis reflects the accumulated criteria development of that research programme.</p>
<p>Looking forward, the conclusions underscore several needs that the field has been debating. Standardization of sampling, contamination control, and reporting would allow future studies to score well without heroic individual effort. Improved analytical methods, particularly for smaller particles and for polymer identification in complex matrices, would reduce the uncertainty that currently forces conservative assumptions. And the demonstrated feasibility of AI-assisted screening at the scale of nearly a thousand papers suggests that periodic re-audits of the literature could become routine, tracking whether quality improves as guidelines mature. The average total score of 12 out of 26 provides a baseline against which progress can be measured: if the next comparable audit finds a higher mean, with fewer zero scores on controls, blanks, and representativeness, that would be direct evidence that the field&#8217;s quality reforms are working.</p>
<p>Finally, the open-access publication of the study, including its supplementary dataset of ranked studies, lowers the barrier for research groups worldwide to apply its findings. Exposure scientists can locate where their own studies rank and which criteria cost them points; risk assessors can assemble top-tier datasets for the air, food, and beverage pathways; and methodologists can examine the criteria rubric to refine quality standards for the next generation of microplastics research. The work thus functions simultaneously as a critique of the existing evidence base, a practical tool for selecting usable data, and a template for the standardized, quality-controlled exposure studies that human health risk assessment of microplastics ultimately requires.</p>
<p><strong>Subject of Research:</strong> AI-assisted quality assessment of microplastic exposure data across air, food, and beverages</p>
<p><strong>Article Title:</strong> A large-scale AI-assisted QA/QC analysis of microplastic data across human exposure pathways</p>
<p><strong>Article References:</strong> Barchiesi, M., de Ruijter, V., Qiu, Y., Wardani, I., Lane, T., &amp; Koelmans, A. A. (2026). A large-scale AI-assisted QA/QC analysis of microplastic data across human exposure pathways. <em>Microplastics and Nanoplastics</em>. <a href="https://doi.org/10.1186/s43591-026-00241-1" rel="noopener noreferrer">https://doi.org/10.1186/s43591-026-00241-1</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1186/s43591-026-00241-1" rel="noopener noreferrer">10.1186/s43591-026-00241-1</a></p>
<p><strong>Keywords:</strong> microplastics, nanoplastics, quality assessment, AI, human exposure, risk assessment, air, food, beverages, standardization, Wageningen University, large-scale</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">285054</post-id>	</item>
		<item>
		<title>Aged Wuyi Rock Tea Reveals a Hidden Chemical Rebalancing During Years of Storage</title>
		<link>https://scienmag.com/aged-wuyi-rock-tea-reveals-a-hidden-chemical-rebalancing-during-years-of-storage/</link>
		
		<dc:creator><![CDATA[Bethany Barker]]></dc:creator>
		<pubDate>Mon, 12 Oct 2026 02:56:31 +0000</pubDate>
				<category><![CDATA[Chemistry]]></category>
		<category><![CDATA[Aged Wuyi rock tea chemical changes]]></category>
		<category><![CDATA[catechins]]></category>
		<category><![CDATA[chemical rebalancing during tea storage]]></category>
		<category><![CDATA[flavor and aroma development in aged oolong]]></category>
		<category><![CDATA[food chemistry]]></category>
		<category><![CDATA[gallic acid]]></category>
		<category><![CDATA[gallic acid accumulation in stored tea]]></category>
		<category><![CDATA[impact of storage conditions on tea chemistry]]></category>
		<category><![CDATA[insights into aged tea quality and valuation]]></category>
		<category><![CDATA[long-term tea storage effects]]></category>
		<category><![CDATA[Metabolomics]]></category>
		<category><![CDATA[oolong tea]]></category>
		<category><![CDATA[polyphenol transformation in aged tea]]></category>
		<category><![CDATA[polyphenols]]></category>
		<category><![CDATA[quality assessment]]></category>
		<category><![CDATA[Rougui]]></category>
		<category><![CDATA[Rougui tea aging process]]></category>
		<category><![CDATA[stage-wise chemical remodeling in aged tea]]></category>
		<category><![CDATA[tea aging]]></category>
		<category><![CDATA[tea leaf chemistry across multiple years]]></category>
		<category><![CDATA[tea storage]]></category>
		<category><![CDATA[traditional Wuyi rock tea manufacturing]]></category>
		<category><![CDATA[UHPLC-MS/MS]]></category>
		<category><![CDATA[Wuyi rock tea]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=263586</guid>

					<description><![CDATA[A decade-spanning metabolomics study of Wuyi rock tea Rougui reveals stage-wise polyphenol remodeling and a dramatic enrichment of gallic acid during long-term storage.]]></description>
										<content:encoded><![CDATA[<p>Aged Wuyi rock tea commands extraordinary prices in China, with collectors prizing decades-old batches of the oolong cultivar Rougui for their mellowed taste and deepened aroma. But what actually happens inside the leaf as it sits in sealed packaging year after year has remained largely a matter of tradition and guesswork. Now, a study published in Food Chemistry: X has tracked the chemistry of Rougui tea across ten consecutive production years, from 2016 to 2025, and uncovered a picture far more complex than the simple, steady decline that many tea lovers might imagine. Instead of a one-way chemical drift, the researchers found a dynamic, stage-wise remodeling of the tea&#8217;s polyphenol system, accompanied by a striking accumulation of gallic acid in the older batches.</p>
<p>The research team, led by Yuansen Qi and colleagues at Fujian-based institutions, obtained Rougui samples from a single tea garden at Mituo Rock in the Wuyi Mountains, all processed by the same factory using traditional Wuyi rock tea manufacturing procedures. The leaves were harvested from the same cultivar and aged in sealed aluminum foil bags at 25 degrees Celsius with relative humidity below 50 percent, meaning that the storage environment was held as constant as possible. Ten production years were represented, designated RG16 through RG25, corresponding to storage durations of nine years down to zero, with three biological replicates for each year. This design allowed the scientists to compare chemical profiles across a decade of production while keeping cultivar, origin, processing, and storage conditions largely controlled.</p>
<p>To capture the full chemical landscape, the team deployed a dual mass-spectrometry strategy. First, untargeted metabolomics using ultra-high-performance liquid chromatography coupled to quadrupole time-of-flight mass spectrometry, or UHPLC-QTOF-MS, mapped the overall metabolic differences among the ten production years without any preconception about which compounds might matter. Second, a targeted method built on a triple quadrupole mass spectrometer, UHPLC-QqQ-MS/MS, delivered absolute concentrations of nine representative polyphenols: eight catechins and gallic acid. The combination is powerful because the untargeted screen can reveal unexpected patterns, while the targeted quantification anchors those patterns in rigorously validated numbers, with calibration curves showing linearity coefficients above 0.999 for all nine compounds.</p>
<p>The untargeted analysis immediately showed that storage leaves a deep chemical fingerprint. In principal component analysis, the first principal component alone explained 39.3 percent of the total variance, and samples from different production years separated along this axis. Crucially, the trajectory of PC1 scores across the years was not a smooth line. The freshest teas, RG25 and RG24, sat at relatively high values; the score dropped sharply at RG23, reached its lowest region in RG22 and RG21, and then partially recovered from RG20 back to RG16. This stage-wise fluctuation suggests that the chemistry of aging rock tea does not march steadily in one direction but instead passes through distinct phases, possibly reflecting the interplay of slow oxidation, hydrolysis, and other transformations that proceed at different rates over time.</p>
<p>Statistical validation supported the pattern. Permutation testing confirmed that the supervised PLS-DA model was not overfitted, and PERMANOVA analysis demonstrated significant overall differences among the storage-duration groups, while PERMDISP showed that the within-group spread was homogeneous. A global heatmap of all annotated features revealed that the variation was organized by chemical class: flavonoids, phenolic acids, and tannins moved in broadly concordant patterns across the years, indicating coordinated shifts among structurally related constituents rather than random, compound-by-compound noise. The authors are careful to note one limitation, however: because the samples are independently manufactured batches rather than a single batch tracked longitudinally, some of the observed differences may reflect interannual variation in the starting material as well as storage history itself.</p>
<p>Zooming into the polyphenol domain, the researchers manually curated seventeen catechin- and gallic-acid-related features from the untargeted annotation list, spanning catechin monomers, catechin gallates, methylated gallates, trigallic acid, theaflavin gallates, and prodelphinidin gallates. Ranked by their Spearman correlation with production year, these features showed both positive and negative correlations of varying magnitude, confirming that the catechin-gallic acid system did not change unidirectionally during storage. Seven of the annotations corresponded directly to compounds in the targeted panel, and the team added catechin and catechin gallate to complete four structurally matched epimeric pairs, yielding a final quantitative panel of four non-galloylated catechins, four galloylated catechins, and gallic acid.</p>
<p>The targeted quantification brought the story into sharp focus. Among the galloylated catechins, epigallocatechin gallate and gallocatechin gallate dominated, peaking in the RG23 and RG18 batches, while epicatechin gallate and catechin gallate also rose in RG18. The non-galloylated fraction was led by epigallocatechin, which fluctuated more widely than its companions. But the headline finding belonged to gallic acid. Measured against the freshest batch, RG25, gallic acid rose by 104.45 percent in RG20, and by 168.25 percent and 166.25 percent in RG17 and RG16 respectively, the most pronounced relative change of any compound measured. Meanwhile, the ratio of galloylated to non-galloylated catechins ranged from 3.08 to 5.63 across the decade, and galloylated catechins consistently made up between 75.5 and 84.9 percent of the total catechin pool, evidence of a genuine compositional redistribution rather than uniform loss.</p>
<p>Correlation analysis added a final layer of insight. Of the 36 pairwise relationships among the nine quantified compounds, 30 remained statistically significant after Benjamini-Hochberg correction. The epimeric pairs EGCG-GCG and ECG-CG showed near-perfect positive correlations, with Pearson coefficients of 0.9995 and 0.9987, suggesting that structurally matched catechins respond to storage in tightly coupled ways, likely because their shared galloyl groups confer similar susceptibility to hydrolysis and oxidation. Yet gallic acid showed essentially zero linear correlation with EGCG or GCG, the most abundant galloylated precursors. This near-zero relationship does not rule out galloylated catechins as a source of gallic acid, but it does indicate that no single precursor can explain the accumulation. The authors interpret gallic acid enrichment as the net result of multiple simultaneous processes: release from various galloylated substrates, oxidation, isomerization, polymerization, and consumption reactions, all operating in parallel across the aging leaf.</p>
<p>The findings carry practical weight for both tea science and the tea trade. Gallic acid and related phenolic acids are known contributors to the bitterness and astringency of tea infusions, so their enrichment during storage may partly explain why aged Rougui tastes smoother and rounder than its younger counterparts, as astringent catechins are transformed and simple phenolic acids accumulate. The combined catechin-pool and gallic acid profiles documented here could serve as chemical benchmarks for verifying the authenticity and consistency of aged rock tea products, a market where provenance claims are notoriously difficult to check. More broadly, the study demonstrates that even under tightly controlled storage conditions, the non-volatile chemistry of tea undergoes a rich, staged remodeling, and that understanding this remodeling requires looking at whole metabolic systems rather than a handful of marker compounds. For a beverage whose value can multiply with every year in the bag, that chemical clarity is long overdue.</p>
<p><strong>Subject of Research:</strong> Chemical changes in catechins and gallic acid during long-term storage of Wuyi rock tea Rougui</p>
<p><strong>Article Title:</strong> Untargeted metabolomics and targeted quantification revealing polyphenol remodeling and gallic acid enrichment during storage of Wuyi rock tea Rougui</p>
<p><strong>Article References:</strong> Qi, Y., Huang, K., Ma, C., &amp; Huang, Y. (2026). Untargeted metabolomics and targeted quantification revealing polyphenol remodeling and gallic acid enrichment during storage of Wuyi rock tea Rougui. <em>Food Chemistry: X</em>, Article 104613. <a href="https://doi.org/10.1016/j.fochx.2026.104613" rel="noopener noreferrer">https://doi.org/10.1016/j.fochx.2026.104613</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1016/j.fochx.2026.104613" rel="noopener noreferrer">10.1016/j.fochx.2026.104613</a></p>
<p><strong>Keywords:</strong> Wuyi rock tea, Rougui, oolong tea, metabolomics, catechins, gallic acid, polyphenols, tea storage, UHPLC-MS/MS, food chemistry, tea aging, quality assessment</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">263586</post-id>	</item>
		<item>
		<title>AI Scores Health Videos on Douyin Nearly as Well as Human Experts, Study Finds</title>
		<link>https://scienmag.com/ai-scores-health-videos-on-douyin-nearly-as-well-as-human-experts-study-finds/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Sun, 04 Oct 2026 22:12:05 +0000</pubDate>
				<category><![CDATA[Medicine]]></category>
		<category><![CDATA[AI health video assessment]]></category>
		<category><![CDATA[AI vs human experts in health video review]]></category>
		<category><![CDATA[AI-powered health content policing]]></category>
		<category><![CDATA[Artificial Intelligence]]></category>
		<category><![CDATA[automated health video quality assessment]]></category>
		<category><![CDATA[breastfeeding health education videos]]></category>
		<category><![CDATA[ChatGPT]]></category>
		<category><![CDATA[ChatGPT-4 health content evaluation]]></category>
		<category><![CDATA[Chinese social media health guidance]]></category>
		<category><![CDATA[DISCERN instrument]]></category>
		<category><![CDATA[Douyin]]></category>
		<category><![CDATA[Douyin health information quality]]></category>
		<category><![CDATA[health education]]></category>
		<category><![CDATA[health information accuracy on Douyin]]></category>
		<category><![CDATA[lactational mastitis]]></category>
		<category><![CDATA[lactational mastitis educational videos]]></category>
		<category><![CDATA[machine learning for health content moderation]]></category>
		<category><![CDATA[misinformation]]></category>
		<category><![CDATA[nursing]]></category>
		<category><![CDATA[patient education]]></category>
		<category><![CDATA[quality assessment]]></category>
		<category><![CDATA[short videos]]></category>
		<category><![CDATA[short-form video health misinformation detection]]></category>
		<category><![CDATA[social media]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=235874</guid>

					<description><![CDATA[Chinese researchers show that a ChatGPT-4-based framework can assess the quality of lactational mastitis videos on Douyin with near-perfect agreement with human experts and at nearly three times the speed.]]></description>
										<content:encoded><![CDATA[<p>Short-form video platforms have quietly become one of the most influential sources of health information in the world, and China&#8217;s Douyin is no exception. For new mothers searching for guidance on lactational mastitis, a painful and potentially serious inflammation of breast tissue that affects a substantial proportion of breastfeeding women, the platform offers thousands of clips promising advice on symptoms, treatment, and prevention. The problem, as clinicians have long suspected, is that the quality of that advice varies enormously. A new study published in BMC Nursing by researchers at the Women&#8217;s and Children&#8217;s Hospital of Chongqing Medical University and their collaborators now offers both a sobering snapshot of that content landscape and a strikingly efficient technological solution for policing it.</p>
<p>The research team, led by Siyu Zhou and Junfeng Li as co-first authors with Ben Li as corresponding author, set out to answer two intertwined questions. First, how reliable and high-quality are the lactational mastitis videos that new parents actually encounter on Douyin? Second, could a large language model such as ChatGPT-4, carefully adapted for the task, evaluate that content as reliably as trained human experts, and do so at a scale and speed that manual review could never match? The answer to the second question, according to their data, appears to be a qualified but impressive yes.</p>
<p>To build their dataset, the researchers searched Douyin, the Chinese short-video platform operated separately from TikTok, for content related to lactational mastitis posted between January 2021 and June 2025. After strict screening, 50 videos made the final sample. That number may sound modest, but it reflects the deliberate rigor of the selection process: the team needed videos that genuinely addressed the condition as a health education topic, and each one had to be scored in detail by both human raters and the artificial intelligence system. Fifty deeply assessed videos, the authors argue, provide a meaningful proof of concept for a framework that could later be scaled to thousands.</p>
<p>The methodological heart of the study is a hybrid instrument the authors call AI-DISCERN. The DISCERN instrument is a well-established, validated tool originally designed to assess the quality of written health information, probing whether a publication has clear aims, reliable sources, balanced treatment of uncertainty, and realistic descriptions of benefits and risks. Adapting it for video content and for the specific concerns of nursing education, the researchers integrated ChatGPT-4 into the scoring pipeline, refined the framework through nursing-oriented adaptation, and pre-tested it until the agreement between AI-assisted scores reached an intraclass correlation coefficient of 0.923, a level conventionally interpreted as excellent.</p>
<p>As a reference standard, two trained nursing experts independently scored every video while blinded to each other&#8217;s judgments and to the AI&#8217;s outputs. The human raters themselves agreed remarkably well, with an intraclass correlation coefficient of 0.976 for the total score, confirming that the assessment task was well defined and consistently executable. When the AI&#8217;s scores were compared against the human consensus, the agreement was even stronger: an intraclass correlation coefficient of 0.994, with a 95 percent confidence interval of 0.989 to 0.996. On twelve individual items of the instrument, the weighted Kappa coefficient exceeded 0.80, again signaling near-perfect categorical agreement between machine and expert.</p>
<p>Speed is where the technology truly separates itself from human effort. The AI system required an average of 33.34 seconds, with a standard deviation of 7.29 seconds, to score a single video. Human experts needed 89.79 seconds on average, with a standard deviation of 42.09 seconds, making the AI approximately 2.69 times faster, a difference that was statistically significant at P less than 0.001. That gap may seem trivial for 50 videos, but it compounds dramatically at platform scale. A repository of 100,000 health videos that would demand months of expert labor could, in principle, be triaged by an AI-assisted framework in a fraction of the time, freeing clinicians to focus on the borderline cases and on crafting better educational content themselves.</p>
<p>The study&#8217;s descriptive findings about who creates mastitis content on Douyin are equally noteworthy. A striking 86 percent of the included videos were posted by professional medical staff, and another 8 percent by professional medical institutions, while only three videos, or 6 percent, came from non-professional sources. This suggests that on this particular health topic, credentialed voices dominate the supply side of the platform. Yet the researchers observed, descriptively, that non-professional videos appeared to attract higher engagement indicators. Because the non-professional subgroup contained only three videos, the authors explicitly flagged any findings involving that comparison as exploratory, a caution that reflects sound statistical practice rather than a definitive claim about what goes viral.</p>
<p>Perhaps the most counterintuitive result concerns the relationship between quality and popularity. The total DISCERN score was positively correlated with video duration, with a Spearman rank correlation coefficient of 0.498 and a P value below 0.001, meaning that longer videos tended to be more thorough and reliable. However, the total quality score showed no significant correlation with any of the engagement indicators, such as likes or shares, with all P values exceeding 0.05. In other words, the algorithmic and social forces that determine which videos get watched do not appear to reward educational quality in this sample. A parent scrolling Douyin cannot assume that a highly engaged video is a trustworthy one, and a well-made, evidence-based video has no inherent visibility advantage over a superficial competitor.</p>
<p>For clinicians and public health communicators, that disconnect between quality and engagement is the study&#8217;s most actionable insight. If popularity does not track reliability, then platforms, professional bodies, and educators cannot rely on organic market forces to surface the best content. Structured, scalable quality assessment becomes essential infrastructure. The AI-DISCERN framework, the authors suggest, may serve as a feasible supportive tool for exactly that purpose: a way to systematically grade lactational mastitis education, flag substandard material, and identify gaps that professional creators should fill. It is a supportive tool, not a replacement for human judgment, and the authors are careful on this point.</p>
<p>The limitations are clearly acknowledged. The sample of 50 videos is small, drawn from a single platform, a single language, and a single clinical topic, and the exploratory findings about non-professional content rest on just three videos. The authors state that further external validation using larger and more diverse datasets is needed before broader application. The study analyzed only publicly available videos without collecting personally identifiable information, and the ethics committee of Chongqing Health Center for Women and Children determined that formal ethical approval and informed consent were exempt under Guideline 22 of the International Ethical Guidelines for Health-related Research Involving Humans. Funded by a 2025 hospital-level medical education research grant from the Women and Children&#8217;s Hospital of Chongqing Medical University, the work points toward a future in which large language models act as tireless, calibrated reviewers of the health content that billions of people consume, one short video at a time.</p>
<p><strong>Subject of Research:</strong> AI-assisted evaluation of the quality and reliability of lactational mastitis health education videos on Douyin</p>
<p><strong>Article Title:</strong> ChatGPT-assisted evaluation of lactational mastitis videos on Douyin: quality and reliability as a health education resource</p>
<p><strong>Article References:</strong> Zhou, S., Li, J., Tang, F., Tang, X., Shi, Y., An, L., &amp; Li, B. (2026). ChatGPT-assisted evaluation of lactational mastitis videos on Douyin: quality and reliability as a health education resource. <em>BMC Nursing</em>. <a href="https://doi.org/10.1186/s12912-026-05282-8" rel="noopener noreferrer">https://doi.org/10.1186/s12912-026-05282-8</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1186/s12912-026-05282-8" rel="noopener noreferrer">10.1186/s12912-026-05282-8</a></p>
<p><strong>Keywords:</strong> ChatGPT, lactational mastitis, Douyin, short videos, health education, DISCERN instrument, patient education, artificial intelligence, nursing, social media, quality assessment, misinformation</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">235874</post-id>	</item>
		<item>
		<title>Two-Agent AI System Brings Expert-Level Accuracy to Corporate Carbon Footprint Mapping</title>
		<link>https://scienmag.com/two-agent-ai-system-brings-expert-level-accuracy-to-corporate-carbon-footprint-mapping/</link>
		
		<dc:creator><![CDATA[Sloane Callahan]]></dc:creator>
		<pubDate>Thu, 10 Sep 2026 23:43:43 +0000</pubDate>
				<category><![CDATA[Climate]]></category>
		<category><![CDATA[activity-based carbon accounting]]></category>
		<category><![CDATA[AI-driven carbon footprint analysis]]></category>
		<category><![CDATA[carbon accounting]]></category>
		<category><![CDATA[corporate carbon footprint measurement]]></category>
		<category><![CDATA[emission factors]]></category>
		<category><![CDATA[expert-level accuracy in emissions calculation]]></category>
		<category><![CDATA[greenhouse gas emissions from procurement]]></category>
		<category><![CDATA[industrial ecology and environmental data analysis]]></category>
		<category><![CDATA[large language models]]></category>
		<category><![CDATA[LCI database mapping]]></category>
		<category><![CDATA[Life Cycle Assessment]]></category>
		<category><![CDATA[lifecycle inventory database mapping]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[machine learning in sustainability]]></category>
		<category><![CDATA[proxy selection]]></category>
		<category><![CDATA[proxy selection in carbon accounting]]></category>
		<category><![CDATA[quality assessment]]></category>
		<category><![CDATA[Scope 3 emissions]]></category>
		<category><![CDATA[selective classification]]></category>
		<category><![CDATA[supply chain]]></category>
		<category><![CDATA[two-agent AI]]></category>
		<category><![CDATA[two-agent AI system for emissions mapping]]></category>
		<category><![CDATA[uncertainty quantification in environmental data]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=192015</guid>

					<description><![CDATA[A two-agent AI system separates proxy selection from independent quality assessment to map procurement items to lifecycle inventory databases with expert-level accuracy and calibrated confidence scores.]]></description>
										<content:encoded><![CDATA[<p>Scope 3 Category 1 emissions — the greenhouse gases embedded in the goods and services a company purchases — consistently dominate corporate carbon footprints, yet they remain among the most notoriously difficult categories to measure with any real precision. The core task in activity-based carbon accounting sounds deceptively simple: take each procurement line item, such as &#8216;stainless steel fasteners, 500 kg&#8217; or &#8216;cloud data hosting, monthly&#8217;, and connect it to a matching activity in a lifecycle inventory (LCI) database such as ecoinvent. In practice, however, the exact product a company bought almost never exists in the database. Every mapping decision is therefore a proxy selection made under incomplete information, and the consequences of getting it wrong are largely invisible. A new study published in the Journal of Industrial Ecology describes a two-agent artificial intelligence system that tackles this silent error problem head-on, achieving expert-level accuracy while simultaneously quantifying its own uncertainty.</p>
<p>The research, led by Andrew Dumit and colleagues at Watershed Technology Inc. in San Francisco, addresses a problem that distinguishes LCI mapping from most standard machine learning benchmarks. In supervised classification, a misclassified item typically produces some anomalous signal that can be detected downstream. In LCI database mapping, by contrast, an incorrect mapping produces no such anomaly. A wrongly matched dataset will dutifully return an emissions number, and that number will look perfectly plausible in a report. The only reliable way to catch such errors has traditionally been item-level expert review, which is prohibitively expensive at the scale of modern corporate procurement data, where organizations may need to map hundreds of thousands of line items. The result has been an industry-wide reliance on category-average emission factors, which sacrifice the resolution that activity-based accounting is supposed to provide.</p>
<p>The team&#8217;s solution is a deliberately structured two-agent system that separates the act of proxy selection from the act of quality assessment through what the authors call an information barrier. The first agent, the mapper, proposes LCI database matches using iterative, tool-augmented retrieval, searching the database and refining its candidates much as a human practitioner would. The second agent, the judge, is architecturally prevented from seeing anything the mapper did. It observes only the original input item, the proposed activity, and the activity&#8217;s metadata, and then scores the proposed mapping along two independent dimensions: emissions similarity and material similarity. This enforced separation is not an implementation convenience but a methodological choice, designed to prevent the judge from inheriting the mapper&#8217;s biases or rationalizing its choices after the fact.</p>
<p>The performance gains reported in the study are striking. On an evaluation set of 1,039 items spanning seven product categories, the mapper achieved 90.7 percent defensible accuracy — defined as the share of items mapped to an option that a domain expert would approve — with zero abstentions. By comparison, retrieval-based baselines reached only 19 to 43 percent, and prior automated systems, while sometimes avoiding outright errors, abstained on 70 to 73 percent of items, effectively punting the hard decisions back to humans. Because the mapper always commits to an answer, every procurement line item receives a concrete lifecycle-based emission factor rather than a coarse category average, which is precisely what item-level carbon accounting requires.</p>
<p>Even more consequential is what the judge component accomplishes. Because proxy errors are silent, the practical value of any automated mapping system depends on how well it can tell its own confident successes from its quiet failures. At a simulated expert review budget of 20 percent, the judge captured 67 percent of all mapping errors, compared with only 37 to 40 percent for heuristic baselines. When the analysis focused on severe errors — cases where the chosen proxy&#8217;s emissions deviated by more than 100 percent from the correct value — the judge caught 74 percent of them. This means that organizations deploying the system can concentrate their scarce expert review capacity on exactly the items where a wrong proxy would most distort the reported footprint, rather than sampling randomly or reviewing everything.</p>
<p>The information barrier also yields a property that is rare in applied carbon accounting tools: calibration. Because the judge never sees the mapper&#8217;s reasoning, its quality scores function as an independent audit of each mapping, and these scores turn out to be well calibrated against actual correctness. In practical terms, the system can auto-accept 30 percent of its mappings while incurring an error rate of just 0.3 percent on that auto-accepted subset. This selectivity framework connects the work to a broader literature on selective classification and learning to defer to experts, in which models must know not only how to predict but when their predictions deserve trust. The authors note that large language models are often overconfident and biased self-evaluators when asked to grade their own outputs, which strengthens the case for a structurally independent assessor rather than self-reflection.</p>
<p>The technical architecture draws on several strands of recent research. The mapper&#8217;s iterative retrieval approach reflects agentic patterns such as ReAct, in which a language model interleaves reasoning steps with tool calls to ground its decisions in external data — in this case, the LCI database itself. The judge&#8217;s evaluation role builds on work on LLM-as-a-judge methods, while its scoring dimensions echo established lifecycle inventory practice, notably the data quality indicators introduced by Weidema and Wesnæs in the 1990s and subsequent proxy selection methodologies for choosing the most appropriate LCI dataset. Earlier machine learning applications in life cycle assessment largely focused on classification or regression tasks; the present work differs by treating the mapping problem as one of defensible proxy selection with explicit, auditable quality control, consistent with the requirements of ISO 14044.</p>
<p>The evaluation combined proprietary internal data from Watershed&#8217;s technical assessments with a public benchmark. A reproducible subset of 275 items from the Amazon Parakeet dataset of emission factor recommendations has been released, allowing outside researchers to compare their own systems on identical ground truth. The remainder of the evaluation data derives from proprietary procurement records and cannot be published, and the system code itself is proprietary to Watershed, whose carbon accounting products the company commercializes. All authors are Watershed employees, and the paper states that no external funding was received. These disclosures situate the work within a growing wave of industry-led research into AI-assisted sustainability measurement, alongside recent efforts to apply generative AI to product carbon footprint estimation and LCA data quality assessment.</p>
<p>The broader implications reach well beyond one company&#8217;s product pipeline. Accurate Scope 3 accounting has become a central battleground in corporate climate accountability, as regulators, investors, and voluntary disclosure frameworks increasingly demand granular, activity-based figures rather than spend-based approximations. By demonstrating that automated mapping can approach expert quality while providing calibrated signals for where human judgment is still needed, the study sketches a plausible division of labor between machines and domain experts at a scale that neither could achieve alone. If such systems mature, the long-standing trade-off between the resolution of a carbon footprint and the cost of producing it may finally begin to loosen, moving organizations from category averages toward genuinely item-level transparency across their supply chains.</p>
<p>The study arrives at a moment when the infrastructure for lifecycle inventory data itself is expanding. Databases such as ecoinvent, which releases documented change reports with each version update, and newer entrants like China&#8217;s HiQLCD, continue to grow in geographic and sectoral coverage, yet the fundamental mismatch between what companies purchase and what databases contain persists. This is why proxy selection has long been recognized as a methodological challenge in its own right, with earlier work proposing structured selection methodologies and expert elicitation to patch inventory gaps for specific product categories such as laundry detergents.</p>
<p>The reporting context also matters. Under the Greenhouse Gas Protocol&#8217;s Corporate Value Chain standard and its technical guidance, companies are expected to prioritize the Scope 3 categories most relevant to their sector, and sector-specific technical notes from disclosure platforms such as CDP reinforce that purchased goods and services rank highest in relevance for most industries. Spend-based estimation, which multiplies procurement spending by sector-average emission factors, satisfies reporting requirements cheaply but obscures the physical processes actually driving emissions, limiting the value of the resulting figures for procurement decisions and supplier engagement.</p>
<p>One caution raised in the machine learning literature concerns correlated errors: when multiple automated mappings fail in similar ways, headline accuracy figures can mask systematic biases within particular product categories or database regions. The authors&#8217; emphasis on item-level expert annotation of defensible mappings, supported by a dedicated sustainability data advisory team, reflects an awareness that evaluation quality ultimately bounds the trustworthiness of any automated accounting pipeline built upon it.</p>
<p><strong>Subject of Research:</strong> Quality-aware automated mapping of procurement items to lifecycle inventory databases for Scope 3 carbon accounting using a two-agent AI system</p>
<p><strong>Article Title:</strong> Quality-aware automation for LCI database mapping</p>
<p><strong>Article References:</strong> Dumit, A., Rao, K., Ulissi, S., Watson, S., Feintzeig, J., Joyce, P. J., &amp; Bao, S. (2026). Quality-aware automation for LCI database mapping. <em>Journal of Industrial Ecology</em>. <a href="https://doi.org/10.1007/s44498-026-00157-2" rel="noopener noreferrer">https://doi.org/10.1007/s44498-026-00157-2</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s44498-026-00157-2" rel="noopener noreferrer">10.1007/s44498-026-00157-2</a></p>
<p><strong>Keywords:</strong> life cycle assessment, Scope 3 emissions, LCI database mapping, carbon accounting, large language models, two-agent AI, proxy selection, quality assessment, selective classification, emission factors, supply chain, machine learning</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">192015</post-id>	</item>
	</channel>
</rss>
