<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>AI security &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/ai-security/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Sun, 04 Oct 2026 23:23:21 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>AI security &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>SafeSeal embeds certifiable watermarks into AI text without hurting quality</title>
		<link>https://scienmag.com/safeseal-embeds-certifiable-watermarks-into-ai-text-without-hurting-quality/</link>
		
		<dc:creator><![CDATA[Courtney Benton]]></dc:creator>
		<pubDate>Sun, 04 Oct 2026 23:23:21 +0000</pubDate>
				<category><![CDATA[Policy]]></category>
		<category><![CDATA[AI compliance]]></category>
		<category><![CDATA[AI security]]></category>
		<category><![CDATA[AI text watermarking]]></category>
		<category><![CDATA[BERTScore]]></category>
		<category><![CDATA[combating model stealing and content redistribution]]></category>
		<category><![CDATA[content authentication]]></category>
		<category><![CDATA[embedding machine-detectable marks in AI-generated content]]></category>
		<category><![CDATA[ensuring authenticity of AI-generated legal and marketing texts]]></category>
		<category><![CDATA[intellectual property]]></category>
		<category><![CDATA[large language models]]></category>
		<category><![CDATA[level 3 readiness of AI watermarking systems]]></category>
		<category><![CDATA[licensing AI watermarking innovations]]></category>
		<category><![CDATA[model stealing]]></category>
		<category><![CDATA[named entity recognition]]></category>
		<category><![CDATA[patent-pending AI watermarking solutions]]></category>
		<category><![CDATA[protecting intellectual property in large language models]]></category>
		<category><![CDATA[SafeSeal]]></category>
		<category><![CDATA[SafeSeal proprietary watermarking technology]]></category>
		<category><![CDATA[SUNY]]></category>
		<category><![CDATA[technology licensing]]></category>
		<category><![CDATA[technology transfer for AI watermarking]]></category>
		<category><![CDATA[verifiable digital watermarks for language models]]></category>
		<category><![CDATA[watermarking]]></category>
		<category><![CDATA[watermarking without compromising text quality]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=236070</guid>

					<description><![CDATA[Researchers at the Research Foundation for SUNY have developed SafeSeal, a patent-pending watermarking system that embeds detectable marks in large language model outputs while preserving text quality with a 0.981 BERTScore and a 95.1 percent detection rate.]]></description>
										<content:encoded><![CDATA[<p>As large language models churn out everything from legal drafts to marketing copy at industrial scale, the question of who owns that output — and how to prove it — has moved from an academic curiosity to a pressing commercial problem. A research team affiliated with the Research Foundation for the State University of New York believes it has an answer. The technology, called SafeSeal, is a patent-pending watermarking system designed to embed verifiable, machine-detectable marks into the text produced by large language models while leaving the quality, meaning, and readability of that text essentially untouched. According to the announcement published via EurekAlert!, the system is currently at technology readiness level 3 and is available for licensing through SUNY&#8217;s technology transfer channels.</p>
<p>The problem SafeSeal targets is deceptively simple to state and notoriously hard to solve. When an organization deploys a proprietary language model, its outputs can be copied, redistributed, or used to train competing models without permission — a practice often described as model stealing or distillation. Conventional watermarking approaches attempt to counter this by subtly altering generated text so that a hidden statistical signature can later be detected. But many of these methods come with a painful trade-off: the alterations degrade fluency, distort meaning, or introduce awkward phrasing that human readers notice immediately. Worse, sophisticated adversaries can often strip or obscure the watermark through paraphrasing attacks, rendering the protection worthless precisely when it is needed most.</p>
<p>SafeSeal&#8217;s designers approached the challenge by splitting the problem into two coordinated tasks: deciding where a watermark can safely be inserted, and deciding how to insert it so that removal becomes impractically difficult. The first task is handled by named entity recognition, a well-established natural language processing technique that identifies proper nouns and other fixed references — names of people, organizations, places, dates, products, and similar content-critical tokens. By explicitly flagging these elements, the system ensures they remain unaltered. This matters because named entities carry much of the factual payload of a document; corrupting them is what makes many watermarking schemes visibly damaging to the text and, in practical terms, unusable in professional settings.</p>
<p>The second task relies on context-aware synonym substitution. Rather than applying a fixed, predictable transformation that an attacker could reverse-engineer, SafeSeal replaces selected linguistic elements with carefully chosen synonyms that fit the surrounding context. The substitutions are distributed uniformly across eligible positions in the text, which complicates any adversarial attempt to identify and undo the watermark. An adversary who cannot determine which words carry the signal cannot reliably paraphrase their way to a clean, unwatermarked copy without also destroying the document&#8217;s utility. The result, the developers report, is a watermark that is both robust against removal attempts and effectively invisible to human readers.</p>
<p>The performance figures reported for the system are striking, at least on their face. In evaluation, SafeSeal achieved a BERTScore of 0.981, a metric that measures semantic similarity between texts using contextual embeddings from transformer models. A score approaching 1.0 indicates that the watermarked output remains nearly indistinguishable in meaning from the original generation. The system also recorded an entity similarity score of 0.962, quantifying how faithfully named entities survive the watermarking process — a direct measure of the technique&#8217;s content-preservation guarantee. Most importantly for verification purposes, the watermark detection rate reached 95.1 percent, meaning the embedded mark can be reliably recovered from watermarked text in the overwhelming majority of cases.</p>
<p>Those three numbers together describe the fundamental tension in watermarking research: detectability versus fidelity. Push a watermark too hard, and the text degrades or the signal becomes easy to spot and strip. Keep the text pristine, and the signal becomes too faint to detect with confidence. SafeSeal&#8217;s claimed contribution is a balance point at which the watermark remains strongly detectable while both semantic similarity and entity integrity stay close to their theoretical maximum. For organizations deploying language models in sensitive or proprietary applications — legal services, finance, healthcare documentation, enterprise software — that balance is what determines whether watermarking is a genuine security layer or an academic exercise.</p>
<p>The announced applications span a wide commercial landscape. Watermarked outputs can serve as evidence of provenance, helping companies protect intellectual property embedded in their models&#8217; generations and deterring unauthorized copying or redistribution. In industries that require verifiable content integrity, the same mechanism can authenticate AI-generated documents, distinguishing legitimate machine-assisted work from forged or manipulated text. The technology is also positioned as a compliance tool: as regulators worldwide move toward disclosure requirements for AI-generated content, a traceable, certifiable watermark offers a technical mechanism for demonstrating where a document came from and whether it has been altered since generation.</p>
<p>It is worth placing SafeSeal in its proper developmental context. At technology readiness level 3, the system has demonstrated its core concepts through experimental validation — the reported benchmark scores — but it has not yet been integrated into a production language model pipeline or tested at the scale of a commercial deployment. The patent is pending rather than granted, and the technology is being offered for licensing, meaning its real-world trajectory will depend on which adopters pick it up and how it performs under adversarial pressure beyond the laboratory. Independent replication of the reported detection and fidelity figures, and stress-testing against paraphrasing and translation attacks, will be the key milestones to watch as the technology matures.</p>
<p>Even so, the announcement lands at a moment when provenance technology for generative AI is attracting intense attention from industry, government, and standards bodies alike. Watermarking of model outputs is one of several complementary approaches — alongside cryptographic content credentials, retrieval-based provenance, and output logging — being explored to make the AI supply chain auditable. A scheme that combines high detection rates with near-lossless text quality, and that explicitly protects the entities readers care most about, addresses two of the most common objections raised against earlier watermarking proposals. Whether SafeSeal&#8217;s approach holds up against determined adversaries in the wild remains to be seen, but the underlying idea — that watermarking can be certifiable without sacrificing the text it protects — is likely to shape the next generation of deployment security tools.</p>
<p>For now, the technology stands as a concrete example of how university research foundations are moving AI safety and security innovations from papers toward the marketplace. The Research Foundation for SUNY, which supports the largest comprehensive public university system in the United States, is actively seeking licensees, and the broader ecosystem of LLM providers, enterprise software vendors, and compliance-focused startups represents a natural customer base. If the reported benchmarks translate into production performance, SafeSeal could become a meaningful building block in the emerging infrastructure for verifying and protecting machine-generated text — a small but consequential piece of the puzzle as society grapples with how to trust, and hold accountable, the flood of words produced by artificial intelligence.</p>
<p><strong>Subject of Research:</strong> Certifiable watermarking technology for protecting large language model outputs</p>
<p><strong>Article Title:</strong> SafeSeal: Certifiable watermarking for LLM deployments</p>
<p><strong>Article References:</strong> SafeSeal: Certifiable watermarking for LLM deployments. (n.d.). <a href="https://www.eurekalert.org/news-releases/1144575" rel="noopener noreferrer">Original publication</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> Not provided</p>
<p><strong>Keywords:</strong> SafeSeal, large language models, watermarking, AI security, intellectual property, named entity recognition, BERTScore, content authentication, SUNY, technology licensing, model stealing, AI compliance</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">236070</post-id>	</item>
		<item>
		<title>New Taxonomy Maps the Entire Landscape of Retrieval-Augmented AI Systems</title>
		<link>https://scienmag.com/new-taxonomy-maps-the-entire-landscape-of-retrieval-augmented-ai-systems/</link>
		
		<dc:creator><![CDATA[Denise Maddox]]></dc:creator>
		<pubDate>Fri, 02 Oct 2026 04:28:55 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[advancements in AI knowledge retrieval]]></category>
		<category><![CDATA[adversarial attacks on AI retrieval systems]]></category>
		<category><![CDATA[AI interactivity and complex reasoning]]></category>
		<category><![CDATA[AI knowledge limitations]]></category>
		<category><![CDATA[AI security]]></category>
		<category><![CDATA[AI system robustness and security]]></category>
		<category><![CDATA[AI taxonomy and research landscape]]></category>
		<category><![CDATA[Artificial Intelligence Review]]></category>
		<category><![CDATA[Dense Retrieval]]></category>
		<category><![CDATA[efficiency of retrieval-augmented generation]]></category>
		<category><![CDATA[hallucination]]></category>
		<category><![CDATA[hallucination in AI]]></category>
		<category><![CDATA[information retrieval]]></category>
		<category><![CDATA[Interactive AI Systems]]></category>
		<category><![CDATA[large language models]]></category>
		<category><![CDATA[Multi-step Reasoning]]></category>
		<category><![CDATA[reinforcement learning]]></category>
		<category><![CDATA[reinforcement learning in AI retrieval policies]]></category>
		<category><![CDATA[Retrieval-augmented AI systems]]></category>
		<category><![CDATA[retrieval-augmented generation]]></category>
		<category><![CDATA[semantic search]]></category>
		<category><![CDATA[structured survey of AI retrieval technology]]></category>
		<category><![CDATA[taxonomy]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=225698</guid>

					<description><![CDATA[A new survey in Artificial Intelligence Review organizes the fast-moving field of retrieval-augmented generation into a four-axis taxonomy spanning efficiency, security, interactivity, and complex reasoning.]]></description>
										<content:encoded><![CDATA[<p>Large language models have dazzled the world with their fluency, yet they carry a fundamental flaw that has haunted artificial intelligence researchers since the first chatbots went viral: they do not actually know anything. Their knowledge is frozen inside billions of numerical parameters, fixed at the moment training ends, and their tendency to fabricate plausible-sounding but false information, known as hallucination, remains one of the field&#8217;s most stubborn problems. A new peer-reviewed survey published in Artificial Intelligence Review offers the most structured map yet of the technology widely seen as the answer, retrieval-augmented generation, or RAG, and organizes a sprawling research landscape into a taxonomy built on four axes: efficiency, robustness and security, interactivity, and complex reasoning.</p>
<p>The survey, authored by Meghana Sunil and V. Shravya of Vellore Institute of Technology in Chennai, Shravan Venkatraman of Mohamed bin Zayed University of Artificial Intelligence in Abu Dhabi, and P. R. Joe Dhanith, also of VIT Chennai, argues that earlier reviews of the field have concentrated too narrowly on core architectures and standard pipelines. In the years since RAG entered mainstream deployment, the research frontier has expanded into territory those surveys barely touch, including adversarial attacks on retrieval systems, reinforcement-learning-driven retrieval policies, and conversational workflows in which the user and the system negotiate what information is actually needed. The new paper consolidates these threads into a single framework intended to help researchers and engineers see the field whole.</p>
<p>At its heart, RAG is deceptively simple. When a user asks a question, the system first retrieves relevant documents or passages from an external knowledge source, then feeds those retrieved chunks to the language model as context for generating its answer. This grounds the output in verifiable, up-to-date material rather than in the model&#8217;s static, parameter-bound memory. The survey formalizes the key components of this framework and traces how each has evolved. Retrieval itself now spans dense methods, which match queries to documents through learned vector embeddings that capture semantic meaning, and sparse methods, which rely on explicit term matching, with fusion strategies combining the strengths of both to improve recall and precision.</p>
<p>The first axis of the taxonomy, retrieval efficiency, addresses a practical reality that every deployment team confronts: searching billions of documents at query time is expensive, and the quality of what is retrieved directly determines the quality of the answer. The authors review embedding optimizations that compress or refine the vector representations used for semantic search, allowing faster and more accurate matching, alongside reinforcement-learning-based retrieval policies in which the retrieval component itself learns, through reward signals, which documents to fetch and when. These advances matter because a RAG system is only as trustworthy as the evidence it retrieves; a poorly tuned retriever can surface irrelevant or misleading passages that the generator then weaves confidently into its response.</p>
<p>The second axis, robustness and security, reflects a growing awareness that RAG pipelines are attack surfaces. Because the generator treats retrieved text as trusted context, an adversary who can poison the underlying corpus or craft documents that manipulate the retrieval stage can steer the model toward false or harmful outputs. The survey synthesizes the defensive techniques developed to harden these systems, from filtering and verification of retrieved content to architectural safeguards, and frames security not as an afterthought but as a design constraint that must be engineered into the pipeline from the start. As RAG underpins enterprise search assistants and customer-facing AI products, the stakes of this line of work are rising quickly.</p>
<p>The third axis covers user-driven and interactive workflows, an area the authors say prior surveys have underexplored. Early RAG systems operated as one-shot pipelines: a query goes in, an answer comes out. Contemporary systems increasingly support multi-turn dialogue in which the system can ask clarifying questions, the user can refine or redirect the search, and retrieval decisions adapt dynamically across the conversation. This shift transforms RAG from a static lookup mechanism into a collaborative information-seeking partner, and it introduces new technical challenges, including how to maintain coherent retrieval state across turns and how to evaluate whether an interactive session, rather than a single response, actually served the user&#8217;s underlying goal.</p>
<p>The fourth axis, multi-step and complex reasoning, tackles the hardest questions of all, those that cannot be answered from a single retrieved passage. Answering a legal or scientific query may require decomposing the problem, retrieving evidence for each sub-question, and synthesizing the findings into a coherent conclusion. The survey reviews architectural variants that support such chains of reasoning, including the widely adopted progression from Naive RAG, the basic retrieve-then-generate pipeline, through Advanced RAG, which adds pre- and post-retrieval refinements, to Modular RAG, which reassembles the pipeline from interchangeable components such as routing, memory, and iterative retrieval modules. This modularity, the authors suggest, is what allows modern systems to orchestrate retrieval as an active, multi-round process rather than a single lookup.</p>
<p>Beyond the four axes, the paper synthesizes how RAG systems are evaluated and where they are applied. Evaluation practices remain fragmented, the authors note, spanning retrieval metrics that measure whether the right documents were found, generation metrics that assess factual grounding and fluency, and increasingly, end-to-end judgments of answer correctness against verified sources. Domain-specific applications, from medicine to law to software engineering, each impose distinct requirements on retrieval quality, terminology handling, and reliability, and the survey maps how architectural choices shift across these domains. The breadth of the synthesis, covering dense and sparse retrieval, fusion strategies, embedding optimization, learned retrieval policies, and evaluation, is what distinguishes it from earlier, architecture-focused reviews.</p>
<p>The survey does not pretend the field&#8217;s problems are solved. The authors identify persistent challenges in retrieval quality, where even state-of-the-art retrievers fail on ambiguous or rare queries; in reliability, where systems can still be led astray by bad evidence; in domain adaptation, where models tuned for general web text stumble on specialized corpora; in scalability, where the computational cost of searching and processing massive indexes constrains real-time use; and in explainability, where users are rarely shown why particular documents were retrieved or how they shaped the answer. Each of these open problems, the authors argue, is also an opportunity, a well-defined target for the next generation of research.</p>
<p>What emerges from the four-axis taxonomy is a picture of a technology maturing from a clever trick into an engineering discipline. RAG began as a way to bolt fresh knowledge onto a frozen model; it is becoming a layered system in which retrieval policy, security hardening, interaction design, and reasoning orchestration are each objects of deliberate study. For the growing number of organizations betting that grounded generation is the path to AI systems that can be trusted with factual work, the survey offers both a status report and a research agenda: build systems that are faster and cheaper to query, harder to attack, more responsive to the people using them, and capable of reasoning across many sources at once. The authors, who report no funding or conflicts of interest, frame the ultimate goal as RAG systems that are more reliable, adaptable, and transparent, qualities that will determine whether retrieval-augmented generation fulfills its promise as the architecture that finally tames the hallucinating machine.</p>
<p><strong>Subject of Research:</strong> Retrieval-Augmented Generation for large language models</p>
<p><strong>Article Title:</strong> Mapping the RAG landscape: a four-axis taxonomy of efficiency, defense, interactivity, and reasoning</p>
<p><strong>Article References:</strong> Sunil, M., Shravya, V., Venkatraman, S., &amp; Dhanith, P. R. J. (2026). Mapping the RAG landscape: a four-axis taxonomy of efficiency, defense, interactivity, and reasoning. <em>Artificial Intelligence Review</em>. <a href="https://doi.org/10.1007/s10462-026-11715-2" rel="noopener noreferrer">https://doi.org/10.1007/s10462-026-11715-2</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10462-026-11715-2" rel="noopener noreferrer">10.1007/s10462-026-11715-2</a></p>
<p><strong>Keywords:</strong> Retrieval-Augmented Generation, Large Language Models, Information Retrieval, Hallucination, Semantic Search, Dense Retrieval, Reinforcement Learning, AI Security, Interactive AI Systems, Multi-step Reasoning, Taxonomy, Artificial Intelligence Review</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">225698</post-id>	</item>
		<item>
		<title>Hidden Messages That Fool AI: New GAN Fuses Steganography With Adversarial Attacks</title>
		<link>https://scienmag.com/hidden-messages-that-fool-ai-new-gan-fuses-steganography-with-adversarial-attacks/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Thu, 01 Oct 2026 07:31:10 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[adversarial attacks]]></category>
		<category><![CDATA[adversarial attacks on neural networks]]></category>
		<category><![CDATA[adversarial image manipulation techniques]]></category>
		<category><![CDATA[AI security]]></category>
		<category><![CDATA[black-box attack]]></category>
		<category><![CDATA[Caltech-256]]></category>
		<category><![CDATA[Chinese research in AI deception]]></category>
		<category><![CDATA[combining image steganography and adversarial machine learning]]></category>
		<category><![CDATA[covert communication]]></category>
		<category><![CDATA[covert data embedding in images]]></category>
		<category><![CDATA[cross-model transferability]]></category>
		<category><![CDATA[cybersecurity implications of stegoadversarial methods]]></category>
		<category><![CDATA[deep learning]]></category>
		<category><![CDATA[fooling deep learning models with images]]></category>
		<category><![CDATA[generative adversarial networks]]></category>
		<category><![CDATA[generative adversarial networks for hidden messages]]></category>
		<category><![CDATA[image processing]]></category>
		<category><![CDATA[ImageNet]]></category>
		<category><![CDATA[neural network security]]></category>
		<category><![CDATA[practical applications and risks of stegoadversarial AI]]></category>
		<category><![CDATA[steganalysis]]></category>
		<category><![CDATA[steganography]]></category>
		<category><![CDATA[steganography for covert communication]]></category>
		<category><![CDATA[stegoadversarial neural network framework]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=221122</guid>

					<description><![CDATA[Researchers have developed a generative adversarial network framework called StegoAdv-GAN that hides extractable secret messages inside images while simultaneously generating adversarial perturbations that fool deep neural networks in black-box settings.]]></description>
										<content:encoded><![CDATA[<p>In a development that sits at the uneasy intersection of artificial intelligence security and covert communication, researchers in China have unveiled a generative adversarial network framework that does two things at once: it hides secret information inside ordinary-looking images and simultaneously weaponizes those same images to fool deep neural networks. The method, described in the journal Multimedia Tools and Applications, is called StegoAdv-GAN, and it represents one of the most ambitious attempts yet to merge two research fields that have largely evolved in parallel—image steganography, the ancient art of hiding messages in plain sight, and adversarial machine learning, the modern science of breaking AI systems with carefully crafted inputs.</p>
<p>The team, led by Zhuxian Liu of Fujian Agriculture and Forestry University, together with Yunyu Kang and Xiaolong Liu, set out to solve a problem that has long limited the practical value of adversarial attacks. Since researchers first demonstrated that deep neural networks could be deceived by imperceptible perturbations—tiny mathematical nudges to pixel values that cause a classifier to see a gibbon where a human sees a panda—security researchers have explored how such attacks might work in the real world. But most adversarial examples embed what the authors describe as fragile, task-agnostic noise: essentially meaningless static that serves only to disrupt a model&#8217;s calculations. Such images carry no useful payload, survive transmission poorly, and offer nothing beyond the act of disruption itself.</p>
<p>StegoAdv-GAN takes a fundamentally different approach. Instead of treating the perturbation as disposable noise, the framework treats it as a carrier of semantically meaningful content. The system is trained end-to-end and consists of three competing neural components: a generator, an extractor, and a discriminator. The generator receives a cover image and a secret payload, and produces a stego-image—an image that looks essentially identical to the original but contains both the adversarial perturbation needed to mislead a target classifier and the embedded secret data. The extractor&#8217;s job is to recover that secret payload from the stego-image, even after the image has been processed by the target model or passed through various transformations. The discriminator, meanwhile, tries to distinguish stego-images from natural images, forcing the generator to produce outputs that evade steganalysis, the statistical techniques used to detect hidden data.</p>
<p>This three-way adversarial game is what gives the method its dual functionality. Because all three networks are jointly optimized, the generator cannot simply prioritize one goal at the expense of the other. It must learn perturbations that are simultaneously robust enough to survive real-world conditions and transferable enough to fool models it has never seen, while also encoding a high-capacity secret message that remains extractable on the other end. The authors report that the resulting images maintain high visual fidelity, meaning human observers would find it difficult or impossible to tell that anything unusual is hidden inside them, while the framework achieves what they describe as state-of-the-art performance in both steganographic capacity and attack effectiveness.</p>
<p>The experimental evaluation focused on black-box attack settings, the most challenging and realistic scenario in adversarial machine learning. In a black-box attack, the adversary has no access to the internal parameters, gradients, or architecture of the target model. The attacker can only observe inputs and outputs, which means any adversarial example must transfer across model boundaries. The researchers tested StegoAdv-GAN on two widely used benchmark datasets: Caltech-256, a collection of object photographs spanning 256 categories, and ImageNet1k, the million-image classification benchmark that has anchored computer vision research for over a decade. The framework was evaluated against a battery of well-known classifier architectures, including VGG, ResNet, DenseNet, SqueezeNet, ShuffleNet V2, and Inception-style networks, architectures that span the history of convolutional neural network design from deep plain networks to densely connected and efficiency-optimized models.</p>
<p>The results, according to the paper, show that StegoAdv-GAN achieves superior cross-model transferability compared with prior methods, meaning adversarial images crafted against one model are highly likely to fool other models as well. This property matters enormously in practice, because a real-world attacker rarely knows exactly which model is running behind an application programming interface or an autonomous system. Transferability is also what separates laboratory demonstrations from genuine security threats: an attack that only works against the exact network it was optimized on can be mitigated simply by keeping the model secret, whereas a transferable attack undermines that entire defense strategy.</p>
<p>The work builds on a rich lineage of research. The theoretical foundation of adversarial examples was laid by Ian Goodfellow and colleagues, who explained and harnessed the phenomenon, and by subsequent methods such as DeepFool, the Carlini-Wagner attack, and decision-based attacks that operate without gradient access. Generative approaches to adversary creation, including AdvGAN and its successors, showed that generative networks could produce adversarial perturbations faster and more flexibly than iterative optimization methods. On the steganography side, the field has progressed from simple least-significant-bit substitution, a technique dating back decades in which secret bits replace the lowest-order bits of pixel values, to sophisticated deep learning schemes such as StegoGAN and invertible neural network approaches that can hide entire images inside other images at large capacity. More recently, researchers have begun fusing the two domains, with adversarial watermarking methods like Adv-Watermark, FAWA, and BHI embedding invisible watermarks that double as adversarial perturbations.</p>
<p>What distinguishes StegoAdv-GAN from those earlier fusion attempts, the authors argue, is the combination of robustness, extractability, and capacity within a single jointly trained architecture. Earlier adversarial watermark schemes often produced payloads that degraded when images were resized, compressed, or otherwise processed—the very operations that any image undergoes when shared on social media, transmitted over messaging platforms, or ingested by a web service. By training the extractor alongside the generator under realistic conditions, the new framework aims to ensure the hidden message survives the journey. The authors also point to the semantic meaningfulness of the embedded content as a key advance: rather than random noise, the payload is genuine covert information, which opens the door to scenarios in which the stego-image functions as a covert communication channel that also happens to disrupt automated analysis of the image itself.</p>
<p>The implications cut in several directions at once. For defenders, the work is a warning: content moderation systems, malware-scanning pipelines, and computer-vision-driven security tools cannot assume that a visually innocuous image is harmless, because a single image may now carry both an attack against the AI analyzing it and a hidden message for a human recipient. Detection strategies will need to account for the possibility that adversarial perturbations are not noise-like artifacts but structured, information-bearing signals designed to evade steganalysis. For the steganography community, the paper demonstrates that adversarial objectives, usually viewed purely as threats, can serve as a form of camouflage, since perturbations crafted to fool classifiers may also help hidden data escape statistical detection. And for anyone thinking about the provenance and authenticity of images in the generative AI era, the study adds another layer of complexity to an already difficult problem: the same generative modeling techniques that power synthetic media can also embed layered, dual-purpose payloads that are invisible to both humans and machines.</p>
<p>The research, which was supported in part by the Guangzhou Institute of Science and Technology and a Ministry of Education project in China, remains purely algorithmic, built entirely on publicly available benchmark datasets, and the authors note that no human participants were involved. Its publication in Multimedia Tools and Applications signals that the fusion of steganography and adversarial machine learning is moving from a speculative idea toward a mature research program. As deep neural networks continue to mediate what software sees, reads, and decides, techniques like StegoAdv-GAN make clear that the images flowing through those systems can be far more than they appear: simultaneously a picture, a weapon against the machine that views it, and a sealed letter for whoever knows how to look. The arms race between those who build AI systems and those who seek to deceive them has just acquired a new dimension—one hidden, quite literally, in plain sight.</p>
<p><strong>Subject of Research:</strong> Fusion of image steganography and adversarial attacks using generative adversarial networks</p>
<p><strong>Article Title:</strong> Generative image steganography fusion with adversarial perturbations based on generative adversarial networks</p>
<p><strong>Article References:</strong> Liu, Z., Kang, Y., &amp; Liu, X. (2026). Generative image steganography fusion with adversarial perturbations based on generative adversarial networks. <em>Multimedia Tools and Applications, 85</em>(10), Article 783. <a href="https://doi.org/10.1007/s11042-026-21939-7" rel="noopener noreferrer">https://doi.org/10.1007/s11042-026-21939-7</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s11042-026-21939-7" rel="noopener noreferrer">10.1007/s11042-026-21939-7</a></p>
<p><strong>Keywords:</strong> adversarial attacks, steganography, generative adversarial networks, deep learning, black-box attack, image processing, neural network security, cross-model transferability, steganalysis, ImageNet, Caltech-256, covert communication</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">221122</post-id>	</item>
		<item>
		<title>Prompt Injection Emerges as a Patient Safety Threat in Clinical AI</title>
		<link>https://scienmag.com/prompt-injection-emerges-as-a-patient-safety-threat-in-clinical-ai/</link>
		
		<dc:creator><![CDATA[Ophelia Keating]]></dc:creator>
		<pubDate>Tue, 22 Sep 2026 14:05:54 +0000</pubDate>
				<category><![CDATA[Medicine]]></category>
		<category><![CDATA[adversarial attacks]]></category>
		<category><![CDATA[agentic AI]]></category>
		<category><![CDATA[AI misdiagnosis due to prompt manipulation]]></category>
		<category><![CDATA[AI model robustness in medicine]]></category>
		<category><![CDATA[AI patient safety]]></category>
		<category><![CDATA[AI regulation]]></category>
		<category><![CDATA[AI security]]></category>
		<category><![CDATA[clinical AI]]></category>
		<category><![CDATA[clinical decision support system vulnerabilities]]></category>
		<category><![CDATA[electronic health records]]></category>
		<category><![CDATA[ethical implications of AI prompt injection]]></category>
		<category><![CDATA[hallucination]]></category>
		<category><![CDATA[healthcare AI security concerns]]></category>
		<category><![CDATA[hidden instruction risks in healthcare AI]]></category>
		<category><![CDATA[language model security vulnerabilities]]></category>
		<category><![CDATA[large language model safety threats]]></category>
		<category><![CDATA[large language models]]></category>
		<category><![CDATA[medical AI failure modes]]></category>
		<category><![CDATA[medical decision support]]></category>
		<category><![CDATA[patient safety]]></category>
		<category><![CDATA[patient safety and AI prompt contamination]]></category>
		<category><![CDATA[prompt injection]]></category>
		<category><![CDATA[prompt injection in clinical AI]]></category>
		<category><![CDATA[provenance]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=205623</guid>

					<description><![CDATA[Researchers argue that prompt injection, which hijacks clinical AI systems through hidden instructions in medical records, should be formally classified as a patient safety hazard.]]></description>
										<content:encoded><![CDATA[<p>Artificial intelligence in medicine has spent the past decade under scrutiny for the failures everyone can see: a model that misreads a scan, a chatbot that produces a confident but wrong diagnosis, an algorithm that performs worse for one patient population than another. A new letter in the Annals of Biomedical Engineering argues that the most dangerous failure mode may be the one nobody notices, because it does not look like a failure at all. Ethan Waisberg of the University of Cambridge and Joseph W. Guarnieri of the Blue Marble Space Institute of Science contend that prompt injection, the technique of smuggling hidden instructions into the text a language model reads, should be classified as a patient safety hazard with a formal threat model, not dismissed as a technical curiosity confined to security conferences.</p>
<p>The core of their argument rests on a property of current large language model architectures that is easy to state and hard to fix. A model such as GPT-4 or Llama receives an undifferentiated stream of tokens. The words typed by a clinician, the text extracted from a referral letter, the contents of a patient&#8217;s portal message, and any instructions embedded by a system designer all arrive as one continuous sequence. The architecture has no mechanism for distinguishing content that carries authority from content that does not. When a model follows an instruction that neither the clinician wrote nor can see, it is not malfunctioning in the usual sense. It is performing exactly as instructed, by an instruction that entered the context window from the outside world.</p>
<p>This is what separates prompt injection from the failure modes that dominate clinical AI safety discussions. Accuracy, bias, and hallucination all describe a model failing at its assigned task, and each has spawned a mature evaluation culture of benchmarks, audits, and regulatory checkpoints. Prompt injection describes the opposite condition: the model succeeding at a task nobody assigned to it. That inversion matters because the entire apparatus of clinical validation is built to detect poor performance, not to detect a model that has been quietly redirected. A safety evaluation that tests whether an AI summarizer produces faithful summaries tells you nothing about what happens when a malicious string inside a scanned document tells the model to omit a critical allergy or to append a reassuring but false statement.</p>
<p>Medicine is particularly exposed to this attack surface because of how clinical records are assembled. The letter emphasizes that the medical record is not a curated, institution-controlled corpus. It is a confluence of material originating outside the hospital walls: referral correspondence from other practices, patient-entered messages, external imaging reports, scanned documents of uncertain provenance, and records acquired elsewhere and pasted into the chart. Every one of those channels is an entry point for text that an adversary can craft. A referral letter could contain a sentence invisible to human readers but legible to a model. A patient message could carry a benign-looking request that doubles as an instruction to the summarization system processing the inbox. Scanned paperwork, where optical character recognition converts pixels into tokens, offers an especially wide aperture because no human will ever read the raw text the model consumes.</p>
<p>The empirical evidence that this vulnerability is real rather than theoretical has accumulated rapidly. A 2025 study in JAMA Network Open demonstrated that large language models providing medical advice can be manipulated through prompt injection to produce harmful recommendations. In the same year, researchers reported in Nature Communications that adversarial prompts and fine-tuning attacks threaten medical large language models systematically, and a separate Nature Communications study showed prompt injection attacks succeeding against vision language models in oncology, the multimodal systems designed to interpret pathology slides and clinical images alongside text. A Nature Medicine paper added a further dimension, showing that medical large language models are vulnerable to data-poisoning attacks, in which corruption is introduced during training rather than at inference time. Together, these findings suggest that the injection problem spans text, images, and the training pipeline itself.</p>
<p>The threat grows sharper as medicine moves from language models that answer questions to agentic AI systems that take actions. Waisberg and Guarnieri, who have previously written about delegation and supervision in clinical AI agents, point out that an agent designed to draft orders, schedule appointments, triage messages, or query the electronic health record does not merely generate text; it converts text into consequences. A prompt injection that redirects a chatbot might produce a wrong answer. A prompt injection that redirects an agent with write access to a record system, a prescribing interface, or a lab-ordering pipeline can produce a wrong action, executed automatically and possibly at scale. The authors&#8217; earlier work on correlated failure is relevant here: when many clinical decisions are delegated to systems built on the same foundation models, a single effective injection technique can propagate across institutions that believed themselves independent.</p>
<p>Why can&#8217;t the problem simply be prompted away? The letter is direct on this point: improved prompting and input filtering do not address the vulnerability. Telling a model to ignore hidden instructions relies on the same mechanism that makes it vulnerable in the first place, namely treating all text as instructions to weigh. Input filtering fares little better, because the boundary between legitimate clinical content and malicious payload is semantic rather than syntactic; a sentence that says &#8216;the patient reports that all previous instructions should be disregarded&#8217; is grammatically indistinguishable from ordinary patient prose. The OWASP Foundation has recognized the severity of the issue by listing prompt injection among the top risks for large language model applications in its 2026 guidance, but awareness alone does not restore an authority signal that the architecture never had.</p>
<p>What would a workable response look like? The authors outline three pillars. The first is provenance-aware context handling: systems should track where every token in the context window came from and treat externally sourced text as untrusted data rather than as instruction-bearing content, engineering the authority distinction that the architecture lacks. The second is restricted privileges for irreversible actions. An AI system should never hold, in a single context, both the ability to be influenced by untrusted input and the authority to perform actions that cannot be undone, such as ordering medication or altering a legal record; human confirmation gates must sit between untrusted text and irreversible consequence. The third is adversarial testing before deployment, treating prompt injection the way aviation treats engine failure, as a scenario to be probed systematically before patients are exposed, rather than discovered in the field.</p>
<p>The regulatory dimension is already taking shape. The European Union&#8217;s Artificial Intelligence Act, Regulation 2024/1689, establishes harmonized rules for high-risk AI systems, and clinical decision-support tools fall squarely within that category. The letter&#8217;s contribution to that conversation is conceptual: prompt injection should be treated as a patient safety hazard in the same register as medication error or device malfunction, which means it belongs in risk assessments, incident reporting systems, and pre-market validation requirements, not only in cybersecurity frameworks. Whether hospitals, vendors, and regulators converge on that framing in time for the wave of agentic clinical deployments now in development may determine whether the first large-scale prompt injection incident in medicine is a contained near-miss or a patient harm that reshapes the field.</p>
<p><strong>Subject of Research:</strong> Prompt injection attacks on large language models and agentic AI in clinical medicine</p>
<p><strong>Article Title:</strong> Prompt Injection in Clinical Artificial Intelligence Systems: The Emerging Security Challenge of Large Language Models and Agentic AI</p>
<p><strong>Article References:</strong> Waisberg, E., &amp; Guarnieri, J. W. (2026). Prompt Injection in Clinical Artificial Intelligence Systems: The Emerging Security Challenge of Large Language Models and Agentic AI. <em>Annals of Biomedical Engineering</em>. <a href="https://doi.org/10.1007/s10439-026-04376-3" rel="noopener noreferrer">https://doi.org/10.1007/s10439-026-04376-3</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10439-026-04376-3" rel="noopener noreferrer">10.1007/s10439-026-04376-3</a></p>
<p><strong>Keywords:</strong> prompt injection, large language models, clinical AI, patient safety, agentic AI, AI security, adversarial attacks, electronic health records, medical decision support, AI regulation, provenance, hallucination</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">205623</post-id>	</item>
	</channel>
</rss>
