<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>adversarial examples &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/adversarial-examples/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Mon, 12 Oct 2026 20:06:38 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>adversarial examples &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>New AI Defense MAPLE Cleans Adversarial Images and Reshapes Decision Boundaries</title>
		<link>https://scienmag.com/new-ai-defense-maple-cleans-adversarial-images-and-reshapes-decision-boundaries/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Mon, 12 Oct 2026 20:06:38 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[adversarial defense]]></category>
		<category><![CDATA[adversarial example detection and removal]]></category>
		<category><![CDATA[adversarial examples]]></category>
		<category><![CDATA[adversarial image defense]]></category>
		<category><![CDATA[black-box adversarial attack defense strategies]]></category>
		<category><![CDATA[black-box robustness]]></category>
		<category><![CDATA[deep learning security]]></category>
		<category><![CDATA[deep neural network robustness improvements]]></category>
		<category><![CDATA[face recognition model protection]]></category>
		<category><![CDATA[image classification]]></category>
		<category><![CDATA[image denoising for adversarial robustness]]></category>
		<category><![CDATA[image purification]]></category>
		<category><![CDATA[logit-edge calibration for robust classification]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[manifold-aligned]]></category>
		<category><![CDATA[manifold-aligned purification in neural networks]]></category>
		<category><![CDATA[MAPLE]]></category>
		<category><![CDATA[MAPLE method for adversarial attack mitigation]]></category>
		<category><![CDATA[margin calibration]]></category>
		<category><![CDATA[medical image analysis security]]></category>
		<category><![CDATA[neural network decision boundary reshaping]]></category>
		<category><![CDATA[neural networks]]></category>
		<category><![CDATA[open-access AI security research]]></category>
		<category><![CDATA[transferable attacks]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=265899</guid>

					<description><![CDATA[Researchers have developed MAPLE, a black-box adversarial defense framework that jointly purifies adversarial images and recalibrates the classifier's decision margins to withstand transferable attacks.]]></description>
										<content:encoded><![CDATA[<p>Deep neural networks now power everything from face recognition to medical image analysis, yet a tiny, carefully crafted nudge to an input image can make them fail spectacularly. These manipulated inputs, known as adversarial examples, are nearly invisible to the human eye but can flip a classifier&#8217;s output with alarming reliability. A newly published study in Complex &amp; Intelligent Systems proposes a fresh line of defense called MAPLE, short for Manifold-Aligned Purification with Logit-Edge Calibration, which tackles the problem by combining two complementary strategies: cleaning the corrupted image and then adjusting the classifier itself so that leftover traces of the attack lose their power. The work, authored by Ning Zhou of Xinxiang University and Peng Yi of Songshan Laboratory, was published on 12 October 2026 as an open-access article.</p>
<p>The starting point for the research is a candid assessment of where existing black-box defenses fall short. Most practical defenses operate without any knowledge of the attacker&#8217;s model, a setting known as the black-box regime, and they typically rely on input transformation. The idea is simple: before the image reaches the classifier, pass it through a denoising or purification network that strips away the adversarial perturbation. If the cleaning succeeds, the classifier sees something close to the original image and produces the correct label. In practice, however, this pipeline is fragile, because images live on a complicated, high-dimensional manifold, and perfectly recovering a clean image from an adversarially corrupted one is extremely difficult. Even a small residual perturbation, invisible to a casual observer, can still sit on the wrong side of a decision boundary and cause a misclassification.</p>
<p>MAPLE&#8217;s authors argue that this is the crux of the issue: purification and classification have traditionally been treated as separate problems, with the purifier doing its best and the classifier simply consuming whatever comes out. The new framework instead couples the two components so that each one improves the other. The system consists of two modules. The first is a Semantic Purification Network, or SPN, built as a fully convolutional network whose job is to transform adversarial inputs into images that are semantically consistent with their true class. The second is a Margin Calibration Classifier, or MCC, which begins as a copy of the target classifier that the defender wants to protect. Initializing from the target classifier matters, because it means the calibrated model retains the original network&#8217;s learned knowledge rather than starting from scratch.</p>
<p>The training procedure unfolds as a cyclic co-calibration between these two modules, and this is where the technical novelty lies. In the first phase, the Margin Calibration Classifier guides the Semantic Purification Network. Because the MCC is initialized from the target classifier, its outputs provide a meaningful signal about which purified images are classification-consistent, meaning images that the classifier would label correctly. The SPN learns to push adversarial inputs toward regions of the image manifold that are not merely visually plausible but actively aligned with the correct class from the classifier&#8217;s perspective. This manifold-aligned objective is what gives the method its name: rather than trying to reconstruct the exact original pixel values, the purifier aims to land the input in a region of the manifold where the classifier&#8217;s semantics are unambiguous.</p>
<p>Once the purifier has been trained in this way, the roles reverse. The SPN now processes adversarial examples and hands the resulting purified images to the Margin Calibration Classifier, which uses them to recalibrate its own decision geometry. The key insight is that even after purification, some adversarial residue may remain, clustering near the edges of decision regions. Instead of ignoring these residual adversarial regions, the MCC deliberately reshapes its local decision boundaries around them, enlarging the classification margin in the neighborhoods where attacks are most likely to leave traces. In effect, the classifier learns to build a wider safety buffer around each class in exactly the places where the purification process is least reliable.</p>
<p>These two phases are not performed once and forgotten. They are repeated in a cycle: the classifier guides purification, the purified outputs then guide classifier calibration, and the improved classifier in turn produces better guidance for purification. Through this progressive loop, the defense pipeline simultaneously suppresses adversarial perturbations and expands the local classification margin. The authors describe this as enabling the system to progressively suppress perturbations while enlarging the margin, a formulation that treats robustness as an emergent property of the interaction between the two modules rather than the property of either one alone.</p>
<p>To evaluate the framework, the researchers turned to two widely used image classification benchmarks, CIFAR-10 and Mini-ImageNet. These datasets are standard proving grounds for adversarial robustness research because they are small enough to permit extensive experimentation while still capturing the essential difficulty of visual recognition. The evaluation focused on transferable adversarial attacks, the most realistic threat model for black-box defense. In a transfer attack, an adversary trains or queries a surrogate model, crafts adversarial examples against it, and then transfers those examples to the victim model, hoping the perturbations generalize across models. Defending against such attacks without ever seeing the attacker&#8217;s model is precisely the black-box scenario that input-transformation defenses are designed for.</p>
<p>According to the published results, MAPLE consistently outperformed previous mainstream methods under diverse black-box attacks on both benchmarks. The authors position the framework as an effective and practical defense paradigm for transferable adversarial attacks, a notable claim in a field where many proposed defenses prove brittle once evaluated against adaptive or transfer-based adversaries. The practical orientation of the design also deserves emphasis: because the Margin Calibration Classifier is initialized from the target classifier, deploying MAPLE does not require training a robust model from the ground up, and the fully convolutional architecture of the purifier makes it a natural drop-in component in an existing inference pipeline.</p>
<p>Beyond the specific benchmark numbers, the conceptual contribution of the work may prove its most lasting element. By framing adversarial defense as a joint problem of manifold alignment and margin calibration, the study highlights a weakness in the prevailing paradigm, in which purification is expected to be perfect and the classifier is left untouched. The cyclic co-calibration scheme suggests a more forgiving and arguably more realistic contract: the purifier does not need to recover the clean image exactly, because the classifier has been explicitly hardened against the imperfections that remain. This division of labor mirrors a broader trend in machine learning security, where robustness emerges from system-level design rather than from any single magic component.</p>
<p>The research was financially supported by the Science and Technology Research Project of Henan Province of China under grant number 252102521061, and the authors declare no conflicts of interest relevant to the work. The article is published open access under a Creative Commons license, making the full technical details available to the security community. As adversarial threats continue to shadow the deployment of deep learning in safety-critical domains, approaches like MAPLE, which acknowledge the limits of purification and compensate for them at the classifier level, offer a template for defenses that are engineered for the messy reality of imperfect recovery rather than the ideal of a perfectly clean input.</p>
<p><strong>Subject of Research:</strong> Black-box adversarial defense for deep neural networks using joint image purification and decision margin calibration</p>
<p><strong>Article Title:</strong> MAPLE: manifold-aligned purification with logit-edge calibration for robust black-box adversarial defense</p>
<p><strong>Article References:</strong> Zhou, N., &amp; Yi, P. (2026). MAPLE: manifold-aligned purification with logit-edge calibration for robust black-box adversarial defense. <em>Complex &amp;amp; Intelligent Systems</em>. <a href="https://doi.org/10.1007/s40747-026-02538-3" rel="noopener noreferrer">https://doi.org/10.1007/s40747-026-02538-3</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s40747-026-02538-3" rel="noopener noreferrer">10.1007/s40747-026-02538-3</a></p>
<p><strong>Keywords:</strong> adversarial examples, adversarial defense, deep learning security, black-box robustness, image purification, margin calibration, neural networks, image classification, transferable attacks, machine learning, MAPLE, manifold-aligned</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">265899</post-id>	</item>
		<item>
		<title>AI Network Defenses Face a Hidden Weakness: Adversarial Attacks That Travel Between Models</title>
		<link>https://scienmag.com/ai-network-defenses-face-a-hidden-weakness-adversarial-attacks-that-travel-between-models/</link>
		
		<dc:creator><![CDATA[Hailey Crawford]]></dc:creator>
		<pubDate>Thu, 01 Oct 2026 13:08:43 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[adversarial examples]]></category>
		<category><![CDATA[adversarial examples in network traffic analysis]]></category>
		<category><![CDATA[adversarial network attack detection]]></category>
		<category><![CDATA[adversarial training]]></category>
		<category><![CDATA[adversarial training for network security]]></category>
		<category><![CDATA[cybersecurity]]></category>
		<category><![CDATA[deep learning]]></category>
		<category><![CDATA[deep learning cybersecurity challenges]]></category>
		<category><![CDATA[enhancing network defenses against adversarial attacks]]></category>
		<category><![CDATA[evaluating AI network security resilience]]></category>
		<category><![CDATA[evasion attacks]]></category>
		<category><![CDATA[F1-score]]></category>
		<category><![CDATA[generative adversarial networks]]></category>
		<category><![CDATA[generative adversarial networks for cyber defense]]></category>
		<category><![CDATA[intrusion detection system]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[machine learning network security]]></category>
		<category><![CDATA[multimodal intrusion detection systems]]></category>
		<category><![CDATA[multimodal learning]]></category>
		<category><![CDATA[network security]]></category>
		<category><![CDATA[robustness of AI-based network defenses]]></category>
		<category><![CDATA[transferability]]></category>
		<category><![CDATA[transferability of adversarial attacks in AI]]></category>
		<category><![CDATA[vulnerabilities in AI-powered intrusion detection]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=222878</guid>

					<description><![CDATA[Researchers in Vietnam show that multimodal intrusion detection systems hardened with adversarial training can resist transferable adversarial examples generated by GANs, achieving the best F1 score among tested defenses.]]></description>
										<content:encoded><![CDATA[<p>Invisible tweaks to network traffic can fool the artificial intelligence systems that guard modern computer networks, and researchers in Vietnam have now mapped just how far that vulnerability spreads. A team at the VNUHCM-University of Information Technology, publishing in Mobile Networks and Applications, has put multimodal machine-learning intrusion detection systems through one of the most demanding stress tests yet devised: a barrage of adversarial examples generated by generative adversarial networks and deliberately engineered to transfer between different models. Their findings expose both the fragility of current defenses and a promising path toward hardening them, in the form of a strategy the authors call MAT, which combines multimodal learning with adversarial training.</p>
<p>Intrusion detection systems sit at the heart of network security. They watch the ceaseless stream of packets flowing through a network and flag the ones that look malicious, distinguishing botnet commands, denial-of-service floods, port scans and brute-force login attempts from ordinary traffic. Over the past decade, the field has largely abandoned hand-written rules in favor of machine learning and deep learning models that learn the statistical fingerprints of attack traffic from labeled datasets. These models routinely achieve impressive accuracy on standard benchmarks such as CIC-IDS2017, a widely used collection of realistic attack and benign traffic compiled by researchers at the University of New Brunswick. But benchmark accuracy tells only part of the story, because it measures performance against attacks that look exactly like the ones the model was trained on.</p>
<p>The deeper problem is adversarial machine learning. An adversarial example is an input that has been perturbed with tiny, carefully calculated changes, so small that a human analyst would notice nothing amiss, yet large enough to push the input across a decision boundary inside the model. In image recognition, this means a panda photograph becomes a gibbon with a few dozen altered pixels. In network intrusion detection, it means a packet stream corresponding to a real attack is modified just enough that the classifier labels it benign. The attacker does not need to change what the malware does; it only needs to change how the traffic looks to the detector. Because network features are numeric and structured, attackers can manipulate fields such as flow durations, byte counts and inter-arrival times in ways that preserve the attack&#8217;s function while destroying its statistical signature.</p>
<p>What makes this threat especially insidious is transferability. An attacker rarely knows the exact architecture, weights or training data of the defender&#8217;s model, so a direct attack is often impossible. Transferable adversarial examples solve this problem: they are crafted against a surrogate model that the attacker controls, and then deployed against the real target. If the two models learn similar decision boundaries, the perturbations that fool one often fool the other. Prior research, including surveys of adversarial machine learning for intrusion detection and empirical studies of black-box transferability in cybersecurity, has shown that this cross-model leakage is a genuine and practical danger. It means that a defense validated only against attacks crafted on the defender&#8217;s own model may offer a false sense of security against a realistic adversary working blind.</p>
<p>The Vietnamese team, led by Phan The Duy and Van-Hau Pham along with colleagues including Cao The Thuan, Doan Ngoc Nhu Quynh, Truong Thi Hoang Hao, Doan Minh Trung and Nghi Hoang Khoa, attacked the problem from two directions at once. First, they evaluated how well multimodal learning-based intrusion detection systems hold up against transferable adversarial examples produced by generative adversarial networks. GANs pit two neural networks against each other, a generator that produces candidate inputs and a discriminator that tries to distinguish them from real data, and this adversarial dynamic makes them a natural engine for producing deceptive network traffic. Second, the researchers integrated adversarial training into their detection pipeline, exposing the model to perturbed samples during training so that it learns to classify attack patterns even when they carry small perturbations designed to hide them.</p>
<p>Multimodality is the other half of the defense. Rather than relying on a single view of network traffic, a multimodal IDS fuses information from multiple sources or feature representations, much as multimodal deep learning has improved diagnosis of Alzheimer&#8217;s disease from combined imaging and clinical data, or breast cancer classification from fused mammogram and ultrasound features. In the intrusion detection context, multimodal architectures can combine flow-level statistics with payload characteristics or sequential patterns, giving the detector a richer description of each connection. The intuition is that an attacker who evades one feature space may still be caught in another, and that fused representations generalize better to unknown attacks. Recent work on multimodal and multi-view intrusion detection, including approaches for vehicle CAN bus security and few-shot detection, has supported this intuition, but robustness against transferable adversarial attacks had not been systematically evaluated.</p>
<p>The headline result of the new study is the MAT strategy, short for multimodal adversarial training. Under second-round adversarial attack conditions, meaning scenarios in which the detector faces a renewed wave of adversarial examples after its initial defenses, MAT achieved near-perfect detection rates across all attack types and posted the highest overall F1 score of any system tested, at 0.7595. The F1 score, the harmonic mean of precision and recall, is a demanding metric because it penalizes both false alarms and missed detections; a high F1 under adversarial pressure means the system catches attacks without drowning analysts in false positives. MAT substantially outperformed all baseline models in the comparison, demonstrating that the combination of multimodal fusion and adversarial training is more than the sum of its parts.</p>
<p>The authors are candid that the results, while strong, are not as remarkable as one might ultimately want. An F1 score of 0.7595, though the best in the study, still leaves room for improvement, and the gap between near-perfect per-attack detection and the overall score reflects the genuine difficulty of the problem. Adversarial training is expensive, because it requires generating and incorporating adversarial examples throughout the training process, and it tends to harden a model against the specific perturbation families it has seen. The transferability experiments underscore why this matters: defenses must be tested against examples crafted on other models, not merely against attacks the defender can simulate directly. By benchmarking multimodal IDS under exactly these conditions, the study provides a more realistic picture of deployment readiness than standard benchmark evaluations allow.</p>
<p>The broader significance of the work lies in its reframing of what a robust intrusion detector must do. The literature on adversarial attacks against network intrusion detection has grown rapidly, with studies demonstrating evasion attacks on practical systems, detection mechanisms such as MANDA that spot adversarial inputs, ensemble defenses like ELAT that combine multiple learners with adversarial training, and transfer-learning-based multi-adversarial detection approaches. Each of these defenses addresses one facet of the problem. The multimodal adversarial training strategy adds a complementary dimension: instead of asking whether a single model can resist a single attack family, it asks whether a system that sees traffic through several lenses at once, and has been trained under adversarial pressure, can resist attacks that were designed elsewhere and transferred in. The answer, according to the experiments, is a qualified yes, with meaningful gains over every baseline examined.</p>
<p>For network operators, the message is sobering but actionable. Machine learning-based IDS are not plug-and-play fortresses; they are statistical systems with exploitable geometry, and an adversary armed with a surrogate model and a GAN can degrade them. The study suggests that organizations deploying learned detectors should incorporate adversarial training into their model lifecycle and consider multimodal architectures that fuse multiple feature views, raising the cost of crafting effective perturbations. For researchers, the work opens a clear agenda: better fusion strategies, cheaper adversarial training, and evaluation protocols that treat transferability as the default threat model rather than an afterthought. The research was supported by the VNU-HCM Scientific Research Support Fund under grant NCM2025-26-01, and the authors note that their code is available from the corresponding author on reasonable request. As networks grow more complex and attackers grow more sophisticated, the contest between deception and detection will only intensify, and studies like this one mark out the terrain on which it will be fought.</p>
<p><strong>Subject of Research:</strong> Robustness of multimodal machine-learning intrusion detection systems against transferable GAN-generated adversarial evasion attacks</p>
<p><strong>Article Title:</strong> Evaluating the Robustness and Transferable Adversarial Example Resistance of Multimodal Learning-based Intrusion Detection Systems against Evasion Attacks</p>
<p><strong>Article References:</strong> Evaluating the Robustness and Transferable Adversarial Example Resistance of Multimodal Learning-based Intrusion Detection Systems against Evasion Attacks. (n.d.). <a href="https://doi.org/10.1007/s11036-026-02522-8" rel="noopener noreferrer">https://doi.org/10.1007/s11036-026-02522-8</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s11036-026-02522-8" rel="noopener noreferrer">10.1007/s11036-026-02522-8</a></p>
<p><strong>Keywords:</strong> intrusion detection system, adversarial examples, adversarial training, multimodal learning, generative adversarial networks, evasion attacks, network security, transferability, deep learning, machine learning, cybersecurity, F1 score</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">222878</post-id>	</item>
		<item>
		<title>Twisting Molecules Just Enough: Physically Valid Adversarial Attacks Expose Weak Spots in 3D AI Chemistry Models</title>
		<link>https://scienmag.com/twisting-molecules-just-enough-physically-valid-adversarial-attacks-expose-weak-spots-in-3d-ai-chemistry-models/</link>
		
		<dc:creator><![CDATA[Bethany Barker]]></dc:creator>
		<pubDate>Thu, 01 Oct 2026 07:57:52 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[3D molecular prediction]]></category>
		<category><![CDATA[3D molecular property prediction]]></category>
		<category><![CDATA[3D molecular structure validation]]></category>
		<category><![CDATA[adversarial attacks in chemistry]]></category>
		<category><![CDATA[adversarial examples]]></category>
		<category><![CDATA[adversarial examples in molecular modeling]]></category>
		<category><![CDATA[AI model robustness in chemistry]]></category>
		<category><![CDATA[chemically realistic adversarial examples]]></category>
		<category><![CDATA[computational chemistry]]></category>
		<category><![CDATA[drug discovery]]></category>
		<category><![CDATA[equivariant neural networks]]></category>
		<category><![CDATA[force fields]]></category>
		<category><![CDATA[geometric neural networks for molecules]]></category>
		<category><![CDATA[Graph Neural Networks]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[molecular conformers]]></category>
		<category><![CDATA[molecular geometry perturbation]]></category>
		<category><![CDATA[physically plausible molecule distortions]]></category>
		<category><![CDATA[QM9]]></category>
		<category><![CDATA[robustness benchmark]]></category>
		<category><![CDATA[robustness of machine learning in drug discovery]]></category>
		<category><![CDATA[systematic fooling of 3D AI models]]></category>
		<category><![CDATA[torsion perturbations]]></category>
		<category><![CDATA[vulnerability of AI chemistry models]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=221206</guid>

					<description><![CDATA[Researchers have developed an adversarial attack framework that rotates molecular torsion angles within strict physical validity constraints, revealing consistent vulnerabilities in leading 3D molecular prediction models.]]></description>
										<content:encoded><![CDATA[<p>Machine learning models that predict the properties of molecules in three dimensions have become indispensable tools in modern chemistry and drug discovery. These networks take the coordinates of atoms, the bonds between them, and increasingly sophisticated geometric architectures, and from that information they estimate everything from quantum-chemical energies to biological activity. But a new study published in the International Journal of Machine Learning and Cybernetics raises an uncomfortable question: how well do these models hold up when the molecules they are shown are subtly, yet legitimately, distorted? Junhyeong Lee of the Ground Operations Command of the Republic of Korea Army and Hyun Kwon of the Korea Military Academy present a framework for generating adversarial examples for 3D molecular predictors that remain physically plausible, and their results suggest that even chemically realistic perturbations can systematically fool state-of-the-art architectures.</p>
<p>Adversarial examples are a well-known phenomenon in computer vision, where imperceptible changes to an image can cause a neural network to misclassify it with high confidence. In molecular machine learning, the analogue would be a molecule whose geometry has been nudged in ways that do not change its chemical identity but that cause a property predictor to produce wildly wrong answers. Previous work on adversarial attacks in this domain has typically taken one of two routes: applying unconstrained perturbations to atomic coordinates, or modifying the discrete molecular graph itself by adding, deleting, or rewiring bonds. Both approaches have a serious flaw. The resulting structures are often chemically nonsensical, with atoms overlapping, bonds stretched to impossible lengths, or molecular frameworks that could never exist. If an attack produces an implausible molecule, the question arises whether the model&#8217;s failure is meaningful at all, since such a structure would never appear in real applications.</p>
<p>Lee and Kwon&#8217;s contribution is to constrain the attack to a space that chemists trust: torsion angles. Molecules are not rigid objects; they have rotatable bonds, and rotating around a single bond changes the molecule&#8217;s conformation without altering its atom types or its bond connectivity. This is precisely the degree of freedom that distinguishes, for example, an extended from a folded conformer of the same molecule. The researchers use RDKit, the widely adopted open-source cheminformatics toolkit, to identify rotatable bonds, and their attacks operate exclusively by rotating these bonds. The molecular graph remains untouched. Every adversarial example they generate is, by construction, the same molecule, merely presented in a different geometric arrangement that a real molecule could plausibly adopt.</p>
<p>Plausibility, however, is not guaranteed by torsion-only perturbation alone. Rotating a bond can swing one part of a molecule into another, creating steric clashes where atoms occupy the same space, or producing conformations so strained that they would never be populated at any reasonable temperature. To prevent this, the authors enforce hard validity constraints drawn from classical computational chemistry. The first is a van der Waals steric check, which verifies that no two non-bonded atoms come closer than physically permitted given their van der Waals radii, the standard measure of atomic size used since the mid-twentieth century. The second is an energy budget evaluated with established molecular mechanics force fields, MMFF94 and UFF. These force fields assign an energy to any 3D structure based on bond lengths, angles, torsions, and non-bonded interactions, and the attack rejects any candidate conformer whose energy exceeds a defined threshold. The result is that every adversarial example remains thermodynamically accessible, meaning it corresponds to a geometry a real molecule could realistically sample.</p>
<p>Within this constrained framework, the researchers develop two white-box attacks, so called because the attacker has full access to the model&#8217;s internals and gradients. The first, WB-PGD, is a momentum-based projected gradient descent adapted to torsion space. Gradient descent is the workhorse of neural network training, but here it is turned against the model: instead of adjusting parameters to reduce error, the attack adjusts torsion angles to maximize the model&#8217;s prediction error, while a projection step with backtracking pulls any proposed update back into the physically valid region whenever it violates the steric or energetic constraints. The momentum term accumulates gradient information across steps, a technique known to stabilize and strengthen adversarial optimization. The second method, WB-Manifold, serves as a validity-filtered random search baseline: it samples torsion perturbations at random, keeps only those that pass the physical validity filters, and retains whichever candidate most damages the model&#8217;s prediction. Comparing a gradient-guided method against a search-based one reveals how much of the attack&#8217;s power comes from exploiting model gradients rather than simply exploring the conformational space.</p>
<p>The evaluation covers four prominent architectures for 3D molecular property prediction: EGNN, the E(n)-equivariant graph neural network; InvMPNN, an invariant message-passing network; SchNet, a continuous-filter convolutional network that models quantum interactions; and PaiNN, a polarizable attention network that tracks both scalar and vectorial features. These models represent the leading families of geometric deep learning applied to molecules, differing in how they handle rotational symmetry and directional information. The benchmark is derived from QM9, a standard dataset of quantum-chemical properties for small organic molecules, and the authors take particular care to use leak-free data splits, ensuring that the same molecule does not appear in both training and test sets in different conformations, a subtle form of data leakage that can inflate reported performance.</p>
<p>The findings are striking in their consistency. Across all four architectures, prediction error grows steadily as the torsion perturbation budget increases. At a modest budget of 10 degrees of torsional rotation, the mean damage to predictions is already measurable, at roughly 0.01 to 0.02. When the budget is relaxed to 60 degrees, still well within the range of conformational flexibility that real molecules exhibit, the mean damage climbs to 0.04 to 0.05. Meanwhile, the attack success rate, the fraction of molecules for which the attack produces a prediction error above a defined threshold, rises from nearly zero at small budgets to between 15 and 17 percent at the largest budgets tested. Notably, this degradation occurs even though every adversarial conformer passed the steric and energetic validity checks, meaning the models are not simply being shown impossible molecules.</p>
<p>The central lesson the authors draw is that physical constraints alone do not protect 3D molecular predictors from adversarial failure. One might have hoped that restricting attacks to chemically valid conformations would neutralize the threat, since valid conformers of the same molecule should, in principle, be handled correctly by a model that has truly learned the relationship between structure and property. Instead, the consistent error amplification across architectures suggests that these networks rely on geometric cues in ways that are fragile under realistic conformational change. This has practical implications for drug discovery and materials design pipelines, where molecular property predictions guide expensive experimental decisions. A model that is sensitive to which conformer it happens to be shown could produce unreliable rankings of candidate compounds, and adversarial robustness testing offers a way to probe that sensitivity before deployment.</p>
<p>Beyond diagnosing vulnerability, the study establishes torsion-space attacks as a principled robustness benchmark for the field. Because the attacks preserve chemical identity and enforce thermodynamic accessibility, they isolate a specific and meaningful failure mode: sensitivity to conformational geometry within the physically realizable manifold. The authors suggest that future work on 3D molecular machine learning should incorporate such physically valid adversarial evaluation alongside standard accuracy metrics, and that defenses, such as training on diverse conformations or enforcing invariance across the conformational ensemble, can be measured against these attacks. The work was supported by a National Research Foundation of Korea grant funded by the Korean government, and the authors report no competing interests. As machine learning continues to permeate computational chemistry, studies like this one serve as a reminder that the reliability of a predictor cannot be judged by its accuracy on clean data alone; it must also withstand the geometric variability that real molecules present every day.</p>
<p><strong>Subject of Research:</strong> Physically valid adversarial attacks on 3D molecular property prediction models using torsion-space perturbations</p>
<p><strong>Article Title:</strong> Physically valid adversarial examples for 3D molecular prediction</p>
<p><strong>Article References:</strong> Physically valid adversarial examples for 3D molecular prediction. (n.d.). <a href="https://doi.org/10.1007/s13042-026-03321-z" rel="noopener noreferrer">https://doi.org/10.1007/s13042-026-03321-z</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s13042-026-03321-z" rel="noopener noreferrer">10.1007/s13042-026-03321-z</a></p>
<p><strong>Keywords:</strong> adversarial examples, 3D molecular prediction, torsion perturbations, graph neural networks, equivariant neural networks, molecular conformers, force fields, QM9, robustness benchmark, machine learning, computational chemistry, drug discovery</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">221206</post-id>	</item>
		<item>
		<title>Flat Gradients Make Fake Users Deadlier: Smarter Attacks Expose Recommender Vulnerabilities</title>
		<link>https://scienmag.com/flat-gradients-make-fake-users-deadlier-smarter-attacks-expose-recommender-vulnerabilities/</link>
		
		<dc:creator><![CDATA[Denise Maddox]]></dc:creator>
		<pubDate>Sat, 12 Sep 2026 13:03:31 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[adversarial attack efficiency]]></category>
		<category><![CDATA[adversarial examples]]></category>
		<category><![CDATA[adversarial fake users]]></category>
		<category><![CDATA[black box attack on recommendation models]]></category>
		<category><![CDATA[black-box attack]]></category>
		<category><![CDATA[collaborative filtering]]></category>
		<category><![CDATA[data poisoning]]></category>
		<category><![CDATA[digital life influence by recommendation engines]]></category>
		<category><![CDATA[fake user attack success rate]]></category>
		<category><![CDATA[Gowalla]]></category>
		<category><![CDATA[gradient penalty]]></category>
		<category><![CDATA[gradient penalty in recommender systems]]></category>
		<category><![CDATA[loss landscape]]></category>
		<category><![CDATA[machine learning security]]></category>
		<category><![CDATA[MovieLens]]></category>
		<category><![CDATA[RecGP technique]]></category>
		<category><![CDATA[recommendation model deception]]></category>
		<category><![CDATA[Recommendation system vulnerabilities]]></category>
		<category><![CDATA[recommendation systems]]></category>
		<category><![CDATA[recommender system security risks]]></category>
		<category><![CDATA[resource-efficient attack methods]]></category>
		<category><![CDATA[shilling attacks]]></category>
		<category><![CDATA[transfer-based adversarial attacks]]></category>
		<category><![CDATA[transferability]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=194655</guid>

					<description><![CDATA[Researchers have developed RecGP, a gradient penalty method that crafts transferable adversarial fake users by steering them toward flat regions of the loss landscape, boosting attack success rates against unknown recommendation systems.]]></description>
										<content:encoded><![CDATA[<p>Recommendation systems quietly shape much of modern digital life, deciding which films appear on a streaming homepage, which restaurants surface in a navigation app, and which products rise to the top of an online marketplace. Their power rests on a simple assumption: that the behavioral traces users leave behind—ratings, purchases, check-ins—faithfully reflect genuine preferences. A new study published in Data Mining and Knowledge Discovery demonstrates just how fragile that assumption can be. Researchers led by Caihong Wu and Hai Chen have developed a technique called RecGP, short for Recommendation-specific Gradient Penalty, which crafts adversarial fake users that can deceive recommendation models they were never designed to attack. The work, published in the journal&#8217;s September 2026 issue, reports attack success rate improvements of roughly eight percent over existing methods on the Gowalla dataset across eight different target models, while a resource-efficient variant maintains 98 percent of that attack power while cutting GPU memory consumption by 42 percent.</p>
<p>The technique belongs to a family of attacks known as transfer-based adversarial attacks. In such attacks, an adversary cannot peer inside the target recommendation system, which operates as a black box guarded by commercial secrecy. Instead, the attacker builds a surrogate model that mimics the target&#8217;s behavior, trains the surrogate on publicly available data, and then injects carefully constructed fake user profiles designed to manipulate the surrogate&#8217;s recommendations. The hope is that these poisoned profiles will transfer: that when injected into the real, unknown target system, they will produce the same distortion, promoting a chosen item or burying a competitor. This scenario, often called a shilling attack, has been studied since the early days of collaborative filtering, but deep learning has dramatically raised the stakes, because modern neural recommenders are both more powerful and, in some respects, more susceptible to carefully aimed perturbations.</p>
<p>The core insight behind RecGP comes from an unexpected corner of deep learning theory: the geometry of the loss landscape. When an adversarial example is optimized on a surrogate model, it typically settles into a region where the loss surface is sharp—a narrow spike surrounded by steep gradients. Such solutions perform superbly on the surrogate but generalize poorly, because they are exquisitely sensitive to small changes in model parameters. Two recommendation systems, even trained on the same data, will have slightly different internal weights, and an adversarial example perched on a sharp peak will lose its effectiveness under that variation. Flat regions of the loss landscape, by contrast, exhibit small gradients and gentle slopes, meaning the adversarial example&#8217;s effect is stable even when parameters shift between the surrogate and the unknown target. The same flatness principle underlies sharpness-aware minimization, a technique developed to improve model generalization in entirely benign contexts, and the authors adapt it here for offensive purposes.</p>
<p>RecGP operationalizes this insight by adding a gradient penalty to the optimization process that generates fake users. As the attacker searches for adversarial perturbations, the penalty regularizes the magnitude of the gradients, steering the search away from sharp peaks and toward flat basins of the loss surface. In effect, the method asks not merely, &#8216;Which fake user fools this surrogate most effectively?&#8217; but rather, &#8216;Which fake user fools this surrogate in a way that is robust to the inevitable differences between models?&#8217; The authors frame this as a recommendation-specific reformulation, because recommendation data differs fundamentally from the continuous image data where flatness-aware attacks were first explored. A fake user profile in a recommender is not a subtly shifted photograph; it is a discrete collection of interactions, and the attack must respect the semantic structure of that discrete space.</p>
<p>That discrete structure creates a computational challenge, which the team addressed with a second contribution: RecGP-RS, or Recommender Systems Gradient Penalty with Resource-efficient Sampling. Computing true second-order gradient information—needed to assess the flatness of the landscape—is expensive, particularly over the large interaction spaces typical of real-world recommender systems. RecGP-RS sidesteps the cost through semantic-aware neighborhood sampling, which selects representative neighbors of each perturbation in the discrete interaction space while preserving semantic consistency, ensuring that sampled neighbors correspond to plausible user behaviors rather than arbitrary noise. Around these sampled neighbors, the method approximates second-order gradients using first-order interpolation, capturing the essential curvature information at a fraction of the computational price. The result, according to the paper, is a variant that retains 98 percent of the attack efficacy of the full method while reducing GPU memory consumption by 42 percent—a substantial saving that matters when attacks must be staged against large-scale production-like systems.</p>
<p>The empirical evaluation spanned two widely used benchmark datasets: MovieLens-1M, a canonical collection of roughly one million movie ratings maintained by the GroupLens research group, and Gowalla, a location-based social network dataset distributed through the Stanford Network Analysis Project. Across eight target recommendation models, RecGP achieved an average attack success rate improvement of approximately eight percent over existing baseline attack methods on the Gowalla dataset. The target models examined in the broader literature on which this work builds include the standard architectures of the field: neural collaborative filtering, Bayesian personalized ranking, collaborative denoising autoencoders, and matrix factorization approaches, among others. The breadth of improvement across diverse architectures is the transferability claim&#8217;s real substance—an attack that only worked against one model family would be of limited concern, but a method that reliably degrades many different recommenders suggests a structural weakness in how these systems learn from behavioral data.</p>
<p>The practical implications are sobering. Recommendation systems are not merely convenience features; they are revenue engines. A seller who can promote products through injected fake users can distort marketplace competition, and a malicious actor who can suppress content can shape public opinion. Earlier generations of shilling attacks required large volumes of hand-crafted fake profiles and were relatively easy to detect because they followed stereotyped patterns. Learning-based attacks such as the one developed here generate profiles optimized by gradient descent, which can be subtler and harder to flag. The flatness technique makes them more portable across the heterogeneous collection of models that platforms actually deploy, meaning a profile set crafted once could plausibly threaten several services rather than one. The study also notes that RecGP builds on earlier transferability work by the same group, including methods based on Nesterov momentum and multi-model integration and fine-tuning, indicating a sustained research trajectory into how adversarial examples move between recommender architectures.</p>
<p>From a defensive standpoint, the research is valuable precisely because it illuminates the mechanism of failure. If sharp loss regions are what make adversarial examples brittle and flat regions what make them dangerous, then defenders have a concrete signal to target. Detection systems could look for interactions that sit suspiciously in flat regions of the platform&#8217;s own loss surface, or training procedures could incorporate flatness-aware objectives that make recommendation models inherently less sensitive to small numbers of poisoned profiles. The work also joins a broader conversation about loss landscape geometry in machine learning security, echoing findings from computer vision where flat local maxima have been linked to improved adversarial transferability, and from theoretical studies of the embedding principle of loss landscapes in deep neural networks. The transferability problem, once considered a vision-specific curiosity, now demonstrably spans the recommender domain.</p>
<p>The research team, based at Anhui University&#8217;s Key Laboratory of Intelligent Computing and Signal Processing and its Artificial Intelligence Institute, with a collaborator at Tsinghua University, was supported by the National Natural Science Foundation of China and provincial research programs, and used Anhui University&#8217;s high-performance computing platform. Caihong Wu and Hai Chen contributed equally to the work, with Fulan Qian serving as corresponding author. As recommendation systems grow more embedded in commerce, media, and information ecosystems, studies of this kind serve a dual purpose: they hand attackers a sharper tool, but they also hand defenders a clearer map of where the walls are thin. The eight percent gain in attack success reported on Gowalla is not merely a benchmark increment; it is a quantified measure of how much behavioral data alone can be trusted, and a reminder that robustness against adversarial manipulation must be designed into recommendation systems from the ground up rather than bolted on after the fact.</p>
<p><strong>Subject of Research:</strong> Gradient-penalized transferable adversarial attacks on recommendation systems</p>
<p><strong>Article Title:</strong> Recgp: gradient penalization for transferable adversarial attacks in recommendation systems</p>
<p><strong>Article References:</strong> Wu, C., Chen, H., Song, S., Yan, Y., Zhao, S., &amp; Qian, F. (2026). Recgp: gradient penalization for transferable adversarial attacks in recommendation systems. <em>Data Mining and Knowledge Discovery, 40</em>(5), Article 88. <a href="https://doi.org/10.1007/s10618-026-01253-4" rel="noopener noreferrer">https://doi.org/10.1007/s10618-026-01253-4</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10618-026-01253-4" rel="noopener noreferrer">10.1007/s10618-026-01253-4</a></p>
<p><strong>Keywords:</strong> recommendation systems, adversarial examples, gradient penalty, loss landscape, transferability, shilling attacks, collaborative filtering, data poisoning, black-box attack, MovieLens, Gowalla, machine learning security</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">194655</post-id>	</item>
	</channel>
</rss>
