<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>DP-SGD &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/dp-sgd/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Fri, 16 Oct 2026 00:18:54 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>DP-SGD &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>Spiking AI Learns to Fake Brainwaves Without Leaking Your Thoughts</title>
		<link>https://scienmag.com/spiking-ai-learns-to-fake-brainwaves-without-leaking-your-thoughts/</link>
		
		<dc:creator><![CDATA[Cassandra Pierce]]></dc:creator>
		<pubDate>Fri, 16 Oct 2026 00:18:54 +0000</pubDate>
				<category><![CDATA[Medicine]]></category>
		<category><![CDATA[Science News]]></category>
		<category><![CDATA[adversarial neural networks in neuroscience]]></category>
		<category><![CDATA[brain-computer interface privacy solutions]]></category>
		<category><![CDATA[brain-computer interfaces]]></category>
		<category><![CDATA[brain-inspired machine learning]]></category>
		<category><![CDATA[brainwave data security in consumer BCIs]]></category>
		<category><![CDATA[Data Privacy]]></category>
		<category><![CDATA[differential privacy]]></category>
		<category><![CDATA[DP-SGD]]></category>
		<category><![CDATA[EEG]]></category>
		<category><![CDATA[EEG data privacy]]></category>
		<category><![CDATA[ethical considerations in neurodata sharing]]></category>
		<category><![CDATA[federated learning]]></category>
		<category><![CDATA[federated learning for neurodata]]></category>
		<category><![CDATA[formal privacy mathematics in neurotech]]></category>
		<category><![CDATA[generative adversarial networks]]></category>
		<category><![CDATA[motor imagery]]></category>
		<category><![CDATA[neural data anonymization challenges]]></category>
		<category><![CDATA[neuroscience AI]]></category>
		<category><![CDATA[privacy-preserving EEG datasets]]></category>
		<category><![CDATA[Rényi differential privacy]]></category>
		<category><![CDATA[spiking generative adversarial networks]]></category>
		<category><![CDATA[spiking neural networks]]></category>
		<category><![CDATA[synthetic brainwave generation]]></category>
		<category><![CDATA[synthetic data]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=279618</guid>

					<description><![CDATA[Researchers at Lakehead University have built a federated spiking GAN that generates realistic synthetic EEG data for brain-computer interfaces while formally protecting individual privacy through Rényi differential privacy.]]></description>
										<content:encoded><![CDATA[<p>Every time you slip on an EEG headset to play a neurogame, steer a virtual wheelchair, or test a brain-controlled interface, your brain is broadcasting secrets. The electrical ripples picked up by electrodes on your scalp are not just abstract signals of left hand versus right hand; they carry physiological fingerprints that are specific to you, and researchers have long struggled to share EEG datasets without exposing the people inside them. A new study from Lakehead University, published in Frontiers in Human Neuroscience, proposes an unusual alliance of brain-inspired computing, adversarial machine learning, and formal privacy mathematics to solve the problem: a federated spiking generative adversarial network that manufactures synthetic brainwaves that behave like the real thing while mathematically refusing to betray any individual.</p>
<p>The stakes are growing quickly. Brain-computer interfaces, or BCIs, are moving out of laboratories and into consumer gaming, human augmentation, and virtual reality, where streams of neural data are collected continuously from ordinary users. Encryption protects data in transit and anonymization strips obvious identifiers, but neither helps once the data is being analyzed, and studies have shown that even anonymized EEG can still expose identifiable attributes. Differential privacy offers a formal guarantee, but bolting it onto a generative model usually degrades the quality of the output. The challenge the researchers set out to address was precise: generate synthetic EEG that protects sensitive attributes while preserving the temporal features that downstream classifiers actually depend on.</p>
<p>The team&#8217;s answer combines three ideas that rarely appear together. First, the generator of their GAN is not a conventional convolutional network but a spiking neural network, or SNN, built on a modified Leaky Integrate-and-Fire neuron model. Spiking neurons communicate through discrete electrical pulses rather than continuous activations, which makes them naturally suited to capturing the temporal dynamics of EEG signals, and prior work has shown they can match state-of-the-art artificial neural networks on EEG classification while consuming far less power. Second, the discriminator that judges whether samples are real or fake is a conventional artificial neural network, chosen for its efficiency at classification. Third, the whole training process runs under a federated learning framework, so raw EEG never leaves the client devices that hold it; only model updates travel to a central server, which merges them using federated averaging.</p>
<p>The privacy guarantee itself comes from differentially private stochastic gradient descent applied to the discriminator. During local training, gradients are computed for each individual EEG example, clipped to a fixed L2 norm of 1.0, and then perturbed with Gaussian noise whose scale is controlled by a noise multiplier. Because these noisy updates repeat across many training steps, the team accounts for the accumulating privacy loss using Rényi differential privacy, a refinement of standard differential privacy that composes more tightly over repeated randomized operations. The result is converted into an (epsilon, delta) guarantee, with delta set to 10 to the power of minus 3 in the experiments. Notably, the researchers draw a careful line between this formal mechanism and a second source of randomness: the temporally correlated noise injected into the generator&#8217;s membrane potentials. Because that noise is autoregressive, with consecutive values statistically dependent, it cannot be counted as a sequence of independent Gaussian mechanisms, so it is treated as a tool for shaping temporal dynamics rather than as part of the privacy budget.</p>
<p>The generator itself is a study in biological plausibility. A 100-dimensional latent vector, concatenated with a class label embedding, passes through three fully connected layers, and after each layer Leaky Integrate-and-Fire neurons simulate membrane potential dynamics: the potential leaks toward a resting state, integrates incoming current, and fires a spike when it crosses a threshold, at which point it resets. Double exponential synaptic filters then convert the discrete spike trains into smooth, continuous signals that mimic the graded outputs of real neural tissue. The final layer scales the output to the normalized range, producing three channels of 1,000 data points each, corresponding to the C3, Cz, and C4 electrodes over the sensorimotor cortex, the positions most informative for imagined movement.</p>
<p>To test the framework, the researchers used the BCI Competition IV Dataset 2a, which contains EEG recordings from nine subjects performing four motor imagery tasks: imagining left hand, right hand, foot, and tongue movements. Each subject&#8217;s data was partitioned equally among four simulated clients, each of which trained its local spiking GAN for four local epochs with mini-batches of eight samples. After local training, each client&#8217;s contribution to the global model was quantified by measuring how well its local discriminator separated real from generated spike trains, and the server aggregated parameters with weights proportional to these contribution scores rather than averaging uniformly. The entire federated environment, clients and server alike, was simulated on a single laptop, a pragmatic choice that the authors acknowledge differs from truly distributed deployments.</p>
<p>The comparisons were demanding. The team modified four established time-series generative models, TimeGAN, RCGAN, CRNN-GAN, and Clare-GAN, to operate under the same Rényi differential privacy framework, creating RDP-TimeGAN, RDP-RCGAN, RDP-CRNN-GAN, and RDP-Clare-GAN as baselines. Synthetic data from each method was then fed into two well-known EEG classifiers, EEGNet and ATCNet, across five evaluation scenarios ranging from training on real data augmented with synthetic samples to training entirely on synthetic data and testing on real recordings. Across most privacy budget settings, the proposed method achieved the highest accuracy, reaching approximately 0.83 with ATCNet and 0.78 to 0.81 with EEGNet, while the best baseline, RDP-TimeGAN, hovered around 0.76. The proposed approach also remained more stable as the noise multiplier increased, whereas the baselines fluctuated more widely.</p>
<p>Two findings stand out for anyone thinking about real deployments. First, halving the real training data and replacing it with synthetic samples maintained or slightly improved classification accuracy, which suggests the framework could safely augment scarce EEG datasets in privacy-sensitive applications such as BCI games. Second, when classifiers trained only on synthetic data were tested on real recordings, the proposed method degraded less than its competitors, indicating that the synthetic brainwaves retain genuinely transferable structure rather than superficial statistical resemblance. Fidelity was further verified with dynamic time warping, which measures how closely synthetic signals follow the temporal contours of real ones, and spectral similarity scores, which compare power spectral density; both showed high fidelity despite considerable variation between subjects, hinting that subject-specific modeling could push quality further.</p>
<p>Privacy was stress-tested as well. The team ran a full black-box attack, in which an adversary sees only the synthetic data and tries to determine whether a specific real recording was used in training, by checking whether the closest synthetic sample falls within a threshold distance of the target. At low epsilon values the model resisted the attack with few successful inferences, while higher epsilon values, as differential privacy theory predicts, made it more vulnerable. An ablation study confirmed that no single component deserves the credit: replacing the spiking generator with a conventional CNN generator, removing federated training, or stripping out the privacy mechanism each degraded the privacy-utility balance, showing that the SNN generator, federated learning, and Rényi differential privacy work jointly.</p>
<p>The authors are candid about limitations. The experiments used a single federated simulation per subject rather than pooling subjects, heterogeneous non-IID client distributions were not evaluated, and the data-dependent contribution scores used for aggregation are not themselves privatized, a gap the team plans to close. Clinical use would require further validation with clinically representative datasets and regulatory compliance; the framework is aimed at research, algorithm development, data augmentation, and benchmarking, not at altering diagnostic EEG. Still, the direction is clear: as brain-sensing wearables multiply, the ability to generate useful synthetic neural data without centralizing or exposing anyone&#8217;s recordings could become essential infrastructure for the field. The researchers also point toward extending the approach to other neural data types such as fMRI and MEG, and toward integrating multimodal signals, suggesting that the privacy-preserving synthesis of brain data is only beginning.</p>
<p><strong>Subject of Research:</strong> Privacy-preserving synthetic EEG generation using federated spiking generative adversarial networks with Rényi differential privacy for brain-computer interfaces</p>
<p><strong>Article Title:</strong> Federated Spiking GANs with Rényi Differential Privacy for privacy-preserving synthetic EEG generation in brain–computer interfaces</p>
<p><strong>Article References:</strong> Paul, S., &amp; Bajwa, G. (2026). Federated Spiking GANs with Rényi Differential Privacy for privacy-preserving synthetic EEG generation in brain–computer interfaces. <em>Frontiers in Human Neuroscience, 20</em>, Article 1909432. <a href="https://doi.org/10.3389/fnhum.2026.1909432" rel="noopener noreferrer">https://doi.org/10.3389/fnhum.2026.1909432</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.3389/fnhum.2026.1909432" rel="noopener noreferrer">10.3389/fnhum.2026.1909432</a></p>
<p><strong>Keywords:</strong> EEG, brain-computer interfaces, spiking neural networks, generative adversarial networks, differential privacy, Rényi differential privacy, federated learning, synthetic data, DP-SGD, motor imagery, data privacy, neuroscience AI</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">279618</post-id>	</item>
		<item>
		<title>How Cities Can Watch Without Peeking: Privacy Math for Surveillance Cameras</title>
		<link>https://scienmag.com/how-cities-can-watch-without-peeking-privacy-math-for-surveillance-cameras/</link>
		
		<dc:creator><![CDATA[Veronica Carney]]></dc:creator>
		<pubDate>Thu, 15 Oct 2026 20:32:02 +0000</pubDate>
				<category><![CDATA[Science News]]></category>
		<category><![CDATA[CIFAR-10]]></category>
		<category><![CDATA[differential privacy]]></category>
		<category><![CDATA[DP-SGD]]></category>
		<category><![CDATA[federated learning]]></category>
		<category><![CDATA[gradient leakage]]></category>
		<category><![CDATA[homomorphic encryption]]></category>
		<category><![CDATA[image classification]]></category>
		<category><![CDATA[privacy-utility trade-off]]></category>
		<category><![CDATA[remote sensing]]></category>
		<category><![CDATA[secure aggregation]]></category>
		<category><![CDATA[smart-city surveillance]]></category>
		<category><![CDATA[urban IoT]]></category>
		<category><![CDATA[urban privacy concerns aim to protect.]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=277682</guid>

					<description><![CDATA[A new review of over 60 studies shows that differentially private federated learning has narrowed the accuracy gap for privacy-preserving image analysis in smart-city surveillance, but significant barriers remain before deployment on real camera networks.]]></description>
										<content:encoded><![CDATA[<p>Smart cities are drowning in images. Thousands of cameras and imaging sensors now watch traffic, public spaces, infrastructure, and even drones, generating streams of visual data that can make urban life safer and more efficient—but at the cost of recording the faces, movements, and habits of nearly everyone who lives there. A new mini review in Frontiers in Imaging argues that a well-established combination of machine learning techniques, known as differentially private federated learning, or DPFL, has quietly become the leading technical answer to the privacy problem in urban image analysis, while cautioning that the framework is far from a finished solution. Drawing on more than sixty published studies, computer engineering researchers Namrata Pandya and Dhrupa Mistry of CVM University in Gujarat, India, trace how far the field has come in a decade—and what still stands between promising benchmarks and reliable deployment on real city camera networks.</p>
<p>The core dilemma the review describes is architectural. The most accurate image-analysis models are built by centralizing data: collecting every image in one place so a neural network can learn from all of it. But centralizing surveillance footage concentrates exactly the kind of sensitive biometric and behavioral information that privacy laws, governance policies, and re-identification research worry about. Federated learning, introduced as a practical alternative in 2017, inverts the arrangement. Instead of shipping images to a central server, each camera or client trains a local copy of the model on its own data and sends only model updates—the gradients that describe how its parameters should change—to an aggregator, which averages them into a shared global model using the FedAvg algorithm. Raw footage never leaves the device. The scheme fits urban sensing naturally, because cities already have enormous numbers of distributed devices with local storage and limited bandwidth.</p>
<p>Yet federated learning alone, the review emphasizes, does not actually guarantee privacy. This is the surprise that transformed the field. In 2019, researchers demonstrated that the gradients a client uploads can be mathematically inverted to reconstruct training images pixel-for-pixel, in an attack memorably titled Deep Leakage from Gradients. Successive refinements made reconstruction feasible for realistically sized batches, extended the technique to whole image sets, and added recursive linear-algebraic attacks. A 2023 systematic categorization of the field divides gradient-leakage methods into bias attacks, optimization-based attacks, and linear equation-solver attacks, and confirms something especially worrying for surveillance: images are substantially more vulnerable to near-exact reconstruction than text or tabular data, because they are high-dimensional and redundant. Beyond gradient inversion, the review catalogues membership inference attacks that reveal whether a particular person&#8217;s image was in a training set, property inference attacks that deduce aggregate attributes of a client&#8217;s data, and model extraction attacks that steal the trained model itself. In other words, sharing updates instead of images is a necessary step, not a sufficient one.</p>
<p>That is where differential privacy enters. Differential privacy is a formal, mathematically defined guarantee: it bounds how much the learning process can be influenced by any single example in the training data, ensuring that the final model would look statistically similar whether or not any one image was included. In practice, the guarantee is implemented through an algorithm called DP-SGD, first benchmarked on image classification in 2016. DP-SGD computes gradients for each training example individually, clips each one to a bounded maximum size, and then adds calibrated Gaussian noise before the results are aggregated. The strength of the protection is governed by a privacy budget, denoted by the Greek letter epsilon. A smaller epsilon means stronger privacy but more noise and therefore lower accuracy—a fundamental trade-off that no amount of clever engineering has eliminated. Secure aggregation protocols are typically layered on top, using cryptography so the server sees only the noised sum of all clients&#8217; updates and never any individual contribution. The combination of these ingredients is DPFL.</p>
<p>The review&#8217;s most striking quantitative finding concerns how fast this trade-off has improved. On CIFAR-10, the standard image-classification benchmark used across nearly a decade of research, the first DP-SGD results in 2016 reported 73.0 percent top-1 accuracy at a privacy budget of epsilon equal to 8, roughly 22 percentage points below a non-private baseline of about 95 percent. By 2022, careful scaling and tuning of large over-parameterized models had pushed the private state of the art to 81.4 percent at the same budget, narrowing the gap to roughly 13 to 14 points. Progress was not perfectly monotonic—the earliest result used pre-trained convolutional layers, which changes the effective privacy setup—and the trajectory has been powered by innovations such as adaptive and automatic clipping, which remove the need for hand-tuning the clipping threshold, and architecture designs optimized specifically for private training. The review also notes the cost of tighter protection: on the same architecture, accuracy falls from 73 percent at epsilon 8 to 67 percent at epsilon 2, so cities with stricter privacy requirements should expect to pay more in model performance.</p>
<p>Crucially, the authors draw a line that much of the broader literature blurs. Those celebrated benchmark numbers all come from centralized training on curated datasets, where a single trusted party holds everything. Federated DPFL adds a second layer of difficulty: gradients are clipped and noised locally, then aggregated across clients whose data distributions differ substantially—so-called non-IID data—because cameras in different locations see different scenes. Studies in this federated regime report smaller but more realistic gains. Clustered federated learning with adaptive local differential privacy improved the privacy-utility balance on heterogeneous Internet-of-Things data; adaptive noise mechanisms beat fixed-noise baselines at the same privacy level; and one reliable federated scheme improved accuracy by 1.1 percent while cutting convergence time by more than 9 percent. Evidence from medical imaging, which shares core mechanics with surveillance, suggests acceptable performance at moderate budgets around epsilon 10 but substantial degradation under strict budgets around epsilon 1.</p>
<p>Applied smart-city systems are now demonstrating what hybrid designs can achieve. A federated anomaly-detection approach for CCTV surveillance avoided sharing raw footage entirely and achieved 95 percent accuracy under random data splits, or 86 percent under balanced splits. A remote-sensing classification framework designed to tolerate a dishonest majority of malicious participants saw accuracy fall from 92.5 percent with 20 percent attacker participation to 81.84 percent with 80 percent—an eleven-point penalty that quantifies the price of distrust. Perhaps most eye-catching are the hybrid stacks: a framework combining differential privacy with homomorphic encryption, which allows computation on encrypted data, retained 95.2 percent accuracy even at a strict privacy budget of epsilon 1.0 with minimal degradation. A companion approach pairing homomorphic encryption with dynamic differential privacy and compression reached 92.6 percent accuracy while cutting transmission volume by 40 percent and latency by 43 percent. And a quantum-inspired aggregation scheme reported 94.7 percent accuracy with 43 percent less overhead and only a 2.1 percent degradation relative to a non-private baseline. A blockchain-backed framework handling 100 clients with 15 percent malicious participants reported more than 90 percent accuracy, 32 percent lower overhead, and less than 4 percent accuracy loss at epsilon 1.</p>
<p>The authors insert an important dose of skepticism here: those applied figures are not directly comparable to one another or to the CIFAR-10 benchmarks. They use different datasets, architectures, privacy accounting methods, and threat models, and some easier task framings—such as binary anomaly detection rather than full multi-class classification—likely inflate apparent accuracy. Nor are epsilon values necessarily on a common scale across studies, since neighboring datasets can be defined differently, as adding or removing one image versus one client, and cumulative privacy loss across training rounds further erodes the guarantee over a full deployment. A single reported epsilon can therefore carry very different real-world implications depending on context. The review concludes that no standardized guidance exists for what privacy budget meaningfully protects citizens while preserving public-safety-relevant accuracy in surveillance settings.</p>
<p>That gap leads to the review&#8217;s central caution: DPFL is a credible, rapidly maturing framework rather than a finished solution. Nearly all gradient-leakage attacks have been demonstrated in controlled settings with known architectures and small batches, so their success rate against production-scale systems defended by secure aggregation remains an open empirical question. Real camera networks bring non-IID data, heterogeneous hardware, and communication constraints that curated benchmarks simply do not capture. Hybrid stacks that deliver the best accuracy also add system complexity and latency that may clash with real-time public-safety requirements. The authors&#8217; proposed path forward is fourfold: benchmark DPFL on heterogeneous, non-IID camera data rather than curated datasets; validate resistance to gradient leakage against production-scale secure aggregation and adversarial client populations; converge on domain-specific epsilon guidance balancing public-safety accuracy against re-identification risk; and evaluate hybrid privacy stacks for the latency and complexity costs they impose, not only the accuracy they recover. For a field racing to keep cities intelligent without making their citizens transparent, that measured verdict may be the review&#8217;s most valuable contribution.</p>
<p><strong>Subject of Research:</strong> Differentially private federated learning for privacy-preserving image analysis in smart-city surveillance systems</p>
<p><strong>Article Title:</strong> Differentially private federated learning for image analysis in smart-city surveillance</p>
<p><strong>Article References:</strong> Pandya, N., &amp; Mistry, D. (2026). Differentially private federated learning for image analysis in smart-city surveillance. <em>Frontiers in Imaging, 5</em>, Article 1966936. <a href="https://doi.org/10.3389/fimag.2026.1966936" rel="noopener noreferrer">https://doi.org/10.3389/fimag.2026.1966936</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.3389/fimag.2026.1966936" rel="noopener noreferrer">10.3389/fimag.2026.1966936</a></p>
<p><strong>Keywords:</strong> differential privacy, federated learning, DP-SGD, gradient leakage, smart-city surveillance, image classification, privacy-utility trade-off, homomorphic encryption, secure aggregation, remote sensing, CIFAR-10, urban IoT</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">277682</post-id>	</item>
		<item>
		<title>AI Audits AI: New Tool Catches Broken Privacy Guarantees Before Model Training Begins</title>
		<link>https://scienmag.com/ai-audits-ai-new-tool-catches-broken-privacy-guarantees-before-model-training-begins/</link>
		
		<dc:creator><![CDATA[Denise Maddox]]></dc:creator>
		<pubDate>Fri, 09 Oct 2026 07:05:53 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[adversarial attacks on privacy guarantees]]></category>
		<category><![CDATA[AI model training privacy risks]]></category>
		<category><![CDATA[AI privacy guarantees]]></category>
		<category><![CDATA[automated detection of privacy breaches]]></category>
		<category><![CDATA[automated privacy auditing frameworks]]></category>
		<category><![CDATA[cybersecurity]]></category>
		<category><![CDATA[cybersecurity in AI training]]></category>
		<category><![CDATA[Data Privacy]]></category>
		<category><![CDATA[differential privacy]]></category>
		<category><![CDATA[differential privacy audit tools]]></category>
		<category><![CDATA[differential privacy validation methods]]></category>
		<category><![CDATA[DP-SGD]]></category>
		<category><![CDATA[DP-SGD implementation flaws]]></category>
		<category><![CDATA[evidence chain]]></category>
		<category><![CDATA[large language models]]></category>
		<category><![CDATA[LLM agents]]></category>
		<category><![CDATA[machine learning privacy validation]]></category>
		<category><![CDATA[machine learning security]]></category>
		<category><![CDATA[membership inference attacks]]></category>
		<category><![CDATA[privacy auditing]]></category>
		<category><![CDATA[privacy semantic consistency gap]]></category>
		<category><![CDATA[sensitive data protection in ML]]></category>
		<category><![CDATA[software supply chain]]></category>
		<category><![CDATA[static code analysis]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=252457</guid>

					<description><![CDATA[Researchers have developed LLMDPA, an AI-powered framework that audits DP-SGD implementations in source code before training begins, catching broken privacy guarantees with near-perfect precision in under a minute.]]></description>
										<content:encoded><![CDATA[<p>Differential privacy has long been the gold standard for protecting the data that fuels modern machine learning. When companies train models on medical records, financial transactions, or other sensitive information, they increasingly turn to a technique called DP-SGD—Differentially Private Stochastic Gradient Descent—which mathematically guarantees that no single individual&#8217;s data can unduly influence the final model. But a new study published in the journal Cybersecurity reveals a troubling truth: the privacy guarantee you think you have may not actually exist. A team of researchers from Beijing University of Posts and Telecommunications and the Chinese Academy of Sciences has developed LLMDPA, an automated framework that audits DP-SGD implementations before a single training step runs, and it can catch failures that even experienced engineers routinely miss.</p>
<p>The core problem the researchers identify is what they call the privacy semantic consistency gap. Privacy-related code can be syntactically present in a codebase—clipping functions defined, noise generators imported, privacy parameters declared—while the actual execution semantics silently deviate from the mathematical requirements that make differential privacy work. Prior research has documented that even formally verified algorithms can suffer implementation deviations that completely invalidate their guarantees. In adversarial settings, attackers can exploit this by manipulating subtle logic, such as converting per-example gradient clipping into batch-level clipping, inducing significant privacy leakage without degrading model accuracy. The result is a model that appears private but leaks like a sieve.</p>
<p>DP-SGD works by performing three critical operations during training: randomly sampling data, clipping each individual sample&#8217;s gradient to a fixed threshold, and injecting calibrated Gaussian noise into the update. The privacy guarantee depends entirely on these steps being executed faithfully, along with correct values for the clipping threshold, noise multiplier, sampling rate, and training duration. When the implementation is semantically correct, the privacy risk can be quantified before training even starts, using closed-form theoretical tools. This property makes DP-SGD uniquely suited to what the researchers formalize as pre-execution privacy auditing—a &#8216;shift-left&#8217; approach that verifies privacy before compute is spent and data is exposed.</p>
<p>To demonstrate why such auditing matters, the team constructed four categories of broken DP-SGD variants. In Broken Binding, clipping and noise are computed correctly but never actually participate in the gradient update, so the privacy mechanism is bypassed entirely. In Broken Camouflage, a function named add_dp_noise generates noise scaled down by a factor of a trillion, making the mechanism appear present while rendering it essentially useless. Broken Config involves a correct implementation sabotaged by a single parameter—setting the noise multiplier to zero. Broken Semantic violates the fundamental requirement of per-example clipping by computing an aggregate batch-level norm instead. When the researchers evaluated these variants with RMIA, a state-of-the-art membership inference attack, even subtle code-level deviations substantially increased privacy risk under identical parameter settings.</p>
<p>Existing auditing approaches fall short in complementary ways. Attack-based empirical auditing, the dominant paradigm, requires training shadow models, querying inference interfaces, and running exhaustive experiments—costing thousands of seconds of compute and offering no way to localize the root cause of leakage. Traditional static analysis tools like CodeQL and Joern rely on rule matching and abstract syntax tree traversal, which capture syntactic structure but struggle with the cross-module dependencies that determine whether a privacy mechanism is genuinely wired into the training path. Vanilla large language models, meanwhile, offer stronger semantic reasoning but suffer from hallucinations, lack privacy-specific adaptation, and cannot reliably analyze entire repositories.</p>
<p>LLMDPA bridges these gaps through a three-stage pipeline built around a structured Evidence Chain. In the first stage, the framework extracts code facts using two complementary strategies: a fast, deterministic extractor based on abstract syntax trees and pattern matching, and an LLM-based Task Agent that digs deeper when syntactic evidence is incomplete. The Evidence Chain organizes findings into four subsets covering training structure, mechanism implementation, validation logic, and parameter configuration, with each atomic evidence item traceable back to its source file and code location. An Audit Task Tree constrains the agent&#8217;s reasoning to task-relevant information, reducing both hallucination risk and token consumption.</p>
<p>In the second stage, an Eval Agent adjudicates semantic consistency solely on the extracted evidence, scoring four dimensions: whether the mechanism exists, whether it is bound to the training update path, whether parameters are complete, and whether the implementation matches DP-SGD&#8217;s mathematical semantics. A weighted aggregation produces a semantic gap measure, and rule-based fusion yields a verdict that distinguishes mechanism absence, semantic failure, effectiveness, or insufficient evidence. If evidence is lacking, the system loops back for targeted supplementation. The third stage produces a human-readable report and, when parameters permit, a conditional static risk indication derived from closed-form bounds on membership inference attacks against DP-SGD.</p>
<p>The evaluation results are striking. Across a benchmark of 40 real-world open-source repositories—half integrating DP-SGD and half not—LLMDPA achieved global precision between 98.82 and 100 percent and F1-scores between 0.9091 and 0.9677 across four different large language model backends, including GPT-4o-mini, Gemini 2.5 Flash, DeepSeek-V3, and Qwen3-Max. On repositories without DP-SGD, it produced zero false positives, while DP-aware static analysis variants misclassified 10 percent of them. In diagnosing broken variants, LLMDPA substantially outperformed both static analysis baselines and an end-to-end LLM approach: removing the evidence chain or evaluation module caused recall to collapse from nearly 0.95 to around 0.50. Perhaps most compelling is the speed: LLMDPA audited a repository in roughly 50 seconds, whereas the RMIA attack-based evaluation of the same project took about 2,745 seconds, most of it spent training the model.</p>
<p>The implications extend across the machine learning supply chain. Modern deep learning development depends heavily on third-party repositories that are frequently updated by many contributors, and practitioners often prioritize model performance over rigorous implementation audits. Even standardized libraries like Opacus or TensorFlow Privacy can be silently misused through incorrect integration or parameter declaration, decoupling the theoretical proof from practical execution. A fast, automated pre-execution audit could serve as a screening stage in continuous integration pipelines, flagging deceptive or broken privacy implementations before models are trained on sensitive data—whether the failure stems from honest engineering mistakes or malicious supply-chain tampering.</p>
<p>The researchers are candid about limitations. High-quality open-source repositories with systematic DP-SGD integration remain sparse, the multi-stage reasoning process consumes considerable tokens, and the static risk indication is a conditional estimate rather than an empirical measurement of realized leakage. Runtime behaviors like data-dependent sampling, dynamic noise scheduling, and distributed training dynamics may also escape source-level analysis. The framework is designed to complement, not replace, post-training empirical evaluation. Future work aims toward a closed-loop paradigm that automatically repairs identified privacy gaps, and toward extending the approach to other provable mechanisms such as PATE and differentially private federated learning. For now, LLMDPA offers something the field has lacked: an interpretable, evidence-traceable way to ask, before it is too late, whether your privacy guarantee is real or merely declared.</p>
<p><strong>Subject of Research:</strong> Pre-execution privacy auditing of differentially private machine learning using LLM-based semantic code analysis</p>
<p><strong>Article Title:</strong> LLMDPA: pre-execution privacy auditing of DP-SGD via evidence-constrained semantic analysis</p>
<p><strong>Article References:</strong> Zhang, Z., Zuo, J., Liu, J., Shi, R., Pang, J., Lu, Y., &amp; Li, F. (2026). LLMDPA: pre-execution privacy auditing of DP-SGD via evidence-constrained semantic analysis. <em>Cybersecurity, 9</em>(1), Article 229. <a href="https://doi.org/10.1186/s42400-026-00657-5" rel="noopener noreferrer">https://doi.org/10.1186/s42400-026-00657-5</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1186/s42400-026-00657-5" rel="noopener noreferrer">10.1186/s42400-026-00657-5</a></p>
<p><strong>Keywords:</strong> differential privacy, DP-SGD, privacy auditing, large language models, machine learning security, membership inference attacks, static code analysis, software supply chain, evidence chain, LLM agents, data privacy, cybersecurity</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">252457</post-id>	</item>
		<item>
		<title>Privacy-First AI Detects Fainting Condition Without Exposing Patient Data</title>
		<link>https://scienmag.com/privacy-first-ai-detects-fainting-condition-without-exposing-patient-data/</link>
		
		<dc:creator><![CDATA[Ophelia Keating]]></dc:creator>
		<pubDate>Sat, 12 Sep 2026 16:18:51 +0000</pubDate>
				<category><![CDATA[Medicine]]></category>
		<category><![CDATA[AI interpretability in medicine]]></category>
		<category><![CDATA[biomedical engineering]]></category>
		<category><![CDATA[CKKS scheme]]></category>
		<category><![CDATA[differential privacy]]></category>
		<category><![CDATA[differential privacy in healthcare]]></category>
		<category><![CDATA[DP-SGD]]></category>
		<category><![CDATA[electrocardiogram]]></category>
		<category><![CDATA[encrypted medical data analysis]]></category>
		<category><![CDATA[ethical AI in cardiovascular diagnostics]]></category>
		<category><![CDATA[explainable AI]]></category>
		<category><![CDATA[fainting diagnosis using machine learning]]></category>
		<category><![CDATA[head-up tilt test]]></category>
		<category><![CDATA[head-up tilt test analysis with AI]]></category>
		<category><![CDATA[homomorphic encryption]]></category>
		<category><![CDATA[LIME]]></category>
		<category><![CDATA[machine learning pipeline for fainting condition]]></category>
		<category><![CDATA[privacy-first healthcare technology]]></category>
		<category><![CDATA[privacy-preserving AI]]></category>
		<category><![CDATA[secure inference]]></category>
		<category><![CDATA[secure patient data processing]]></category>
		<category><![CDATA[SHAP]]></category>
		<category><![CDATA[transparent AI models for clinical diagnosis]]></category>
		<category><![CDATA[vasovagal syncope]]></category>
		<category><![CDATA[vasovagal syncope detection]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=196251</guid>

					<description><![CDATA[A proof-of-concept study shows that differentially private, explainable AI can detect vasovagal syncope from tilt-test data with minimal accuracy loss, while fully homomorphic encryption for secure inference remains limited by approximation error.]]></description>
										<content:encoded><![CDATA[<p>Vasovagal syncope, the sudden and temporary loss of consciousness caused by a drop in blood pressure and heart rate, affects a large share of the population and often leaves patients waiting years for a clear diagnosis. The gold-standard diagnostic procedure, the head-up tilt test, requires patients to be tilted upright on a table while clinicians monitor how their cardiovascular system responds. Although the test is widely used, its diagnostic sensitivity has remained limited, and hospitals have been slow to embrace artificial intelligence tools that could sharpen interpretation. A new proof-of-concept study suggests a way forward that addresses two of the biggest obstacles to clinical AI at once: protecting patient privacy and making the model&#8217;s reasoning transparent to doctors.</p>
<p>Researchers led by Mahbuba Ferdowsi, Ban-Hoe Kwan, Maw Pin Tan and Choon-Hian Goh, working across Universiti Tunku Abdul Rahman in Malaysia, the University of New South Wales in Australia, Universiti Malaya and Sunway University, have built a machine learning pipeline that trains on sensitive physiological data using differential privacy, produces explanations clinicians can inspect, and even runs its predictions on encrypted data. The work, published in BioMedical Engineering OnLine, analysed records from 137 participants who underwent head-up tilt testing, of whom 54 were classified as vasovagal syncope positive and 83 as negative. From electrocardiogram and blood pressure signals recorded during the tilt protocol, the team extracted 54 features capturing the haemodynamic and autonomic signatures of each patient&#8217;s response.</p>
<p>The privacy guarantee at the heart of the training process comes from differentially private stochastic gradient descent, or DP-SGD. In conventional training, a neural model&#8217;s gradients are computed from each patient example and used to update the model weights, which creates a risk that memorised details of individual patients could be extracted from the finished model. DP-SGD interrupts this leakage path in two ways. First, it clips the gradient computed from every individual example so that no single patient can exert an outsized influence on the weights. Second, it injects calibrated Gaussian noise into the clipped gradients before they are aggregated, obscuring the contribution of any one record. The strength of this protection is formally quantified by a privacy budget, expressed as epsilon and delta. In this study, the model was trained under a privacy budget of approximately epsilon equal to 16.5 with delta set to 10 to the power of minus 5, a setting that provides a mathematically provable bound on how much any single participant&#8217;s information can leak into the model or its outputs.</p>
<p>Crucially, this formal privacy came at a surprisingly modest cost in accuracy. The DP-SGD trained logistic regression model, combined with a feature importance selection step that retained the most informative variables, achieved a cross-validated accuracy of 0.833 plus or minus 0.035 and an area under the receiver operating characteristic curve of 0.888 plus or minus 0.019. The evaluation used a stratified five-fold cross-validation framework in which all pre-processing steps were performed strictly within each training fold, a design choice that prevents subtle data leakage from inflating performance estimates. For comparison, the researchers also trained baseline models including a standard logistic regression, random forest classifiers and artificial neural networks, providing a benchmark for how much predictive power was preserved once the privacy machinery was switched on.</p>
<p>The second, more ambitious layer of the pipeline attempted to hide patient data even at the moment of prediction, using fully homomorphic encryption. This cryptographic technique allows computation directly on encrypted values, meaning a hospital could send an encrypted feature vector to an untrusted server and receive an encrypted diagnosis without the server ever seeing the underlying physiological measurements. The team implemented the Cheon-Kim-Kim-Song scheme, often abbreviated CKKS, using the TenSEAL library, which is designed for arithmetic on approximate real numbers and is well suited to encrypting continuous biomedical features. Because homomorphic encryption supports only addition and multiplication, non-linear activation functions must be approximated by polynomials, and the researchers used a degree-3 polynomial approximation of the sigmoid function to perform encrypted classification.</p>
<p>Here the study delivered an honest and instructive negative result. While the differentially private model performed well, inference carried out entirely under encryption degraded sharply, with the area under the curve falling to roughly 0.53, barely better than a coin flip. The culprit was approximation error: the polynomial surrogate for the sigmoid, combined with the noise inherent in CKKS arithmetic, distorted the decision boundary enough to destroy much of the model&#8217;s discriminative power. The authors are careful to frame this as a feasibility assessment rather than a failure, noting that the encrypted pipeline was applied only at the prediction stage and that optimised homomorphic architectures are a clear direction for future work. The finding matters for the field because it quantifies, in a real clinical setting, the gap between privacy-preserving training and fully secure inference, showing that the former is nearly free in utility terms while the latter remains a genuine engineering challenge.</p>
<p>Interpretability, the third pillar of the framework, was assessed with two widely used explanation techniques, LIME and SHAP, which attribute a model&#8217;s predictions back to individual input features. Both methods converged on the same picture of what the model had learned. Tilt-phase haemodynamic measurements, specifically systolic and diastolic blood pressure recorded during the tilt (SBP_T and DBP_T), together with autonomic balance indices derived from heart rate variability and blood pressure variability in the low-frequency to high-frequency bands (LFHF_RRI_T and LFHF_SBP_T), emerged as the key predictors of a positive vasovagal syncope diagnosis. This alignment is clinically reassuring, because these features correspond to the physiological mechanisms physicians already associate with tilt-induced fainting: an exaggerated drop in vascular tone and a shift in autonomic control when the body is tilted upright.</p>
<p>The study&#8217;s authors are explicit about the limits of what their results demonstrate. All reported performance figures are internal, cross-validated estimates derived from a single-centre dataset of 137 participants, and the team cautions that they should not be read as evidence of generalizable clinical performance. The relatively modest sample size also meant that subgroup analyses were omitted, a decision consistent with the data minimisation principle that underpins the privacy framework itself. External validation on multi-centre cohorts, and independent confirmation that the identified haemodynamic and autonomic features hold across different populations and tilt-test protocols, remain essential next steps before any deployment in a clinical environment.</p>
<p>Even so, the work arrives at a moment when healthcare systems worldwide are wrestling with how to exploit the predictive power of machine learning without breaching patient trust or privacy law. Differential privacy, homomorphic encryption and explainable AI are usually studied in isolation; this study is notable for assembling all three around a concrete diagnostic problem and reporting exactly where each succeeds and where each breaks down. The demonstration that a formally private model can match conventional baselines with minimal utility loss offers a template for other biomedical prediction tasks, from arrhythmia detection to sepsis early warning, where training data are scarce, sensitive and ethically charged.</p>
<p>The research was funded by the UTAR Research Fund from Universiti Tunku Abdul Rahman and received ethics approval from both the UTAR Scientific and Ethical Review Committee and the UMMC Medical Research Ethics Committee, with written informed consent obtained from all participants. As hospitals move toward federated learning and cloud-based clinical AI, studies of this kind provide the empirical grounding needed to decide which privacy technologies are ready for the clinic today and which still require the next generation of cryptographic engineering. For patients whose fainting spells have defied easy diagnosis, the promise is an AI assistant that reads their tilt test accurately, explains its reasoning, and never exposes their data in the process.</p>
<p><strong>Subject of Research:</strong> Privacy-preserving and explainable machine learning for vasovagal syncope detection from head-up tilt test signals</p>
<p><strong>Article Title:</strong> Differentially private and explainable machine learning for vasovagal syncope detection: a feasibility study of homomorphic encryption for secure inference</p>
<p><strong>Article References:</strong> Ferdowsi, M., Kwan, B.-H., Tan, M. P., &amp; Goh, C.-H. (2026). Differentially private and explainable machine learning for vasovagal syncope detection: a feasibility study of homomorphic encryption for secure inference. <em>BioMedical Engineering OnLine</em>. <a href="https://doi.org/10.1186/s12938-026-01626-2" rel="noopener noreferrer">https://doi.org/10.1186/s12938-026-01626-2</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1186/s12938-026-01626-2" rel="noopener noreferrer">10.1186/s12938-026-01626-2</a></p>
<p><strong>Keywords:</strong> vasovagal syncope, head-up tilt test, differential privacy, DP-SGD, homomorphic encryption, CKKS scheme, explainable AI, LIME, SHAP, secure inference, biomedical engineering, electrocardiogram</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">196251</post-id>	</item>
	</channel>
</rss>
