AI Learns to Spot Cyberattacks With Almost No Labeled Data

Every day, networks across the world generate torrents of traffic data that defenders must sift through for signs of intrusion. Machine learning has promised to automate this vigilance, but the promise comes with a catch: supervised models need enormous volumes of accurately labeled traffic, and labeling network flows is slow, expensive work that few organizations can afford at scale. Worse, models trained on public benchmark datasets routinely falter when deployed on a company’s own network, because the statistical character of traffic differs from one environment to the next. A research team at Yanshan University in China, working with a colleague at the University of Sunderland in the United Kingdom, has now proposed a way to attack both problems at once, in a study published in the journal Cluster Computing.

The new algorithm, described by Qian Wang, Jiahui Shang, Weihao Huang, Yongqiang Cheng and Bing Zhang, is a semi-supervised, domain-adaptive intrusion detection method built around a generative adversarial network that maximizes mutual information between features, combined with a careful scheme for choosing pseudo-labels. In plain terms, the system learns to detect attacks on a new network even when almost none of that network’s traffic has been labeled, by transferring what it knows from a labeled source domain while reshaping its internal representation so that the quirks of one dataset do not contaminate its judgments about another.

The core difficulty the authors address is known as domain shift. When an intrusion detection model is trained on, say, a public benchmark dataset and then confronted with traffic from an Internet of Things deployment or a private enterprise network, the distributions of the two datasets differ in countless small ways: different protocols, different device mixes, different attack patterns. Features that carried strong predictive signal in the source domain may be nearly meaningless, or even misleading, in the target domain. Earlier work on domain-adaptive intrusion detection has tried to align the feature distributions of source and target data, but aggressive alignment can erase information that actually matters for distinguishing attacks from benign traffic.

The team’s answer is to align distributions while preserving semantics, and their tool for this is a generative adversarial network augmented with a mutual information objective. Mutual information is an information-theoretic quantity that measures how much knowing one variable tells you about another. By maximizing the mutual information between the original features of the source and target domains and the domain-invariant features that the network extracts, the model ensures that the compressed, environment-agnostic representation it builds retains as much of the integrated semantic content of the raw data as possible. The result, the authors report, is a set of domain-invariant features that are effectively equivalent to the original features in information content, yet no longer betray which dataset they came from — precisely the property an intrusion detector needs when it must operate across environments.

Before that adversarial game even begins, the researchers tackle another chronic headache in intrusion detection: class imbalance. Real network traffic is overwhelmingly benign, and public attack datasets are often dominated by a handful of frequent attack types, so models trained naively overfit to majority classes and neglect rare but dangerous ones. The team proposes an improved oversampling method, LR-SMOTE, which builds on the Limit Radius Synthetic Minority Oversampling Technique previously developed using k-means clustering and support vector machines. Their enhancement generates synthetic minority-class samples using a multi-sample strategy with random smoothing, expanding the representation of underrepresented attack categories in the source domain before the distribution alignment step. This pre-balancing prevents the adversarial alignment from washing minority attack classes away in pursuit of overall distributional similarity.

Once the domain-invariant features are available, the algorithm exploits the sea of unlabeled target-domain traffic through pseudo-labeling — the practice of letting a trained model assign provisional labels to unlabeled data and then training on those labels as if they were ground truth. Pseudo-labeling is powerful but risky: a confidently wrong pseudo-label can propagate error through the model. To keep the feedback loop honest, the researchers adopt an Uncertainty-aware Pseudo-label Selection framework, which admits only those provisional labels the model assigns with sufficient confidence, filtering out ambiguous cases that would inject noise. The selected pseudo-labeled samples then train a One-class Support Vector Machine classifier over the domain-invariant features in a semi-supervised manner, allowing the detector to make full use of unlabeled target traffic rather than discarding it.

The architecture is notable for how each component compensates for a specific failure mode of the previous state of the art. Standard adversarial domain adaptation, popularized by the domain-adversarial training of neural networks approach introduced by Ganin and colleagues, aligns distributions but can sacrifice class-discriminative structure. Adding the mutual information maximization term, an idea drawn from self-supervised representation learning, anchors the alignment to the original feature content. Pseudo-labeling with uncertainty selection, in turn, closes the loop by letting the adapted representation be refined with target-domain supervision that costs nothing to produce. The combination means the system needs labeled data only in the source domain, which is exactly the asymmetry that real deployments exhibit.

The experimental evaluation spanned both conventional network intrusion datasets and Internet of Things datasets, testing the algorithm in cross-domain scenarios where training and testing data come from different distributions. The datasets referenced in the study include widely used benchmarks such as UNSW-NB15, CICIDS-style collections, and IoT-focused resources like Bot-IoT and TON-IoT, which capture the distinctive traffic profiles of connected devices. Across these experiments, the authors report that the proposed approach demonstrates effectiveness in cross-domain intrusion detection scenarios, validating that the mutual-information-constrained adaptation plus uncertainty-filtered pseudo-labeling outperforms the naive transfer of models trained purely on public data. The study builds on the team’s earlier work on domain-adaptive IoT intrusion detection using joint domain adversaries, extending it with the semi-supervised machinery that lets unlabeled target data do real work.

The practical significance is considerable. Security operations centers are chronically short of labeled incident data for their own environments, and the most sensitive networks — hospital systems, industrial control systems, smart buildings — are precisely those where curated public datasets are least representative. An algorithm that can harvest knowledge from labeled public benchmarks, adapt it to the idiosyncrasies of local traffic, and improve itself on the fly using unlabeled flows could dramatically lower the cost of deploying competent intrusion detection in resource-constrained settings, including IoT fleets where devices lack the compute to run heavyweight models and the cloud-side detectors they depend on must generalize across heterogeneous device populations.

The work also joins a broader research movement to make machine learning robust to the gap between laboratory benchmarks and the messy real world. Recent studies have compared synthetic and real-world intrusion detection datasets and found the discrepancy sobering, and researchers in adjacent fields — fault diagnosis of machinery, malware detection, smart-grid security — have pursued parallel domain adaptation strategies. By showing that mutual information maximization can keep adapted features semantically faithful while adversarial training strips away domain-specific artifacts, and that uncertainty-aware pseudo-label selection can safely convert unlabeled traffic into training signal, the Yanshan University team and their British collaborator offer a template that security researchers far beyond intrusion detection are likely to study. The work was supported by the Science and Technology Program of Hebei Province, and the authors state that the datasets analyzed are available from the corresponding author on reasonable request. As cyberattacks grow more automated, the defenses that guard against them may increasingly be algorithms that teach themselves — quietly, on unlabeled traffic — what an attack looks like in a network they have never seen labeled.

Subject of Research: Semi-supervised domain-adaptive network intrusion detection using adversarial mutual information maximization and pseudo-labeling

Article Title: A semi-supervised intrusion detection algorithm using mutual-information maximization adversarial network and pseudo-labeling

Article References: Wang, Q., Shang, J., Huang, W., Cheng, Y., & Zhang, B. (2026). A semi-supervised intrusion detection algorithm using mutual-information maximization adversarial network and pseudo-labeling. Cluster Computing, 29(15), Article 845. https://doi.org/10.1007/s10586-026-06643-3

Image Credits: AI Generated

DOI: 10.1007/s10586-026-06643-3

Keywords: intrusion detection, domain adaptation, semi-supervised learning, generative adversarial network, mutual information, pseudo-labeling, IoT security, class imbalance, SMOTE, machine learning, cybersecurity, domain-invariant features