The scenario the researchers studied is a three-body engagement involving the target, the pursuer, and the defender. Once the defender is deployed, two coupled pursuit–evasion relationships emerge simultaneously: the pursuer chases the target, while the defender chases the pursuer in an attempt to spoil the interception. Because the defender bends the pursuer’s trajectory away from the target, the two friendly vehicles must act in a coordinated fashion rather than as independent agents. The difficulty is compounded by the fact that the pursuer may employ any of several established interception laws, including optimal control guidance, proportional navigation, or differential game guidance. A defense scheme tuned to a single assumed attack strategy can be defeated the moment the adversary switches tactics. At the same time, neither the target nor the defender has access to complete state information; both must rely on noisy local measurements of range and line-of-sight angles, which makes the problem one of partial observability as well as multi-strategy adversarial behavior.

Existing guidance approaches fall short in this setting for distinct reasons. Unilateral optimal control methods assume a known, fixed adversary model and cannot adapt when the pursuer changes strategy mid-engagement. Differential game formulations deliver elegant theoretical solutions but typically presume perfect information on both sides, an assumption that collapses in the presence of sensor noise and hidden intentions. Conventional reinforcement learning, meanwhile, has shown promise in adversarial settings, but standard algorithms struggle to converge when observations are incomplete and the opponent’s policy varies across encounters. The Sun Yat-sen team identified this triple challenge—unknown pursuit strategies, information deficiency, and high-maneuverability confrontation—as the key technological bottleneck standing in the way of practical, cooperative active defense for spacecraft.

To overcome it, the researchers reframed the three-body engagement as a multi-agent partially observable Markov decision process, or Multi-POMDP. In this formalism, each agent receives only a noisy local observation rather than the true global state, and the opponent’s policy is treated as uncertain and potentially drawn from a set of diverse strategies. The solution architecture is a reinforcement learning guidance framework built on an adaptive dueling double deep Q-network, abbreviated AD3QN. The central idea is that a single neural network learns, from experience, how to issue coordinated maneuver commands to both the target and the defender, so that the pair adapts on the fly to whatever interception strategy the pursuer happens to be executing. The framework separates perception from decision-making: first the raw, incomplete observation history is transformed into a compact situational representation, and then that representation drives the selection of acceleration commands.

The perception pipeline is a fusion of two well-established neural components. Current and historical incomplete observations are stacked along the time dimension into a two-dimensional tensor, which a convolutional neural network processes to extract spatial features—the critical geometric signatures of an unfolding engagement, such as the configuration of lines of sight among the three vehicles. A gated recurrent unit then models the temporal structure of those features, using its internal update and reset gates to produce a history tensor that encapsulates the trajectory characteristics of the encounter. This history encoding is what allows the policy to infer which pursuit strategy the adversary appears to be following, something no single-frame observation can reveal. To make training on partial information effective, the team restructured the experience replay buffer so that it stores the stacked observation tensor, the action taken, the history tensor, and the resulting reward, enabling the network to exploit temporal correlations during learning rather than treating each decision as an isolated snapshot.

The decision-making core of AD3QN builds on the dueling double deep Q-network formulation, in which the state value function and the action advantage function are estimated separately. This decomposition reduces the variance of value estimates, a property that proves crucial in multi-strategy environments where the consequences of a maneuver differ sharply depending on the adversary’s current policy. Equally important is the reward design. Rather than rewarding success only at the final moment of the engagement, the researchers constructed a continuous reward function based on potential-field differences computed from the zero-effort miss distance—the miss distance that would result if both vehicles stopped maneuvering. Before the defender–pursuer encounter, the reward landscape encourages the defender to shrink its zero-effort miss distance relative to the pursuer, driving it toward interception. After that encounter, the shaping switches, guiding the target to enlarge its zero-effort miss distance from the pursuer and thereby accomplish evasion. The authors provide a theoretical proof that this reward formulation does not alter the optimal policy, which means the shaping improves training stability without sacrificing optimality.

The numerical validation compared AD3QN against a demanding field of baselines, including Deep Deterministic Policy Gradient, Twin Delayed Deep Deterministic Policy Gradient, Proximal Policy Optimization, and Deep Recurrent Q-Learning. Under the combined stresses of multi-strategy adversaries and incomplete information, these mainstream algorithms all struggled to achieve stable policy optimization, whereas AD3QN converged reliably thanks to its fusion architecture and its explicit handling of observation history. Computational efficiency is a decisive factor for flight implementation, and here the method posted a striking result: a decision frequency of 85 Hz in a simulated single-chip microprocessor environment, roughly 30 percent faster than the DRQN comparison and comfortably within the real-time requirements of spacecraft actuation systems. In representative sample engagements, the defender successfully deflected the pursuer’s trajectory by approximately 20 meters relative to the target—a deviation large enough to convert a lethal interception into a clean miss.

Statistical robustness was assessed through Monte Carlo analysis. Across 1,000 randomized simulations, the proposed method achieved an evasion success rate of 99.7 percent, dramatically outperforming the optimal switching cooperative guidance law at 51.8 percent and various reinforcement learning baselines, which fell below 0.2 percent. The robustness tests are perhaps the most compelling evidence of practical value: even when observation noise was inflated to 40 times the typical level—with range noise of 400 meters and line-of-sight angle noise of 40 milliradians—the method still maintained an evasion success rate of 73.5 percent. Parameter sensitivity studies added further engineering insight. When the pursuer’s maneuvering capability increased, the target’s achievable miss distance fell by roughly 30 percent, but boosting the defender’s agility effectively compensated, improving evasion performance. This trade-off quantifies a design principle for future defensive architectures: investment in the defender’s maneuverability can offset a faster adversary.

The broader significance of the study lies in demonstrating that cooperative, adaptive active defense is achievable under realistic sensing conditions rather than idealized perfect information. By combining a Multi-POMDP problem formulation, a CNN–GRU fusion network for perception under partial observability, dueling double Q-learning for stable value estimation in adversarial settings, and a theoretically sound potential-field reward, the Sun Yat-sen team has assembled a guidance framework that is simultaneously adaptive, robust, and computationally light enough for onboard implementation. For operators of high-value satellites in congested orbital regions, the work suggests a path toward survivability that does not depend on predicting the attacker’s playbook in advance. As orbital confrontation scenarios grow more complex, methods of this kind—able to learn coordinated counter-interception from noisy observations and to withstand sensor degradation far beyond nominal levels—are likely to become a cornerstone of spacecraft autonomy and space security engineering.

Subject of Research: Active defense guidance for spacecraft in three-body pursuit–evasion engagements with incomplete information and multi-strategy adversaries

Article Title: Active defense guidance for spacecraft in multi-strategy engagement with incomplete information

Article References: Active defense guidance for spacecraft in multi-strategy engagement with incomplete information. (n.d.). Original publication

Image Credits: AI Generated

DOI: Not provided

Keywords: spacecraft guidance, active defense, pursuit-evasion, reinforcement learning, deep Q-network, partial observability, Multi-POMDP, space security, zero-effort miss distance, convolutional neural network, gated recurrent unit, spacecraft survivability