AI Learns to Dodge Defenses: New Guidance System Trains Missiles to Outsmart Interceptors

A missile streaking toward a defended target faces a deadly two-sided problem: it must chase down a maneuvering aircraft while simultaneously evading the interceptor missiles that the aircraft fires back at it. Solving that problem in real time, under extreme acceleration and split-second timing, has long been one of the hardest challenges in aerospace guidance engineering. Now, researchers at Le Quy Don Technical University in Hanoi have proposed a solution that hands the job to artificial intelligence. In a study published in the International Journal of Aeronautical and Space Sciences, Tran Quang Minh and Cao Huu Tinh describe an integrated guidance and evasion method built on hierarchical reinforcement learning, a branch of machine learning in which software agents teach themselves optimal behavior through repeated trial and error rather than through explicitly programmed rules.

The scenario the Vietnamese team addressed is known in the guidance literature as a target-missile-defender engagement. A surface-to-air missile launches at an aerial target, but the target is not passive: it detects the incoming threat and launches its own defender missile to intercept the interceptor. Classical approaches to this three-body duel rely on proportional navigation and its many variants, elegant mathematical guidance laws that steer a missile by rotating its line of sight to the target. Against a defended target, however, engineers have had to layer additional strategies on top, such as weaving maneuvers timed to exhaust the defender’s limited turning capability. These analytical laws work well under idealized assumptions, but they can struggle when the geometry of the engagement shifts unpredictably or when the target behaves in ways the designer did not anticipate.

Minh and Tinh’s answer is to split the problem into two levels, mirroring the way humans decompose complex tasks into skills and decisions about when to use them. At the lower level, two specialized agents are trained independently: one learns the skill of guiding the missile toward its target, and the other learns the skill of evading the incoming defender. Each low-level agent is trained with a meta-reinforcement learning approach, meaning it is exposed to a wide distribution of engagement conditions during training so that it learns not just one solution but a general strategy for adapting to new situations. The agents use recurrent neural networks, specifically gated recurrent units, which give them a form of memory. Instead of reacting only to the instantaneous state of the engagement, they can integrate information over time, a crucial capability when the outcome of a duel depends on the recent history of relative motion rather than on any single snapshot.

Meta-learning, sometimes summarized as learning to learn, has become a powerful tool in guidance research because it addresses a chronic weakness of standard deep reinforcement learning: brittleness. A conventionally trained guidance network often performs beautifully in the exact scenarios it was trained on but degrades sharply when parameters such as speeds, launch ranges, or defender capabilities drift outside that envelope. By training across varied conditions and rewarding rapid adaptation, the meta-learning framework produces agents that adjust their behavior on the fly. The authors drew on a growing body of work in this area, including prior demonstrations of reinforcement metalearning for intercepting maneuvering exoatmospheric targets and curriculum-based deep reinforcement learning for intelligent game strategies in defended-target engagements.

At the top of the hierarchy sits a decision-making layer that determines which skill the missile should exercise at any moment. The high-level policy is discrete: rather than issuing continuous steering commands, it selects between the pursuit-oriented guidance agent and the evasion-oriented agent. Crucially, the researchers combined this learned policy with a threat-region-based switching mechanism, a geometric rule that identifies zones around the defender missile in which evasion becomes imperative. The hybrid design prevents a well-known failure mode of purely learned high-level policies, namely erratic, rapid oscillation between options that would translate into wasteful and potentially destabilizing chattering of the missile’s control surfaces. Once the high level commits to an option, it maintains that choice over an extended time interval, giving the low-level agent a stable window in which to execute its skill effectively.

This hierarchical structure reflects a broader trend in reinforcement learning research dating back to foundational work by Sutton, Barto, and others on decomposing sequential decision problems. Hierarchical reinforcement learning allows each low-level skill to be trained in isolation, which dramatically simplifies the learning problem compared with training a single monolithic agent to master pursuit and evasion simultaneously. It also produces more interpretable behavior: an analyst can inspect which option the high-level policy selected at each moment and understand the missile’s overall strategy, something that is far harder to extract from an opaque end-to-end network. The approach builds on earlier hierarchical guidance studies, including work on missile evasion and guidance published in Scientific Reports and hierarchical guidance with threat avoidance published in the Journal of Systems Engineering and Electronics.

The evaluation of the proposed method covered multiple engagement scenarios, with the intelligent system pitted against several conventional guidance strategies. According to the authors, the results show that the method achieves high guidance accuracy, meaning the missile reliably reaches its target despite the defender’s interference. Equally important for practical adoption, the learned behavior limits control energy and flight time. Control energy is a critical budget in missile engineering: every hard maneuver bleeds kinetic energy, shortens the effective range, and stresses the airframe. A guidance scheme that wins the duel while spending less energy and less time in flight is inherently more survivable and more operationally useful than one that achieves hits through brute-force maneuvering.

Robustness across diverse scenarios is the third pillar of the reported performance. Because the low-level agents were trained with meta-learning and memory-equipped recurrent networks, they retained their effectiveness when engagement conditions varied, rather than requiring retraining for each new configuration. This adaptability addresses a persistent concern about deploying learned systems in safety-critical and adversarial domains, where opponents may deliberately behave in ways that exploit a predictable algorithm. A missile whose evasion patterns shift intelligently with the situation presents a far more difficult target for a defender to defeat than one executing a fixed, pre-programmed weave.

The study situates itself within a rapidly expanding research program that applies deep reinforcement learning to computational missile guidance. Recent contributions in this field include guidance laws for intercepting endoatmospheric maneuvering missiles using recorded recurrent networks, angle-only intercept guidance for maneuvering targets, integrated guidance-and-control designs for three-dimensional interception, and rapid bootstrapping of guidance networks through curriculum and imitation strategies. The common ambition is to move beyond hand-derived analytical laws toward systems that discover effective strategies directly from simulated experience, potentially uncovering maneuvers and timing patterns that human designers would never enumerate.

For the broader defense technology community, the work by Minh and Tinh offers a template for taming the complexity of multi-agent aerial combat: train specialized skills with memory and meta-learning, then orchestrate them with a stable, hybrid decision layer that blends learned judgment with geometric safety rules. As simulated engagement environments grow more realistic and training pipelines mature, hierarchical reinforcement learning frameworks of this kind are likely to influence not only missile guidance but also autonomous aerial systems more broadly, wherever a machine must both pursue a goal and protect itself from an active adversary at the same time. The research was communicated by Bo Wang and published as an original paper in the journal of the Korean Society for Aeronautical and Space Sciences, with both authors affiliated with the Department of Aerospace Control Systems at Le Quy Don Technical University in Hanoi.

Subject of Research: Reinforcement learning-based integrated missile guidance and evasion against defended aerial targets

Article Title: Reinforcement Learning-Based Integrated Guidance and Evasion for Surface-to-Air Missiles Against Defended Targets

Article References: Minh, T. Q., & Tinh, C. H. (2026). Reinforcement Learning-Based Integrated Guidance and Evasion for Surface-to-Air Missiles Against Defended Targets. International Journal of Aeronautical and Space Sciences. https://doi.org/10.1007/s42405-026-01238-z

Image Credits: AI Generated

DOI: 10.1007/s42405-026-01238-z

Keywords: missile guidance, reinforcement learning, hierarchical reinforcement learning, meta-reinforcement learning, gated recurrent unit, surface-to-air missile, evasion, proportional navigation, target-missile-defender engagement, aerospace control, recurrent neural networks, defense technology