The problem the team set out to address is known as actuator loss-of-effectiveness, or LoE. In a quadrotor, four rotors share the work of stabilizing the vehicle in roll, pitch, yaw, and altitude. If a single rotor degrades, whether through motor wear, a damaged propeller, or a partial power failure, the control authority available to the flight computer shrinks asymmetrically. A controller tuned for a healthy aircraft, with fixed gains calculated once before takeoff, may respond too weakly or too aggressively to the resulting imbalance, and the vehicle can destabilize. Fault-tolerant control strategies exist, ranging from robust backstepping designs to model predictive control and hardware redundancy such as tilting rotors, but many require substantial redesign of the control stack or additional actuators.

The Algerian team’s approach is deliberately conservative. They kept the standard cascaded PID structure, the underlying control mixer, and the rigid-body model of the quadrotor untouched. On top of that, they added a bounded online gain-adaptation layer implemented with reinforcement learning. Four decentralized agents operate in parallel, each responsible for one control channel: roll, pitch, yaw, and altitude. Each agent observes the state of the vehicle and adjusts the PID gains in its own channel in real time, but only within preset limits. This bounding is a critical safety feature, because it prevents the learning system from ever commanding gains that could make the aircraft unstable, a concern that has historically limited the acceptance of learning-based controllers in safety-critical flight applications.

To test the idea rigorously, the researchers built a six-degree-of-freedom Newton–Euler quadrotor model with first-order motor dynamics in MATLAB/Simulink. This level of modeling captures both the full rigid-body motion of the aircraft and the lag with which real motors respond to commands, which matters greatly when a rotor’s effectiveness is dropping. The adaptation layer was instantiated with Soft Actor-Critic, or SAC, a reinforcement learning algorithm known for balancing exploration and stability during training. The simulations subjected the controller to nominal flight conditions and to multiple transient and sustained single-rotor LoE profiles, meaning scenarios in which a rotor’s effectiveness dropped either briefly or permanently during flight.

A key strength of the study is its comparison set. The authors did not simply benchmark their learning controller against a naive baseline. They included two other prominent reinforcement learning algorithms, Twin Delayed Deep Deterministic Policy Gradient (TD3) and Proximal Policy Optimization (PPO), evaluated under identical observation and action definitions, the same reward structure, the same gain limits, and the same 500-episode training budget. An additional 1000-episode run of PPO was included to check whether the results were sensitive to how long the algorithms were allowed to train. This kind of controlled comparison is rare and valuable, because reinforcement learning results can vary dramatically with small changes in setup.

The team also addressed a subtler question: how much of the benefit comes from online adaptation itself, rather than from clever static tuning? To separate the two effects, they created offline-optimized fixed-gain PID baselines using two metaheuristic optimization methods, particle swarm optimization (PSO) and grey wolf optimization (GWO). These baselines represent the best that conventional, non-adaptive tuning can achieve before the flight even begins. Including two different metaheuristics also guards against the criticism that the comparison depends on which optimization algorithm happened to be chosen for the baseline.

The results tell a clear story. In nominal flight, with all rotors healthy, the methods performed comparably: the learning-augmented controller did not sacrifice accuracy in ordinary conditions, and step responses and three-dimensional trajectory-tracking simulations showed similar performance across the board. The differences emerged under degradation. When a rotor began to lose effectiveness, the fixed-gain controllers, even those tuned by sophisticated metaheuristics, showed larger post-fault deviations from the desired trajectory. The online gain adaptation layer, by contrast, produced smaller deviations after the fault, because the agents could shift the controller’s aggressiveness to compensate for the lost control authority as the degradation unfolded.

Among the three reinforcement learning algorithms tested, SAC provided the most consistent fault accommodation in the evaluated configurations. This finding aligns with SAC’s design philosophy: the algorithm optimizes both the expected reward and the entropy of its policy, encouraging robust behavior rather than overfitting to a narrow set of training conditions. TD3 and PPO remained competitive under the same budget, but SAC’s consistency across the various LoE profiles made it the standout. The additional 1000-episode PPO check helped the authors assess whether longer training would change the picture, addressing a common concern that reinforcement learning comparisons may simply reflect training-budget artifacts.

What makes this work notable for the drone industry is its integration cost, or rather its lack of one. Many fault-tolerant control approaches demand that engineers abandon the PID controllers their teams know well and adopt entirely new architectures, with all the certification, testing, and retraining burdens that implies. The approach demonstrated here treats learning as a thin adaptation layer on top of existing infrastructure. The mixer, the outer-loop structure, and the physical model all remain unchanged, and the learning agents act only within preset gain bounds. For operators of delivery drones, inspection platforms, and other commercial quadrotors, that means a path to greater resilience against rotor degradation without rewriting the flight stack from scratch.

The study is simulation-based, and the authors are careful about the scope of their claims: in the tested setup, the results support bounded online gain adaptation as a low-integration-cost way to improve robustness to rotor loss-of-effectiveness. Real-world deployment would bring additional challenges, including sensor noise, wind, computational constraints on embedded flight controllers, and the well-known sim-to-real gap that affects all learning-based control methods. Still, the work adds to a growing body of evidence that reinforcement learning can serve flight control best not as a wholesale replacement for classical control theory, but as a disciplined assistant that fine-tunes proven controllers when the aircraft’s condition changes. As drones take on ever more demanding missions, that kind of graceful degradation under failure may prove to be one of machine learning’s most practical contributions to aviation safety.

Subject of Research: Reinforcement-learning-based online PID gain adaptation for fault-tolerant quadrotor control under rotor loss-of-effectiveness

Article Title: Reinforcement-Learning-Based Online PID Gain Adaptation for Fault-Tolerant Quadrotor Control Under Rotor Loss-of-Effectiveness

Article References: Lahmar, O., Abdou, L., & Ghiloubi, I. B. (2026). Reinforcement-Learning-Based Online PID Gain Adaptation for Fault-Tolerant Quadrotor Control Under Rotor Loss-of-Effectiveness. International Journal of Aeronautical and Space Sciences. https://doi.org/10.1007/s42405-026-01269-6

Image Credits: AI Generated

DOI: 10.1007/s42405-026-01269-6

Keywords: quadrotor UAV, fault-tolerant control, actuator loss-of-effectiveness, reinforcement learning, PID gain adaptation, Soft Actor-Critic, TD3, PPO, MATLAB/Simulink simulation, trajectory tracking, drone safety, adaptive control