The core of the method is a pairing of two well-known artificial intelligence techniques. The first is YOLOv8, a member of the You Only Look Once family of object detectors, which scans each camera frame in real time and returns bounding boxes for the target. The second is a long short-term memory network, or LSTM, a recurrent neural architecture designed to retain information across time steps. By feeding the stream of detected target positions into the LSTM, the system learns the temporal pattern of the target’s motion and projects its future location. This prediction is what allows the controller to act preemptively. In conventional image-based visual servoing, the control loop only sees the present error between the target’s position in the image and a desired position, which means any delay in image processing or actuation translates directly into tracking error. A predicted future position, injected as a feedforward term, compensates for that lag before it accumulates.

Once the prediction is available, the system must convert it into flight commands. The researchers employ a nonlinear image-based visual servoing model, often abbreviated as nonlinear IBVS, to generate the control instructions that steer the unmanned aerial vehicle. Image-based visual servoing is a control philosophy in which the robot’s goal is defined directly in image coordinates rather than in three-dimensional world coordinates: the drone tries to drive the target’s pixel position toward a reference point in the camera view. The nonlinear variant accounts for the fact that the mapping between camera motion and image motion is itself nonlinear, particularly when the drone tilts, yaws, or changes altitude. The authors describe the overall loop as achieving real-time control and feedback of the trajectory generation process, meaning that detection, prediction, and control all update continuously as the flight unfolds.

A third ingredient, reinforcement learning, refines how the nonlinear servoing model is tuned. The study integrates Q-learning, a classic reinforcement learning algorithm in which an agent learns the value of taking particular actions in particular states by trial, error, and reward. In this architecture, the Q-learning component optimizes the parameters of the nonlinear IBVS scheme, effectively letting the controller discover through experience which servoing gains and command choices produce stable, accurate tracking. This hybrid design is notable because it combines the interpretability of a physics-informed control law with the adaptivity of a learning algorithm. Rather than replacing the servoing model with an opaque neural policy, the researchers keep the control structure explicit and use learning to polish its behavior, a strategy that tends to transfer more reliably from simulation to physical hardware.

The experimental evaluation rested on two pillars: simulation studies and flights on a real unmanned aerial vehicle platform. In the simulated trials, the proposed model was benchmarked against two established baselines. The first, Deep Reinforcement Learning-Navigation, represents the approach of training a neural network end to end to navigate around obstacles. The second combines Recurrent All-Pairs Field Transforms, a technique for estimating dense optical flow between video frames, with a proportional-integral-derivative controller for actuation. Against both, the new method posted a 99.02 percent obstacle avoidance rate, indicating that the drone successfully steered clear of nearly every obstruction placed in its path while continuing to track its target. The authors attribute this robustness to the combination of predictive tracking and learned servoing optimization, which together eliminate much of the interference that obstacles introduce into the visual control loop.

Tracking accuracy was quantified through root mean square error, a standard metric that measures the typical magnitude of deviation between the commanded and actual trajectory. The proposed model recorded root mean square errors of 0.075 in the X direction and 0.192 in the Y direction, figures the authors describe as significantly lower than those of the comparison models. In practical terms, these numbers mean the drone’s flight path stayed close to the ideal trajectory required to keep the target centered and the mission on course. Because image-based servoing defines success in the camera’s own coordinate frame, low tracking error also implies that the target remained reliably within the field of view, which is the precondition for every downstream task, whether that is inspecting power lines, following a vehicle, or filming a moving subject.

The motivation for the work is grounded in concrete applications. The research was supported by the Science and Technology Key Project of Henan Province, focused on high-precision positioning and intelligent navigation of indoor unmanned aerial vehicles based on multi-sensor fusion, and by the Henan Engineering Research Center of Tunnel Engineering Machinery, which funded work on tracking methods for power inspection quadrotor unmanned aerial vehicles using improved image-based visual servoing control. Power line inspection is a demanding scenario: the drone must fly close to energized conductors, follow a route that may curve and climb, and hold its camera steady on hardware components, all while wind gusts and structural obstacles perturb the flight. A controller that loses sight of the target even briefly can drift into a hazardous position, which is why the authors emphasize stable and efficient flight operations as the practical payoff of their method.

The study also situates itself within a broader research conversation documented in its bibliography. Recent work on aggressive quadrotor flight has explored perception-aware visual servoing, in which the drone’s maneuvers are constrained to preserve visibility of features of interest, and on fixed-time differentiator-based servoing schemes designed to cope with turbulent wind. Other groups have pursued trajectory generation through differential flatness for aerobatic vertical takeoff and landing aircraft, speed adaptation for flight in cluttered environments, and unified robust path planning for three-dimensional area coverage. The new contribution distinguishes itself by integrating the perception and prediction stages into the feedforward path of the servo controller rather than treating them as separate modules, and by using Q-learning to optimize the nonlinear servoing law itself. The authors’ citation of work on moving-target tracking for wheeled robots with visibility maintenance and obstacle avoidance underlines that the target-loss problem spans multiple robotic platforms, and their solution is tailored to the aerial case where dynamics are fast and the camera moves with the vehicle.

From a technical standpoint, the division of labor among the three components is what makes the system coherent. YOLOv8 provides the perceptual anchor, converting raw pixels into a discrete target position at camera frame rate. The LSTM supplies temporal continuity, smoothing out detection noise and extrapolating motion across the intervals where the detector might momentarily fail or the target might be partially occluded. The Q-learning-optimized nonlinear IBVS closes the loop, translating predicted image-space goals into velocity and attitude commands that respect the drone’s nonlinear dynamics. Because the prediction enters as feedforward, the feedback portion of the controller only needs to correct residual errors, which keeps the control signals small and smooth. This architecture reduces the jitter that plagues purely reactive trackers, where every detection fluctuation propagates directly into motor commands, and it explains the low root mean square errors reported in both simulated and physical experiments.

The authors state that all data generated or analyzed during the study are included in the published article, and they declare no conflicts of interest. The work, received in March 2026, revised in July, and published on 12 October 2026 in Aerospace Systems, arrives at a moment when autonomous drones are being asked to operate with less human oversight in increasingly cluttered environments, from warehouse inventory scanning to infrastructure inspection and drone light shows. A tracking controller that anticipates rather than reacts addresses one of the most common failure points in those missions. If the reported gains in obstacle avoidance and tracking precision hold up across the diverse conditions of commercial deployment, the integration of detection, temporal prediction, and reinforcement-learned servoing could become a standard template for the next generation of vision-guided flight control systems, bringing machines one step closer to the kind of effortless visual pursuit that animals perform instinctively.

Subject of Research: UAV trajectory generation using YOLOv8-LSTM dynamic target tracking integrated with Q-learning-optimized nonlinear image-based visual servoing

Article Title: A method for generating unmanned aerial vehicle trajectories by integrating YOLOv8-LSTM dynamic tracking with Q-learning to optimize nonlinear IBVS

Article References: A method for generating unmanned aerial vehicle trajectories by integrating YOLOv8-LSTM dynamic tracking with Q-learning to optimize nonlinear IBVS. (n.d.). https://doi.org/10.1007/s42401-026-00551-5

Image Credits: AI Generated

DOI: 10.1007/s42401-026-00551-5

Keywords: unmanned aerial vehicle, YOLOv8, LSTM, Q-learning, reinforcement learning, image-based visual servoing, trajectory generation, dynamic target tracking, obstacle avoidance, drone navigation, computer vision, control systems