ControlNet Generates Attitude-Controlled Radar Images of Noncooperative Targets

Radar has become one of the most important sensors for detecting and identifying objects in space and in the air, but it faces a stubborn problem when the object of interest refuses to cooperate. Satellites, aircraft, and debris tumbling along uncontrolled trajectories follow motion paths that no operator can dictate, and the window during which a radar can illuminate them is often painfully short. For engineers building automatic target recognition systems powered by deep learning, this is a serious bottleneck: such algorithms demand enormous quantities of radar images captured across many combinations of viewing angles, and measured data from noncooperative targets are extraordinarily difficult to collect. A radar image changes dramatically with the aspect angle at which the target is viewed, so a recognition model trained on a narrow slice of attitudes will fail when it encounters a target in an orientation it has never seen. The data foundation for reliable radar recognition of noncooperative targets therefore depends on the ability to obtain images at essentially arbitrary azimuth and elevation angles.

The conventional routes to multi-attitude radar imagery each carry heavy penalties. Physical measurement of a real aircraft in an anechoic chamber can produce images at many attitudes, but the cost of such campaigns is prohibitively high, and the target must physically exist and be available for the experiment. Electromagnetic computation on a detailed model of the target can, in principle, produce images at any angle, but the computational time grows so steeply that large-scale dataset generation becomes impractical, and certain aspect angles end up missing from the resulting sets. A third route—data augmentation with generative models—has attracted considerable attention, because generative adversarial networks can synthesize plausible new radar images from limited training data. Yet most existing GAN-based methods can control only the azimuth angle of the generated image. Without precise constraint of the elevation angle as well, the projection morphology of the synthetic image can diverge from what a real radar would record at that attitude, undermining the very fidelity the augmentation is meant to provide.

Researchers at the School of Automation of Central South University have now addressed this dual-dimensional control problem with a method built on ControlNet, a generative framework that adds fine-grained spatial conditioning to a pre-trained diffusion model. In a study published in Space: Science & Technology, the team demonstrated the approach using the E-3 AWACS aircraft, one of the most recognizable airborne early warning platforms, as its test target. The workflow begins with electromagnetic computation to obtain echo data at a wide range of azimuth and elevation angles, followed by image formation and careful preprocessing. A frequency-domain filtering technique suppresses the stripe noise that plagues electromagnetic imaging, and Lee filtering mitigates the speckle noise characteristic of coherent imaging. The combination reduced the image entropy of the processed data from 3.24 to 3.06, a quantitative indication that the images became cleaner and more structured. The team then derived, from an optical imaging model, the geometric relationship between projection length and elevation angle, and used Canny edge maps as the control conditions fed into ControlNet. By freezing the backbone network and training only the branch network, the method achieves generation of radar images whose attitude can be specified precisely in both dimensions.

The dataset construction pipeline follows four sequential steps: computer-aided design modeling, electromagnetic computation, imaging and preprocessing, and the generation of edge maps that serve as control inputs. The researchers established a detailed CAD geometric model of the E-3 AWACS and computed its radar echoes using the large-element physical optics method at a center frequency of 80 gigahertz with a bandwidth of 640 megahertz. The raw echo data were then converted into images through a two-dimensional inverse Fourier transform, and Rayleigh clutter was superimposed on the results to simulate realistic measurement environments. This simulation chain produces radar images whose quality reflects the same physical limitations that affect real measurements. Because the electromagnetic imaging process is bounded by the available signal bandwidth and the finite illumination angles, the energy of strong scattering points diffuses across the image, forming prominent cross-shaped stripe artifacts that severely degrade the usefulness of the data for training. Any generative method built on this data inherits these defects unless the artifacts are removed first.

To clean the images, the team examined the two-dimensional spectrum of the electromagnetic imaging results and found that the stripe noise corresponds to identifiable vertical spectral components. By locating these components and setting them to zero, the frequency-domain filter removes the cross-shaped artifacts while leaving the genuine target scattering structure intact. In parallel, Lee filtering was applied to suppress the multiplicative speckle noise that arises from coherent illumination. A comparison of images before and after processing showed that both the stripe and speckle noise were effectively suppressed, and the reduction of image entropy from 3.24 to 3.06 validated the preprocessing quantitatively. The cleaned images then served as the training targets for the generative model. The final ingredient of the data foundation was the control signal itself: using the derived relationship between projection length and elevation angle, the researchers extracted Canny edge maps from optical images rendered at different attitudes, giving the generator an explicit geometric prescription of how the target should appear at any requested combination of azimuth and elevation.

The generative engine of the method is ControlNet, which employs Stable Diffusion as its backbone. The core of Stable Diffusion is a diffusion model, a class of generative network that learns by gradually transforming an image into Gaussian noise through a forward diffusion process and then learning to reverse the procedure, recovering the image from random noise through iterative denoising steps. During training, the objective is to ensure that the noise predicted by the network matches the noise actually added at each step. Diffusion models of this kind produce remarkably realistic images, but the original formulation lacks fine-grained control capability: the user cannot precisely dictate the geometry of what is generated. ControlNet solves this by constructing a parallel branch network alongside the frozen backbone. The backbone loads and freezes the pre-trained Stable Diffusion weights, preserving the general image generation capability the model acquired from large-scale optical imagery. The branch network, which shares an architecture identical to the backbone’s encoder and bottleneck layers, takes the edge maps as input and injects the attitude information they contain into the upsampling stages of the backbone’s decoder through zero-convolution modules.

The zero convolution is a small but crucial design element. It is a one-by-one convolution whose initial weights and biases are all set to zero, which guarantees that at the start of training the branch network contributes nothing to the backbone and cannot disturb the pre-trained generation capability. As training proceeds, the zero convolutions gradually learn to channel attitude control information from the edge maps into the decoder, so the model acquires precise attitude control without sacrificing the generative priors it already possesses. The detailed architecture of the branch network reflects this division of labor: a two-dimensional convolution module first increases the channel dimension of the input edge maps; three down-sampling modules then extract features at multiple spatial scales, with Transformer blocks embedded in the first three groups to strengthen global modeling capability; and the bottleneck outputs high-level semantic features that summarize the attitude information. This design allows the network to retain everything the pre-trained diffusion model learned about image structure on massive optical datasets while gaining a new, radar-specific skill: rendering a target’s radar signature at an exactly specified viewing geometry.

The experimental validation compared ControlNet against two established generative baselines, InfoGAN and Self-Attention GAN, under identical attitude conditions. The images produced by ControlNet reproduced fine details more accurately in the regions dominated by strong scattering points—particularly the engines, the nose, and the radome—and correctly reflected the dimensional changes in the target’s projected shape as the elevation angle varied. Evaluated across the full dataset of 2,821 images, ControlNet outperformed both comparison methods overall in Structural Similarity Index, Peak Signal-to-Noise Ratio, and Fréchet Inception Distance, the three standard metrics for measuring how closely generated images match real ones. The most striking result emerged under deliberately constrained conditions: when only 46 training images were available, the generation quality of InfoGAN degraded continuously as the training data shrank, whereas ControlNet actually improved. The researchers attribute this inversion to the superior distribution modeling capability of diffusion models when data are sparse, combined with the advantage of the pre-training priors inherited from Stable Diffusion. In scenarios involving self-occlusion, where the fuselage hides portions of the wings and tail from the radar’s line of sight, ControlNet generated the occluded regions correctly, preserving occlusion relationships consistent with real images.

The generality of the method was tested by transferring it to a different aircraft, the Su-27 fighter. ControlNet-generated images of the Su-27 achieved a Structural Similarity Index of 0.87 and a Peak Signal-to-Noise Ratio of 24.15 decibels, far surpassing InfoGAN at 0.31 and 20.82 decibels and Self-Attention GAN at 0.11 and 18.95 decibels. This cross-target performance confirms that the approach is not tied to a single airframe but captures a transferable understanding of how radar projections vary with attitude. For the field of radar automatic target recognition, the implications are practical and immediate. The method offers a way to augment radar image datasets of noncooperative targets at will, specifying any azimuth and elevation combination the recognition algorithm needs, and to fill in the missing aspect angles that electromagnetic computation cannot economically produce. As deep learning continues to drive radar recognition of satellites, aircraft, and debris, controllable synthetic data of this kind may prove to be the ingredient that lets recognition models finally see a noncooperative target from every angle it might present.

Subject of Research: Attitude-controllable radar image generation for noncooperative targets using ControlNet

Article Title: Research on an attitude controllable radar image generation method for noncooperative targets

Article References: Research on an attitude controllable radar image generation method for noncooperative targets. (n.d.). Original publication

Image Credits: AI Generated

DOI: Not provided

Keywords: radar imaging, noncooperative targets, ControlNet, Stable Diffusion, diffusion models, data augmentation, deep learning, automatic target recognition, electromagnetic computation, azimuth and elevation control, E-3 AWACS, Su-27