The researchers call their model HA-DETR, short for Hierarchical Adaptive Feature Enhancement Detection Transformer. It builds on the detection transformer family of architectures, which replaced the hand-engineered region proposal pipelines of earlier detectors with an end-to-end attention mechanism that reasons about an entire image at once. Since the original DETR appeared in 2020, the family has evolved rapidly through variants such as Deformable DETR, DAB-DETR, and DINO, and recent work has shown that detection transformers can now rival or exceed the one-stage YOLO detectors that long dominated real-time applications. Liu and Jiao’s contribution is not a new backbone or a new loss function, but a set of three modules that intervene at specific points in the feature hierarchy, each tailored to the particular kind of degradation that dominates at that level.

The key observation motivating the architecture is that underwater degradations affect low-level details and high-level semantic representations differently. At the bottom of a convolutional or transformer feature pyramid, the network encodes fine-grained structure: edges, textures, and the delicate outlines of fins, tentacles, and shells. These are precisely the cues that scattering and blur destroy first. Higher up the pyramid, features become more abstract and semantic, encoding what an object is rather than where its boundaries lie, but they become vulnerable to a different problem: attention drifts toward the water column, sediment, and background clutter instead of locking onto the sparse object regions that matter. A single, uniform enhancement strategy applied to all levels therefore tends to help one level at the expense of another, which is why previous enhancement-plus-detection pipelines have delivered mixed results.

HA-DETR’s first component, the Frequency-Domain Feature Enhancement module, addresses the low-level problem by moving the computation into the frequency domain. The idea draws on a growing body of work showing that frequency analysis can separate image content in ways that spatial processing cannot: blur and haze tend to suppress high-frequency components, while object contours and textures concentrate there. By transforming features with operations related to the fast Fourier transform and adaptively reweighting frequency bands, the module restores the perception of blurred objects before the information is lost to deeper layers. This follows a broader trend in vision research, from frequency-aware transformers for image restoration to discrete cosine transform hybrids, that treats spectral information as a first-class citizen rather than a curiosity.

The second component, the Polarity-Aware Feature Interaction module, works at the opposite end of the hierarchy. Its job is to refine high-level semantic features so that the model’s attention concentrates on object regions rather than on the visually dominant but uninformative background. The term polarity refers to the module’s ability to distinguish and separately handle the opposing contributions of foreground and background signals during feature interaction, strengthening the positive evidence for objects while suppressing the negative pull of the surrounding water. In an underwater scene where a fish may occupy only a few percent of the pixels, this foreground-background asymmetry is the difference between a confident detection and a network that dutifully describes the emptiness around the fish.

The third component, the Hierarchical Attention Feature Pyramid Network, tackles the fusion problem that sits between the two extremes. Feature pyramid networks and their many descendants are the standard machinery for combining multi-scale features so that small objects benefit from high-resolution detail and large objects benefit from semantic depth. HA-DETR’s variant uses attention to optimize how information flows across scales and reinforces semantic-guided representation, ensuring that the enhanced low-level detail from the frequency module and the sharpened semantics from the polarity module are combined coherently rather than averaged into mush. The three modules together perform what the authors describe as differentiated processing and adaptive enhancement across semantic levels, allowing the network to preserve fine-grained structures and maintain robust semantic discrimination simultaneously.

The experimental evidence comes from two widely used underwater benchmarks. On DUO, a dataset of underwater object detections assembled from marine imagery with annotations for creatures such as fish, jellyfish, and sea urchins, HA-DETR achieves an average precision of 70.7 percent. On UTDAC2020, a dataset collected in a real aquaculture environment where turbidity and crowding are severe, it reaches 53.2 percent. Both figures represent the model’s superiority over competing approaches reported in the study, and the gap is particularly meaningful on the aquaculture data, where low contrast and heavy occlusion have historically dragged detection scores down. The authors report no competing interests, and the work was accepted by Cluster Computing after revisions in June 2026 and published on 18 September 2026.

What makes the approach notable beyond its benchmark numbers is the way it reframes the relationship between image enhancement and object detection. Much prior work treats underwater enhancement as a preprocessing step, using generative or physics-based models to produce a cleaner image before detection begins. That strategy can help, but it adds computational cost, can introduce artifacts that mislead the detector, and optimizes for visual quality rather than detection performance. HA-DETR instead embeds enhancement directly inside the detection architecture, applying it selectively where the feature hierarchy needs it. This echoes a recent line of research, including edge-aware DETR variants and CNN-transformer hybrids for underwater scenes, that argues detection-aware feature processing beats generic image restoration for this task.

The practical stakes are considerable. Automated monitoring of fish populations, coral reef health, and invasive species depends on reliable detection in conditions no human photographer would choose. Aquaculture operations use cameras to track feeding behavior, growth, and disease outbreaks in pens where visibility is often measured in meters. Autonomous underwater vehicles conducting infrastructure inspection or deep-sea surveying need to identify objects in real time with limited bandwidth back to shore. A detector that maintains accuracy under blur, low contrast, and occlusion extends the operational envelope of all of these systems, potentially reducing the need for human divers in hazardous or remote environments.

There are, of course, caveats. The reported results come from two datasets, and performance on other water bodies, lighting conditions, and sensor types remains to be demonstrated. Transformer-based detectors also carry computational costs that matter for the power-constrained embedded platforms on which many underwater vehicles run, although the field is moving quickly toward efficient attention designs. Still, the hierarchical adaptive principle at the heart of HA-DETR, matching the enhancement strategy to the semantic level being processed, is a general one, and the authors’ results suggest that respecting the structure of the feature hierarchy is one of the most effective ways to make machine vision work where the water refuses to cooperate.

Subject of Research: Transformer-based hierarchical adaptive feature enhancement for underwater object detection

Article Title: HA-DETR: Hierarchical adaptive feature enhancement for underwater object detection

Article References: Liu, T., & Jiao, G. (2026). HA-DETR: Hierarchical adaptive feature enhancement for underwater object detection. Cluster Computing, 29(13), Article 768. https://doi.org/10.1007/s10586-026-06577-w

Image Credits: AI Generated

DOI: 10.1007/s10586-026-06577-w

Keywords: underwater object detection, detection transformer, HA-DETR, frequency-domain enhancement, feature pyramid network, attention mechanism, computer vision, marine monitoring, aquaculture, deep learning, multi-scale feature fusion, image degradation

Lithology identification is one of those deceptively simple tasks that underpins an enormous range of practical work. Geological exploration, mining, tunneling, drilling operations, and hazard assessment all depend on knowing whether the material at hand is granite, basalt, limestone, or something else entirely. Misclassification can propagate through an entire project, from inaccurate resource estimates to unstable excavation designs. Traditionally, the job has fallen to specialists who read visual cues such as grain size, color, foliation, and crystalline structure. Automating that expertise has proven attractive but technically stubborn, because rocks present image-analysis challenges that generic computer vision systems were never designed to handle.

The dominant tool for image classification over the past decade has been the convolutional neural network, or CNN. Convolutional layers excel at detecting local patterns, such as the edges of individual mineral grains or small repetitive textures, because each filter scans only a small neighborhood of pixels at a time. That locality is a strength for fine detail but a weakness for global structure. To understand how grains are distributed across an entire rock face, or how layered patterns stretch across the whole image, a CNN must stack many layers, each expanding its effective field of view. The result is models that can be large, computationally expensive, and still imperfect at representing long-range spatial relationships, which are exactly the relationships that distinguish many lithological classes.

Transformers, borrowed from natural language processing, offered one way forward by letting every part of an image attend to every other part. But that power comes at a steep price: the attention mechanism scales quadratically with the number of image patches, so the cost of processing grows rapidly as image resolution or model size increases. The newer alternative inspiring the Chinese team’s work is the state-space model, and in particular its vision-oriented incarnation known as Mamba. State-space models compress a sequence’s history into a compact hidden state and update it as they scan the input, which means they can model dependencies across an entire image with computational complexity that grows only linearly rather than quadratically. For geologists staring at high-resolution outcrop photographs, that scaling difference is not an academic nicety; it determines whether the model can run on practical hardware in the field or the lab.

SpecMamba-Net combines this linear-complexity global modeling with a second, complementary branch devoted to the frequency domain. The idea rests on a well-known property of image analysis: while spatial representations describe where features are, their Fourier transform describes which patterns repeat and at what scales. Different rock types produce characteristic signatures in the frequency spectrum, because texture is fundamentally a statistical statement about periodicity, granularity, and roughness. The spectral enhancement branch of SpecMamba-Net transforms feature representations into the frequency domain and amplifies the discriminative spectral components that separate one lithology from another, effectively giving the network a tuning fork for rock texture that the purely spatial branch lacks.

The two branches work in parallel. The state-space scanning branch sweeps across the image, building a representation of global spatial dependencies and long-range mineral arrangement patterns at linear cost. The spectral branch, meanwhile, extracts frequency-domain cues tied to texture. A gated fusion mechanism then serves as the arbiter, adaptively deciding how much weight to give spectral features versus spatial evolution features for each input. Rather than forcing the network to choose between texture and structure, the gating lets the model lean on whichever cue is more informative for a given specimen, producing what the authors describe as a more comprehensive lithology representation. This kind of adaptive fusion has become an increasingly popular strategy in remote sensing and hyperspectral imaging, and the study positions SpecMamba-Net within that broader lineage of dual-branch spectral-spatial architectures.

To test the design, the researchers evaluated the model on a seven-class lithology dataset, using five repeated stratified holdout splits to ensure that results were not an artifact of a single lucky train-test division. SpecMamba-Net achieved a mean test accuracy of 0.8654 with a standard deviation of 0.0155, and a macro-F1 score of 0.8667 plus or minus 0.0179, the highest mean performance among all models evaluated in the comparison. The macro-F1 figure is particularly meaningful in this context because it averages performance across classes, preventing a model from posting a flattering score by excelling on common categories while neglecting rare ones. In geology, where some lithologies are inherently overrepresented in field datasets, that class-balanced metric matters.

The authors were careful about statistical rigor in a way that is not always typical of deep learning papers in the geosciences. Paired comparisons at the split level showed statistically supported improvements over most baseline models, which included mainstream CNNs such as ResNet18 and a range of lightweight architectures. Notably, however, the difference from ResNet18 did not reach the conventional significance threshold, a candid acknowledgment that the classic residual network remains a formidable competitor. Equally important, Grad-CAM interpretability analysis provided qualitative evidence that SpecMamba-Net focused its attention on lithologically relevant texture and structural regions of the images rather than on background artifacts or irrelevant correlations. For a field in which scientists must trust automated judgments, that kind of visualizable attention is a genuine selling point.

The practical implications extend across several industries. In tunneling, rapid and reliable lithology identification from tunnel face images informs support design and safety decisions in real time. In drilling, cuttings analysis has already been explored as a target for intelligent image-based logging, and a model that balances accuracy against computational cost could bring such systems closer to deployment on rigs with limited hardware. In mining and geological hazard assessment, automated classification of field photographs could accelerate mapping campaigns that currently demand scarce expert attention. The linear scaling of the Mamba backbone makes the framework attractive wherever high-resolution imagery and constrained compute collide, which describes most field geology.

The work, published as volume 19, article 177 of Earth Science Informatics on 5 September 2026, also reflects a broader shift in how geoscientists think about machine learning architecture. Rather than importing the largest available vision model and fine-tuning it, the authors designed a domain-motivated structure: one branch that asks what textures repeat in the image and another that asks how mineral patterns are organized across it. The favorable balance between classification performance and computational efficiency reported in the study suggests that such purpose-built hybrids may define the next generation of geological AI tools. The datasets analyzed in the research are available from the corresponding author on reasonable request, and the work was supported by the National Natural Science Foundation of China, the Guangxi Science and Technology Program, and the Guangxi Key Laboratory of Geomechanics and Geotechnical Engineering.

Subject of Research: Deep learning-based lithology classification using frequency-domain enhancement and visual state-space modeling

Article Title: A novel Mamba model based on frequency domain enhancement and visual state space for high-precision lithology classification

Article References: Zhang, Y., Zhang, F., Li, R., & Zhang, Z. (2026). A novel Mamba model based on frequency domain enhancement and visual state space for high-precision lithology classification. Earth Science Informatics, 19(10), Article 177. https://doi.org/10.1007/s12145-026-02233-4

Image Credits: AI Generated

DOI: 10.1007/s12145-026-02233-4

Keywords: lithology classification, Mamba, state-space model, frequency-domain enhancement, deep learning, rock images, feature fusion, CNN, Grad-CAM, geological exploration, Earth Science Informatics, machine learning