Wednesday, August 26, 2026
Science
No Result
View All Result
  • Login
  • HOME
  • SCIENCE NEWS
  • CONTACT US
  • HOME
  • SCIENCE NEWS
  • CONTACT US
No Result
View All Result
Scienmag
No Result
View All Result
Home Science News Earth Science

Study compares attention and transformer models predicting daily river flows in Iran

August 26, 2026
in Earth Science
Reading Time: 5 mins read
0
Study compares attention and transformer models predicting daily river flows in Iran

Study compares attention and transformer models predicting daily river flows in Iran

65
SHARES
587
VIEWS
Share on FacebookShare on Twitter
ADVERTISEMENT

River forecasting has entered a new phase in which artificial intelligence is being asked to do more than follow yesterday’s hydrograph. A study published in Earth Science Informatics reports that a transformer-based model equipped with an attention mechanism substantially outperformed several established deep-learning approaches in predicting daily streamflow across three rivers in West Azerbaijan Province, Iran. The research compares six architectures—Long Short-Term Memory, Attention-LSTM, Encoder-LSTM, CEEMDAN-LSTM, Informer, and Attention-Informer—and concludes that the last of these, known as A-Informer, delivered the most reliable predictions across all monitoring stations. Its performance remained strong not only during ordinary flow conditions but also during the sudden discharge surges that often accompany floods.

The stakes behind this technical comparison are considerable. River discharge forecasts support reservoir operations, irrigation planning, drought response, flood warnings, and the allocation of limited water resources. In regions where rainfall is highly variable and hydrological systems are influenced by complex terrain, seasonal climate patterns, and rapidly changing atmospheric conditions, a small forecasting error can have practical consequences. Traditional statistical models often struggle with nonlinear relationships and long-term dependencies in environmental data. Deep-learning systems can identify such relationships, but their effectiveness depends heavily on how they represent time, how they select relevant information, and how efficiently they learn from multiple interacting variables. The West Azerbaijan study focuses on that problem by testing recurrent and transformer architectures under the same multivariate forecasting framework.

The models were trained with daily measurements of precipitation, air temperature, relative humidity, evaporation, air pressure, and wind speed. These variables provide a compact description of the atmospheric conditions that influence the movement of water through a watershed. Rainfall can produce a rapid rise in discharge, while temperature affects snowmelt and evaporation; humidity, pressure, and wind help describe the broader meteorological setting in which precipitation and water loss occur. By combining these inputs, the researchers sought to move beyond single-variable forecasting based only on historical river flow. The approach is particularly relevant to ungauged or sparsely monitored basins, where meteorological observations may be more widely available than detailed information about every physical process occurring within the catchment.

At the heart of the comparison is the difference between recurrent neural networks and transformers. LSTM networks process a sequence step by step, carrying forward an internal memory that helps them connect current conditions with earlier events. Their gating system allows the network to retain or discard information, making LSTMs more capable than conventional recurrent networks of learning delayed hydrological responses. However, sequential processing can make it difficult to capture relationships across long time windows, and the model may devote too much capacity to information that is not equally important. Attention mechanisms address this limitation by assigning different weights to elements of the input sequence. Instead of treating every previous observation as equally influential, attention allows the model to emphasize the meteorological patterns most relevant to the discharge being predicted.

The Informer model extends the transformer concept for long-sequence time-series forecasting. Standard transformers rely on self-attention, a mechanism that compares each time step with others in the sequence to identify relationships. That procedure can become computationally expensive as the sequence grows. Informer reduces this burden through more efficient attention calculations and a strategy designed to identify the most influential patterns rather than processing every possible interaction with equal intensity. It also uses an encoder-decoder structure to transform historical observations into future predictions. In the study, the Attention-Informer architecture adds another layer of selective focus, allowing the system to concentrate on the meteorological signals and temporal features that matter most for streamflow dynamics.

The results presented by the researchers show a consistent advantage for A-Informer. Across the three rivers, the model achieved correlation coefficients above 0.90 and Nash–Sutcliffe efficiency values exceeding 0.88. The correlation coefficient measures how closely predicted and observed discharge vary together, while the Nash–Sutcliffe efficiency compares the model against a basic benchmark based on the mean observed flow. A value approaching one indicates that the forecasts reproduce the observed pattern with high skill. A-Informer also produced the lowest reported errors, with root mean square error values of approximately 1.53 to 3.33 and mean absolute error values of about 0.87 to 1.84, depending on the station. Because root mean square error gives greater weight to large mistakes, its reduction is especially important when forecasting flood-related peaks.

The study’s visual analyses add an important dimension to the numerical scores. According to the authors, A-Informer tracked both low-flow periods and extreme peaks more accurately than the competing architectures. This distinction matters because a model can achieve a strong average score while still smoothing away short-lived floods or exaggerating minor fluctuations. Low-flow prediction is essential for assessing water availability and ecological stress, whereas accurate peak detection is central to flood preparedness and infrastructure safety. The researchers also evaluated peak-flow agreement, deviation, and bias, finding that A-Informer showed the highest concordance and the smallest departures from observed peak events. In practical terms, the model was less likely to miss or misrepresent the timing and magnitude of the sharp rises that challenge operational forecasting systems.

The CEEMDAN-LSTM model included in the comparison represents a different strategy for improving recurrent forecasting. Complete Ensemble Empirical Mode Decomposition with Adaptive Noise, or CEEMDAN, separates a complex signal into components operating at different time scales before those components are processed by an LSTM. Such decomposition can reveal oscillations, trends, and irregular fluctuations that may be hidden in the original discharge series. Although this hybrid design can improve a recurrent model’s ability to handle nonstationary data, the reported results indicate that signal decomposition alone did not match the performance achieved by the attention-enhanced transformer. The comparison suggests that the capacity to identify relevant relationships directly across long sequences may be more valuable than relying primarily on pre-processing to simplify the streamflow signal.

The authors describe their work as a systematic evaluation of advanced deep-learning models in a heterogeneous hydrological environment, but the findings also highlight important limits. The study used existing observations rather than generating a new dataset, and the underlying data and code are not openly provided; the authors state that code may be requested from the corresponding author. Strong performance across three rivers in West Azerbaijan does not automatically guarantee the same results in basins with different climates, land cover, snow regimes, reservoir operations, or data quality. Transformer models can also require substantial computational resources and careful tuning, and high predictive accuracy does not by itself explain the physical causes of a flood. Even so, the results offer a compelling signal for water-management agencies: combining efficient long-sequence attention with multivariate meteorological information may provide a more responsive and dependable route to daily streamflow forecasting, particularly when the next forecast must capture not just the river’s usual rhythm, but its most dangerous departures from it.

Subject of Research: Comparative evaluation of deep-learning models for multivariate daily streamflow prediction in three rivers of West Azerbaijan Province, Iran.

Article Title: Comparative evaluation of attention-based and transformer deep learning models for multivariate daily streamflow prediction in rivers of West Azerbaijan, Iran

Article References: Keshavar, M. R., & Parvishi, A. (2026). “Comparative evaluation of attention-based and transformer deep learning models for multivariate daily streamflow prediction in rivers of West Azerbaijan, Iran.” Earth Science Informatics, 19, Article 165.

Image Credits: AI Generated

DOI: https://doi.org/10.1007/s12145-026-02212-9

Keywords: Daily streamflow prediction; deep learning; attention mechanism; transformer architecture; Informer; Attention-Informer; flood forecasting; hydrology

Tags: advanced flood warning systemsattention mechanism in deep learningcomparison of LSTM and transformer-based modelsdaily streamflow forecasting Irandeep learning architectures for environmental dataflood prediction and managementhydrological time series analysisimpact of variable rainfall on river dischargeirrigation planning using AIreservoir operation optimizationriver flow predictiontransformer models for hydrology
Share26Tweet16
Previous Post

Gypsy Retrotransposon Insertion Causes Stay-Green Chinese Cabbage by Blocking Chlorophyll b Breakdown

Next Post

Urbanization Intensifies Ecological Sensitivity in Southwest China, Deyang City Study Finds

Related Posts

Urbanization Intensifies Ecological Sensitivity in Southwest China, Deyang City Study Finds
Earth Science

Urbanization Intensifies Ecological Sensitivity in Southwest China, Deyang City Study Finds

August 26, 2026
Volcanic Eruptions, Warming Climate Disrupt Indian-Pacific Ocean Connections
Earth Science

Volcanic Eruptions, Warming Climate Disrupt Indian-Pacific Ocean Connections

August 26, 2026
19th-Century Volcanism Disrupted Pacific–Indian Ocean Climate Variability Coupling
Earth Science

19th-Century Volcanism Disrupted Pacific–Indian Ocean Climate Variability Coupling

August 26, 2026
Shrub Expansion Swept Subarctic High Elevations During Ancient and Modern Warming
Earth Science

Shrub Expansion Swept Subarctic High Elevations During Ancient and Modern Warming

August 26, 2026
How Flow Speed and Contact Area Influence Solute Transport Through Rock Fractures
Earth Science

How Flow Speed and Contact Area Influence Solute Transport Through Rock Fractures

August 26, 2026
New model resolves Salish Sea’s shallow intertidal and deep estuarine circulation simultaneously
Earth Science

New model resolves Salish Sea’s shallow intertidal and deep estuarine circulation simultaneously

August 26, 2026
Next Post
Urbanization Intensifies Ecological Sensitivity in Southwest China, Deyang City Study Finds

Urbanization Intensifies Ecological Sensitivity in Southwest China, Deyang City Study Finds

  • Mothers who receive childcare support from maternal grandparents show more

    Mothers who receive childcare support from maternal grandparents show more parental warmth, finds NTU Singapore study

    27656 shares
    Share 11059 Tweet 6912
  • University of Seville Breaks 120-Year-Old Mystery, Revises a Key Einstein Concept

    1061 shares
    Share 424 Tweet 265
  • Bee body mass, pathogens and local climate influence heat tolerance

    682 shares
    Share 273 Tweet 171
  • Researchers record first-ever images and data of a shark experiencing a boat strike

    546 shares
    Share 218 Tweet 137
  • Groundbreaking Clinical Trial Reveals Lubiprostone Enhances Kidney Function

    531 shares
    Share 212 Tweet 133
Science

Embark on a thrilling journey of discovery with Scienmag.com—your ultimate source for cutting-edge breakthroughs. Immerse yourself in a world where curiosity knows no limits and tomorrow’s possibilities become today’s reality!

RECENT NEWS

  • Outcome Scale Alters Treatment Effect Estimates in Traumatic Brain Injury Trials
  • Connectome-Constrained Fly Vision Model Reveals Stable Direction Representations Within Limited Scales
  • What Drives Farmers to Join the U.S. Conservation Reserve Program?
  • How Soil Amendments Affect Antibiotic Forms and Bioavailability in Saline-Alkali Soils

Categories

  • Agriculture
  • Anthropology
  • Archaeology
  • Athmospheric
  • Biology
  • Biotechnology
  • Blog
  • Bussines
  • Cancer
  • Chemistry
  • Climate
  • Earth Science
  • Editorial Policy
  • Marine
  • Mathematics
  • Medicine
  • Pediatry
  • Policy
  • Psychology & Psychiatry
  • Science Education
  • Social Science
  • Space
  • Technology and Engineering

Subscribe to Blog via Email

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 5,150 other subscribers

© 2025 Scienmag - Science Magazine

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In
No Result
View All Result
  • HOME
  • SCIENCE NEWS
  • CONTACT US

© 2025 Scienmag - Science Magazine

Discover more from Science

Subscribe now to keep reading and get access to the full archive.

Continue reading