<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>LSTM neural networks &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/lstm-neural-networks/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Thu, 08 Oct 2026 19:44:48 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>LSTM neural networks &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>Deep learning turns satellite data into week-long flood warnings for Ivory Coast</title>
		<link>https://scienmag.com/deep-learning-turns-satellite-data-into-week-long-flood-warnings-for-ivory-coast/</link>
		
		<dc:creator><![CDATA[Violet Maxwell]]></dc:creator>
		<pubDate>Thu, 08 Oct 2026 19:44:48 +0000</pubDate>
				<category><![CDATA[Climate]]></category>
		<category><![CDATA[Mathematics]]></category>
		<category><![CDATA[AI-driven climate monitoring and prediction]]></category>
		<category><![CDATA[climate resilience and disaster preparedness in Ivory Coast]]></category>
		<category><![CDATA[deep learning]]></category>
		<category><![CDATA[deep learning rainfall forecasting]]></category>
		<category><![CDATA[extreme rainfall]]></category>
		<category><![CDATA[flood early warning]]></category>
		<category><![CDATA[GPM IMERG]]></category>
		<category><![CDATA[hydrological modeling using deep learning]]></category>
		<category><![CDATA[hydrology]]></category>
		<category><![CDATA[innovative flood warning technologies for developing countries]]></category>
		<category><![CDATA[Ivory Coast]]></category>
		<category><![CDATA[Ivory Coast flood early warning system]]></category>
		<category><![CDATA[Long Short-Term Memory neural networks for weather prediction]]></category>
		<category><![CDATA[LSTM neural networks]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[Marahoué River basin]]></category>
		<category><![CDATA[MERRA-2]]></category>
		<category><![CDATA[Rainfall prediction]]></category>
		<category><![CDATA[real-time flood risk assessment in West Africa]]></category>
		<category><![CDATA[remote sensing satellite data for disaster management]]></category>
		<category><![CDATA[satellite data]]></category>
		<category><![CDATA[satellite-based flood prediction]]></category>
		<category><![CDATA[seasonal flooding impact on agriculture in Ivory Coast]]></category>
		<category><![CDATA[seasonal rainfall pattern analysis with neural networks]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=248945</guid>

					<description><![CDATA[Ivorian researchers have shown that LSTM neural networks fed with NASA satellite data can predict daily rainfall up to seven days ahead in a flood-prone region, outperforming conventional machine learning models and opening the door to operational early warning systems.]]></description>
										<content:encoded><![CDATA[<p>In the heart of central-western Ivory Coast, the towns of Bouaflé and Zuénoula live with an annual threat that arrives with the rains. Situated in the Marahoué River basin, where annual precipitation ranges from 1200 to 1600 millimeters and a dense hydrographic network feeds seasonal flooding, these communities have repeatedly watched torrential downpours overwhelm low-lying areas, damage crops of yam, cassava, rice and maize, and endanger lives. A new study published in Advances in Statistical Climatology, Meteorology and Oceanography offers them something they have never had before: a data-driven early warning capability built entirely from deep learning and freely available satellite observations, capable of predicting daily rainfall up to seven days in advance.</p>
<p>The research, led by Satti J. R. Kamenan of the National Polytechnic Institute Félix Houphouët-Boigny in Yamoussoukro, is the first attempt at near real-time rainfall prediction in any of Ivory Coast&#8217;s river basins. The team built a forecasting framework around Long Short-Term Memory neural networks, a deep learning architecture specifically designed to remember patterns across long sequences of data. LSTM networks, first proposed by Sepp Hochreiter and Jürgen Schmidhuber in 1997, use internal gates—forget, input and output gates—that regulate what information is stored, discarded or passed forward through the network&#8217;s memory cells. This structure allows them to capture the long-term temporal dependencies and nonlinear behavior that characterize daily rainfall, something conventional statistical models have long struggled with.</p>
<p>Feeding the neural network required an ambitious data pipeline. The researchers combined ground-based rainfall records from SODEXAM, the Ivorian meteorological agency, covering ten stations in the Marahoué watershed from 1961 to 2022, with two NASA satellite products: GPM IMERG, a high-resolution precipitation dataset with a spatial resolution of 0.1 degrees and roughly 30-minute temporal resolution, and MERRA-2, a reanalysis that blends satellite observations, ground measurements and numerical weather models into consistent atmospheric fields including temperature, wind, pressure and humidity. All of this was processed on Google Earth Engine, the cloud-based platform that has become a workhorse for large-scale environmental data analysis. Before the satellite data could be trusted, the team validated it against rain gauge observations from 2000 to 2017, finding correlation coefficients of 0.80 at Bouaflé and 0.83 at Zuénoula—meaning the satellite product captured more than 80 percent of the observed rainfall variability.</p>
<p>Quality control was a critical and methodical step. The historical gauge records contained gaps of 7.29 to 8.04 percent, and raw observations can harbor errors that would corrupt any machine learning model. The team applied a two-stage screening protocol: first, the interquartile range method flagged values that deviated unusually far from each station&#8217;s typical distribution; second, a spatial consistency check using the network-wide median and median absolute deviation determined whether a flagged value was physically plausible or simply wrong. Crucially, extreme rainfall events that were spatially coherent across the network were retained even when they exceeded statistical thresholds, preventing the accidental deletion of genuine meteorological extremes. Only 689 of 29,510 observations—2.34 percent—were ultimately identified as outliers, and erroneous values were corrected using the validated GPM IMERG estimates as an auxiliary source.</p>
<p>Selecting the right predictors was equally deliberate. From twenty-one candidate atmospheric variables, the researchers used a Pearson correlation matrix to eliminate multicollinearity, keeping only variables with pairwise correlations below 0.60. They then ran a Random Forest model to rank the remaining candidates by importance, retaining twelve predictors—including seven-day antecedent rainfall, vertical atmospheric motion at 500 hectopascals, specific humidity at multiple pressure levels, and wind components—that each contributed meaningfully to predictive accuracy. The final dataset spanned 15,094 daily time steps from January 1984 to April 2024, with data through January 2020 used for training and the final four years reserved entirely for independent validation, a rigorous test of whether the models had truly learned generalizable patterns rather than memorizing the past.</p>
<p>Three separate LSTM models were trained, one for each forecast horizon: one day ahead, three days ahead and seven days ahead. The architecture settled on three layers of 100 neurons each, a learning rate of 0.001 with automatic reduction, a batch size of 32, and an early stopping mechanism that halted training when validation loss stopped improving. The team then pitted the LSTM against three popular machine learning benchmarks—Random Forest, Extra Trees and XGBoost—using standard metrics including the coefficient of determination, Nash-Sutcliffe Efficiency, normalized root mean square error and mean absolute error. The results were striking. At the one-day horizon, the LSTM achieved R-squared and NSE values exceeding 95 percent at both stations, with a normalized RMSE below 10 percent and a mean absolute error under 1 millimeter, placing it firmly in the &#8216;excellent&#8217; category by conventional hydrological standards.</p>
<p>The gap between the deep learning model and its competitors widened as the forecast horizon stretched. At three days ahead, the LSTM still maintained R-squared values between 88 and 90 percent with a normalized RMSE below 10 percent, while the tree-based models saw their accuracy slip, with R-squared often dropping below 65 percent. By seven days ahead, the LSTM was the only model still producing statistically reliable forecasts, with R-squared values between 70 and 81 percent and errors remaining controlled, whereas Random Forest and Extra Trees deteriorated dramatically—mean absolute errors exceeding 7 millimeters and NSE values sometimes falling below 40 percent—and XGBoost performed worst of all. The explanation lies in fundamental architecture: tree-based ensembles treat observations largely as static feature sets, while the LSTM&#8217;s recurrent memory cells explicitly model the sequential structure and long-range dependencies inherent in daily precipitation series.</p>
<p>Honest scrutiny of the model&#8217;s errors revealed both strengths and limits. Residual analysis showed that predictions were largely unbiased for light to moderate rainfall, which constitutes the majority of events in the Marahoué basin, with mean residuals near zero at both stations. But the Kolmogorov-Smirnov test confirmed the residuals were not normally distributed, and a class-by-class examination exposed an intensity-dependent bias: some low-intensity events were slightly underestimated while moderate and heavy rainfall tended to be overestimated, with error dispersion growing sharply for extreme events. This is a well-documented weakness of deep learning applied to precipitation—intense rainfall is rare, irregular and heavily skewed, so models see too few examples to learn its behavior precisely, and recent studies have shown LSTM networks tend to smooth high-intensity peaks rather than reproduce them faithfully.</p>
<p>For the people of Bouaflé and Zuénoula, however, the practical implications are significant. Early warning systems depend less on perfectly reproducing once-a-decade extremes than on reliably tracking the ordinary rainfall regime and flagging major events in time for communities to act—and the LSTM delivers exactly that at lead times of one to three days, with usable guidance even at seven. The authors point to clear paths forward: enriching the training data with additional atmospheric predictors such as convective available potential energy, total column water vapor and sea surface temperatures over the Gulf of Guinea and ENSO regions, applying post-prediction bias correction, and exploring hybrid models that couple neural networks with physical approaches for extreme events. As climate change intensifies rainfall variability across West Africa, this study demonstrates that a developing region can build world-class forecasting capability from open satellite data, cloud computing and a well-designed neural network—no expensive radar infrastructure required.</p>
<p><strong>Subject of Research:</strong> Deep learning-based daily rainfall forecasting using satellite and reanalysis data for flood early warning in the Marahoué River basin, Ivory Coast</p>
<p><strong>Article Title:</strong> Intelligent daily rainfall prediction for early warning using deep learning and satellite data: application to Bouaflé and Zuénoula stations, Ivory coast</p>
<p><strong>Article References:</strong> Kamenan, S. J. R., Youan, T. M., Adja, M. G., Soro, S. I., &amp; Kouassi, A. M. (2026). Intelligent daily rainfall prediction for early warning using deep learning and satellite data: application to Bouaflé and Zuénoula stations, Ivory coast. <em>Advances in Statistical Climatology, Meteorology and Oceanography, 12</em>(1), 173-193. <a href="https://doi.org/10.5194/ascmo-12-173-2026" rel="noopener noreferrer">https://doi.org/10.5194/ascmo-12-173-2026</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.5194/ascmo-12-173-2026" rel="noopener noreferrer">10.5194/ascmo-12-173-2026</a></p>
<p><strong>Keywords:</strong> deep learning, LSTM neural networks, rainfall prediction, flood early warning, GPM IMERG, satellite data, Ivory Coast, Marahoué River basin, machine learning, hydrology, MERRA-2, extreme rainfall</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">248945</post-id>	</item>
		<item>
		<title>AI Takes the Controls: Ensemble Learning Keeps Missiles Steady in Violent Terminal Maneuvers</title>
		<link>https://scienmag.com/ai-takes-the-controls-ensemble-learning-keeps-missiles-steady-in-violent-terminal-maneuvers/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Mon, 05 Oct 2026 14:45:57 +0000</pubDate>
				<category><![CDATA[Space]]></category>
		<category><![CDATA[advanced missile stabilization techniques]]></category>
		<category><![CDATA[aerospace control systems utilizing machine learning]]></category>
		<category><![CDATA[AI-driven stabilization in guided missile terminal phase]]></category>
		<category><![CDATA[Artificial Intelligence]]></category>
		<category><![CDATA[artificial intelligence in aerospace guidance]]></category>
		<category><![CDATA[chaotic flight phase control in guided missiles]]></category>
		<category><![CDATA[DDPG]]></category>
		<category><![CDATA[ensemble learning]]></category>
		<category><![CDATA[ensemble learning for missile control]]></category>
		<category><![CDATA[flight control systems]]></category>
		<category><![CDATA[guided missile terminal maneuver stabilization]]></category>
		<category><![CDATA[high-accuracy missile targeting using AI]]></category>
		<category><![CDATA[innovative AI applications in missile terminal guidance]]></category>
		<category><![CDATA[LSTM neural networks]]></category>
		<category><![CDATA[machine learning for missile roll control]]></category>
		<category><![CDATA[miss distance]]></category>
		<category><![CDATA[missile guidance]]></category>
		<category><![CDATA[missile guidance system improvements with ensemble learning]]></category>
		<category><![CDATA[PID control]]></category>
		<category><![CDATA[reinforcement learning]]></category>
		<category><![CDATA[roll stabilization]]></category>
		<category><![CDATA[simulation of missile dynamics with AI-based control]]></category>
		<category><![CDATA[six-degree-of-freedom simulation]]></category>
		<category><![CDATA[terminal flight]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=238472</guid>

					<description><![CDATA[A Turkish-Indonesian research team shows that an ensemble of machine learning controllers, including reinforcement learning, outperforms classical PID control in stabilizing a simulated missile's roll during aggressive terminal maneuvers, achieving a miss distance as low as 0.14 meters.]]></description>
										<content:encoded><![CDATA[<p>In the final seconds of a guided missile&#8217;s flight, nothing is calm. The airframe is plunging toward its target at high speed, aerodynamic forces are shifting violently, and any sharp yaw command from the guidance system can send the vehicle rolling in ways that threaten both the seeker&#8217;s line of sight and the structural limits of the body. A new study published in the International Journal of Aeronautical and Space Sciences by Ammar Abdurrauf and Eyüp Emre Ülkü of Marmara University in Istanbul and Larasmoyo Nugroho of the Indonesian National Air and Space Agency&#8217;s Rocket Technology Center argues that this chaotic terminal phase is exactly where artificial intelligence can earn its keep. By training machine learning models to generate roll control inputs, the researchers report dramatically tighter stabilization than a classical control loop can deliver, with a simulated miss distance as low as 0.14 meters in the most demanding scenarios.</p>
<p>The team&#8217;s starting point was a full six-degree-of-freedom missile model, the standard simulation framework for capturing how an air-to-ground weapon translates and rotates in three dimensions under the combined influence of thrust, gravity, drag, and aerodynamic moments. Within this virtual environment, the researchers kept the guidance architecture conventional where it worked well: yaw was handled through waypoint navigation, and pitch followed Proportional Navigation Guidance, the time-honored law that steers an interceptor by closing the line-of-sight rotation rate toward zero. The roll channel, however, was the battleground. A baseline proportional-integral-derivative controller, the workhorse of flight control for decades, provided the reference performance against which every artificial intelligence approach would be measured.</p>
<p>Roll control matters more than casual observers might assume. For an axisymmetric missile, roll couples into pitch and yaw dynamics, meaning that an uncontrolled roll can smear the seeker&#8217;s view of the target, distort the effectiveness of canard or fin deflections, and induce structural loading that a slender airframe was never designed to absorb. Prior research has documented how elastic deformation, wrap-around fins, and spin-deformation coupling all conspire to make the roll channel notoriously difficult, particularly for small air-to-surface missiles where actuator authority is limited and disturbances arrive fast. The Turkish-Indonesian team set out to see whether learned controllers could integrate sensor alignment with structural integrity constraints better than a tuned PID loop, especially when the missile is forced into aggressive terminal maneuvers.</p>
<p>The researchers trained and compared four AI strategies. Linear regression served as the simplest baseline, learning a direct mapping from flight states to roll control inputs. A neural network built on long short-term memory units brought the ability to retain information over time, a natural fit for a dynamical system whose history matters. Deep Deterministic Policy Gradient, a reinforcement learning algorithm that continuously refines a control policy through interaction with the environment, added the capacity to discover control strategies that no human engineer would hand-code. Finally, the team built an ensemble combining all three, letting the strengths of regression, recurrent memory, and reinforcement learning compensate for one another&#8217;s weaknesses. Crucially, all models were trained on data generated by the PID controller itself, meaning the AI systems learned from the accumulated experience of the classical controller before surpassing it.</p>
<p>Testing took place under two families of scenarios: straight flight toward the target, and aggressive yaw maneuvers involving 90-degree and 180-degree turns during the terminal phase. Performance was scored on two fronts. The first was roll angle deviation, a direct measure of how well each controller kept the missile&#8217;s roll attitude near its commanded value. The second was terminal miss distance, the ultimate metric in guided munitions, capturing how close the weapon came to its intended impact point. A controller that holds roll beautifully but misses the target by meters is useless; one that hits within centimeters while keeping the airframe stable is the goal.</p>
<p>The ensemble method emerged as the clear winner. In straight flight it delivered near-minimal roll error, essentially matching the best achievable stabilization. During the punishing 90-degree and 180-degree yaw maneuvers, where rapid changes in lateral acceleration ripple through the roll dynamics, the ensemble maintained superior stability while the simpler models struggled. Most strikingly, it achieved the lowest miss distance recorded in the study, 0.14 meters, in the most demanding scenarios. For context, a miss distance measured in tens of centimeters rather than meters represents the difference between a weapon that reliably defeats a target and one that may require multiple engagements.</p>
<p>Deep Deterministic Policy Gradient on its own also proved robust, posting consistently low miss distances and handling the nonlinearities and disturbances that plague the terminal phase with notable composure. This is consistent with a broader trend in aerospace research, where reinforcement learning controllers have shown an appetite for exactly the kinds of high-dimensional, nonlinear problems that frustrate classical gain-scheduled autopilots. The reinforcement learning agent, in effect, learns through trial and error within the simulation which control actions keep the roll channel quiet under conditions no single linear model can describe, and it can do so without an engineer manually re-tuning gains for every flight regime.</p>
<p>The weaker performers were equally instructive. Linear regression and the LSTM network exhibited noticeably higher roll errors and miss distances, indicating limited adaptability to rapid changes in flight conditions. The lesson is not that machine learning fails, but that the choice of architecture matters enormously. A static regression model can interpolate within the data it has seen but has little capacity to respond gracefully when the missile&#8217;s dynamics depart from its training distribution, as they inevitably do during a violent turn. Even a recurrent network with memory, trained purely on PID-generated trajectories, appears to inherit some of the classical controller&#8217;s limitations. The ensemble&#8217;s success suggests that diversity of learning paradigms, rather than any single clever algorithm, is what buys robustness at the edge of the flight envelope.</p>
<p>The implications extend beyond munitions. The same roll-stabilization problem appears in reusable launch vehicles, hypersonic gliders, and small autonomous aircraft, and the study&#8217;s authors sit squarely within a research community, spanning institutions from Marmara University to Indonesia&#8217;s National Research and Innovation Agency, that has been systematically probing where AI control can replace or augment classical loops. Their work was supported by Turkey&#8217;s TÜBİTAK 2209-A university research program and Indonesia&#8217;s Rumah Program, and it follows earlier contributions from the same group on multi-phase missile guidance and reinforcement learning for landing guidance. The pattern across this literature is consistent: learned and hybrid controllers tend to shine precisely where dynamics are fastest and most nonlinear, which is to say where classical control is weakest.</p>
<p>Caveats remain, and the authors are candid about them. Everything reported here is simulation. A six-degree-of-freedom model, however sophisticated, cannot fully capture sensor noise, actuator saturation and lag, structural flexing, or the computational constraints of real flight hardware. The researchers explicitly state that real-world hardware validation remains essential to confirm the simulation outcomes and to support any operational deployment, a caution that echoes throughout the field of AI-augmented flight control. Verification and certification of learned controllers is an unsolved regulatory problem, and no air force will fly a neural network it cannot formally verify. Still, the trajectory of the evidence is hard to ignore. When an ensemble of regression, memory networks, and reinforcement learning can hold a simulated missile steady through a 180-degree terminal turn and guide it to within 14 centimeters of its aim point, the classical autopilot has been put on notice. The next step is proving it in the air.</p>
<p><strong>Subject of Research:</strong> AI-based roll stabilization control for air-to-ground missiles during dynamic terminal flight</p>
<p><strong>Article Title:</strong> AI-Augmented Roll Stabilization for Missiles Under Dynamic Terminal Flight Conditions</p>
<p><strong>Article References:</strong> Abdurrauf, A., Nugroho, L., &amp; Ülkü, E. E. (2026). AI-Augmented Roll Stabilization for Missiles Under Dynamic Terminal Flight Conditions. <em>International Journal of Aeronautical and Space Sciences</em>. <a href="https://doi.org/10.1007/s42405-026-01233-4" rel="noopener noreferrer">https://doi.org/10.1007/s42405-026-01233-4</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s42405-026-01233-4" rel="noopener noreferrer">10.1007/s42405-026-01233-4</a></p>
<p><strong>Keywords:</strong> missile guidance, roll stabilization, artificial intelligence, reinforcement learning, DDPG, LSTM neural networks, PID control, six-degree-of-freedom simulation, terminal flight, miss distance, flight control systems, ensemble learning</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">238472</post-id>	</item>
		<item>
		<title>Neural Networks Give Markowitz&#8217;s 70-Year-Old Portfolio Formula a Confidence Boost</title>
		<link>https://scienmag.com/neural-networks-give-markowitzs-70-year-old-portfolio-formula-a-confidence-boost/</link>
		
		<dc:creator><![CDATA[Cassandra Pierce]]></dc:creator>
		<pubDate>Thu, 01 Oct 2026 21:36:30 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[covariance estimation]]></category>
		<category><![CDATA[Covariance matrix estimation improvements]]></category>
		<category><![CDATA[COVID-19 market impact on portfolio models]]></category>
		<category><![CDATA[deep learning]]></category>
		<category><![CDATA[Deep learning for financial forecasting]]></category>
		<category><![CDATA[Dow Jones Industrial Average]]></category>
		<category><![CDATA[drawdown]]></category>
		<category><![CDATA[financial engineering]]></category>
		<category><![CDATA[Hybrid confidence-based portfolio models]]></category>
		<category><![CDATA[LSTM neural networks]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[machine learning in investment strategies]]></category>
		<category><![CDATA[Market turbulence risk management]]></category>
		<category><![CDATA[Modern Portfolio Theory]]></category>
		<category><![CDATA[Modern Portfolio Theory enhancements]]></category>
		<category><![CDATA[Monte Carlo simulation]]></category>
		<category><![CDATA[Neural networks in portfolio optimization]]></category>
		<category><![CDATA[portfolio optimization]]></category>
		<category><![CDATA[quantitative finance]]></category>
		<category><![CDATA[Quantitative finance advancements]]></category>
		<category><![CDATA[Regime change detection in asset allocation]]></category>
		<category><![CDATA[Resilient investment portfolio frameworks]]></category>
		<category><![CDATA[risk management]]></category>
		<category><![CDATA[Stability of mean-variance optimization]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=223754</guid>

					<description><![CDATA[Researchers in Tehran have developed Confidence-MPT, a hybrid framework that embeds LSTM neural network forecasts and a measure of predictive confidence into classical Markowitz portfolio optimization, delivering steadier allocations and better drawdown behavior during market turmoil.]]></description>
										<content:encoded><![CDATA[<p>More than seventy years after Harry Markowitz introduced Modern Portfolio Theory, the mathematical framework that won him a Nobel Prize is getting a twenty-first-century upgrade. A team of researchers at K. N. Toosi University of Technology in Tehran has unveiled a hybrid framework called Confidence-MPT, which fuses deep learning forecasts into the classical machinery of mean-variance optimization. The study, published in Neural Computing and Applications, tackles a weakness that has haunted institutional investors for decades: the tendency of traditional portfolio models to fall apart precisely when markets become most turbulent.</p>
<p>The core problem is well understood among quantitative finance practitioners. Markowitz&#8217;s framework asks investors to weigh expected returns against covariance, the statistical measure of how assets move together, and to select the allocation that delivers the best return per unit of risk. But the expected returns and covariances it consumes are typically estimated from historical data using backward-looking statistical assumptions. When markets undergo structural breaks, sudden regime changes, or volatility spikes of the kind seen during the COVID-19 pandemic, those estimates become stale almost overnight. Portfolios that looked optimal on paper can turn fragile, forcing panicked rebalancing at the worst possible moments.</p>
<p>Confidence-MPT addresses this fragility by inserting a Long Short-Term Memory neural network into the heart of the optimization pipeline. LSTM networks are a class of recurrent neural architectures specifically designed to learn long-range temporal dependencies in sequential data, making them well suited to financial time series where patterns can span weeks or months. In the proposed system, the LSTM is trained on historical price data to produce three simultaneous outputs: a forecast of future returns, an estimate of future volatility, and a novel quantity the authors call predictive confidence, which captures how certain the network is about its own predictions.</p>
<p>The third output is what distinguishes this approach from earlier attempts to marry machine learning with portfolio construction. Rather than blindly feeding neural network forecasts into the Markowitz optimizer, Confidence-MPT dynamically adjusts the expected return vector and the covariance matrix according to both the confidence level and the volatility forecasts. When the network is highly confident and predicted volatility is low, the optimizer can lean more aggressively into the forecasts. When confidence drops or volatility is expected to rise, the framework pulls back, effectively shrinking the influence of uncertain predictions on the final allocation. The result is a portfolio construction process that knows not only what it expects, but how much it trusts its own expectations.</p>
<p>Technically, the workflow proceeds in two stages. First, a scaling and sequencing routine converts raw price series into normalized input windows of fixed length, which are used to train the multi-output LSTM. Second, the trained model supplies confidence-adjusted estimates of the mean return vector and covariance matrix to a classical optimizer, which recomputes portfolio weights. The system then compares the new weights against the previous allocation and applies decision thresholds: if a weight change exceeds a buy threshold, the framework signals a purchase; if it falls below a sell threshold, it signals a sale; otherwise the position is held. This thresholding mechanism is a deliberate design choice aimed at controlling turnover, the costly churn of buying and selling that erodes returns through transaction costs.</p>
<p>To test whether this added intelligence actually pays off, the researchers benchmarked Confidence-MPT against a battery of established strategies using fifteen years of daily stock data from the Dow Jones Industrial Average, sourced from publicly available Yahoo Finance data. The comparison set included the Constant Rebalanced Portfolio, Buy and Hold, Exponentiated Gradient, Dynamic CRP, and the Universal Portfolio, a well-known family of online portfolio selection algorithms that have long served as reference points in the literature. The evaluation was reinforced with Monte Carlo simulations and efficient frontier visualizations, which map out the full landscape of risk-return trade-offs available to an investor under each approach.</p>
<p>The findings are notable for what they do and do not claim. Confidence-MPT did not produce the highest raw returns among the strategies tested, and the authors are candid about that. What the framework delivered instead was a compelling trade-off between performance, risk control, and turnover. Its allocations remained more stable over time than those of competing methods, and it exhibited improved drawdown characteristics during turbulent periods, meaning the peak-to-trough losses investors would have endured were comparatively contained. In practical terms, a portfolio that whipsaws between extreme allocations may win on paper in backtests, but the version that holds steady through a crisis is often the one that survives in the real world.</p>
<p>The Monte Carlo analysis and frontier plots add a further layer of insight by showing how incorporating predictive confidence reshapes the entire risk-return landscape rather than merely shifting a single point on it. By adjusting the inputs to the optimizer, confidence weighting changes which combinations of assets appear efficient, altering the position of the maximum Sharpe ratio portfolio and the minimum-risk portfolio alike. The appendices to the paper present these visualizations in detail, highlighting optimal portfolios under both baseline and alternative scenario assumptions, and demonstrating how the adjusted Sharpe distributions differ when LSTM-based predictions are used in place of purely historical estimates.</p>
<p>The study arrives amid a broader wave of research applying machine learning to investment management, from deep reinforcement learning agents that learn trading policies directly from market data, to hybrid systems that use support vector machines for stock pre-selection before optimization, to knowledge-distilled architectures that connect Markowitz optimization with Bellman equations. A systematic literature review published in 2025 catalogued the rapid expansion of deep learning applications in portfolio management, and recent work has explored robustifying Markowitz under model ambiguity and non-Gaussian return distributions. What sets Confidence-MPT apart within this crowded field is its explicit focus on predictive certainty as a first-class input to optimization, rather than treating the neural network as a black-box oracle whose forecasts are accepted at face value.</p>
<p>For investors and asset managers, the appeal of the framework lies in its realism and scalability. It relies on freely available price data, standard neural network tooling, and a classical optimization core that is well understood by practitioners, making it a plausible candidate for real-world deployment rather than a laboratory curiosity. The authors, Ehsan Ameri, Majid Mirzaee Ghazani, and Donya Rahmani, position the method as a tool for robust portfolio construction in dynamic and uncertain market environments, and their contribution underscores a growing consensus in data-driven finance: the future of portfolio optimization may lie not in replacing the classical frameworks, but in teaching them when to trust the machines that advise them.</p>
<p><strong>Subject of Research:</strong> Machine learning-enhanced portfolio optimization integrating LSTM predictions into Modern Portfolio Theory</p>
<p><strong>Article Title:</strong> Confidence-MPT: a machine learning-enhanced framework for robust portfolio optimization</p>
<p><strong>Article References:</strong> Ameri, E., Ghazani, M. M., &amp; Rahmani, D. (2026). Confidence-MPT: a machine learning-enhanced framework for robust portfolio optimization. <em>Neural Computing and Applications, 38</em>(19), Article 763. <a href="https://doi.org/10.1007/s00521-026-12515-z" rel="noopener noreferrer">https://doi.org/10.1007/s00521-026-12515-z</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s00521-026-12515-z" rel="noopener noreferrer">10.1007/s00521-026-12515-z</a></p>
<p><strong>Keywords:</strong> portfolio optimization, Modern Portfolio Theory, LSTM neural networks, machine learning, quantitative finance, risk management, deep learning, covariance estimation, drawdown, Monte Carlo simulation, Dow Jones Industrial Average, financial engineering</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">223754</post-id>	</item>
		<item>
		<title>AI Learns to Drill: Deep Learning and Evolutionary Algorithms Could Slash Carbonate Drilling Costs</title>
		<link>https://scienmag.com/ai-learns-to-drill-deep-learning-and-evolutionary-algorithms-could-slash-carbonate-drilling-costs/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Wed, 30 Sep 2026 18:46:52 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[AI-powered drilling optimization]]></category>
		<category><![CDATA[artificial intelligence in petroleum engineering]]></category>
		<category><![CDATA[Asmari Formation]]></category>
		<category><![CDATA[carbonate reservoir drilling cost reduction]]></category>
		<category><![CDATA[carbonate reservoirs]]></category>
		<category><![CDATA[cost savings in offshore drilling]]></category>
		<category><![CDATA[deep learning in oil and gas exploration]]></category>
		<category><![CDATA[deep learning-based drilling performance enhancement]]></category>
		<category><![CDATA[drilling engineering]]></category>
		<category><![CDATA[drilling optimization]]></category>
		<category><![CDATA[environmentally gentler drilling technologies]]></category>
		<category><![CDATA[evolutionary algorithms for wellbore stability]]></category>
		<category><![CDATA[intelligent drilling system development]]></category>
		<category><![CDATA[LSTM neural networks]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[machine learning for drilling efficiency]]></category>
		<category><![CDATA[mechanical specific energy]]></category>
		<category><![CDATA[multi-objective optimization]]></category>
		<category><![CDATA[NSGA-III]]></category>
		<category><![CDATA[optimization of drilling parameters with AI]]></category>
		<category><![CDATA[predictive modeling for wellbore drilling]]></category>
		<category><![CDATA[rate of penetration]]></category>
		<category><![CDATA[SHAP interpretability]]></category>
		<category><![CDATA[torque prediction]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=218238</guid>

					<description><![CDATA[An integrated framework combining LSTM deep learning, explainable AI, and NSGA-III multi-objective optimization predicts drilling speed gains of up to 68 percent in heterogeneous carbonate reservoirs while enforcing physical feasibility constraints.]]></description>
										<content:encoded><![CDATA[<p>Drilling an oil or gas well is one of the most expensive industrial activities on Earth, and nowhere is that truer than in the notoriously unpredictable carbonate reservoirs that hold much of the world&#8217;s petroleum. A new study published in the journal Results in Engineering describes an integrated artificial intelligence framework that promises to make drilling through these geologically chaotic formations faster, cheaper, and mechanically gentler on equipment. The work, carried out on field data from the Asmari Formation in southwest Iran, combines a deep learning model capable of reading the temporal fingerprints of drilling with an evolutionary optimizer that searches for the best possible operating settings at every point along the wellbore. The stakes are enormous: drilling can account for 30 to 60 percent of total well construction costs, and deepwater rig rates can exceed half a million dollars per day. Because the rate of penetration, or ROP, directly determines how long a rig must be hired, even a ten percent improvement in drilling speed can save millions of dollars on a single offshore well.</p>
<p>The central problem the researchers set out to solve is one that has plagued drilling engineering for decades. The rate of penetration depends on a handful of controllable parameters, chiefly weight on bit, rotary speed, and mud flow rate, but their effects are fiercely nonlinear and entangled with rock strength, pore pressure, in-situ stresses, and the whims of lithology. Early physics-based models, such as the classic Bourgoyne and Young formulation from 1974, required extensive calibration and performed poorly in complex reservoirs; one comparative study reported coefficients of determination as low as 0.12 when such models were applied to heterogeneous formations. Machine learning has since transformed prediction accuracy, but the field has remained fragmented. Predictive models are built to win accuracy benchmarks, then optimization algorithms are bolted on separately, meaning the subtle time-dependent patterns the models capture are never actually exploited when deciding how to drill. Worse, most models operate as black boxes, offering engineers no way to understand why a particular parameter combination is recommended, which undermines trust and slows adoption at the rig site.</p>
<p>The new framework, developed by Shadfar Davoodi, closes these gaps with a deliberately unified design. At its heart are two long short-term memory networks, a type of recurrent neural network built to capture dependencies across sequences. One LSTM predicts the rate of penetration, the other predicts torque, and both were trained on 5,738 records compiled from three vertical wells penetrating the Asmari Formation, a carbonate sequence of limestone, dolomitic limestone, and dolomite with unconfined compressive strength values ranging from roughly 40 to well over 100 megapascals. Crucially, the same LSTM surrogate used for prediction was embedded directly into the optimization engine, a many-objective evolutionary algorithm called NSGA-III, ensuring that the recommendations the optimizer produces rest on exactly the same model that demonstrated its predictive skill. The optimizer juggles three competing goals simultaneously: maximize drilling speed, minimize torque, and minimize mechanical specific energy, the energy required to remove a unit volume of rock.</p>
<p>The choice of training data reflects a subtle but important insight about machine learning in the field. Well A represented efficient drilling, with penetration rates typically between 10 and 30 meters per hour, low torque, and stable hydraulics. Well B was the nightmare scenario: intensely cemented dolomite intervals with strength approaching 300 megapascals, exceptionally low rotary speeds averaging just 3.3 revolutions per minute, and torque readings averaging over 8,000 pound-feet. By training on these two extremes, the model learned both what good drilling looks like and what corrective actions dysfunctional drilling demands. Well C, representing moderate conditions, was withheld entirely as an unseen test. The results were striking: the LSTM models generalized to the unseen well with a coefficient of determination of 0.80 for penetration rate and a remarkable 0.98 for torque, strong evidence that the networks had learned genuine physical relationships rather than memorizing well-specific quirks.</p>
<p>Interpretability was baked into the workflow through SHAP analysis and partial dependence plots, techniques that open the black box and reveal which inputs drive predictions and in which direction. The analysis identified rotary speed as the single most influential parameter governing drilling performance, followed by standpipe pressure, which reflects hydraulic energy and hole cleaning, and weight on bit. The partial dependence curves displayed textbook drilling physics: penetration rate rises with weight on bit but saturates once an efficient operating region is reached, harder rock predictably slows the bit, and increasing drilling fluid pressure drags performance down through differential-pressure effects that hold rock chips in place. Perhaps most intriguingly, the torque model revealed an inverse relationship with rotary speed in the low-RPM regime, a signature of the transition from destructive stick-slip vibration to stable rotation, a phenomenon well known to drilling engineers but rarely recovered automatically from data.</p>
<p>The optimization stage enforced a hard physical constraint that many previous studies ignored: the mechanical specific energy of any recommended solution must exceed the unconfined compressive strength of the rock, the minimum energy thermodynamically required to break it. Solutions violating this rule were penalized into infeasibility, and by the twentieth generation of each optimization run more than 95 percent of candidate solutions satisfied the constraint, with final Pareto fronts containing 100 percent feasible solutions. Out-of-distribution penalties based on Mahalanobis distance kept recommendations within or near the training data envelope, guarding against the unreliable extrapolations that plague data-driven models pushed beyond their evidence. The optimizer also outperformed its rivals in head-to-head comparisons, achieving higher hypervolume and better-distributed solution sets than NSGA-II and MOEA/D under identical settings.</p>
<p>The predicted improvements varied dramatically between wells, and the reasons why are as instructive as the numbers themselves. Well A, already drilled near its optimum, showed only a modest 2.7 percent predicted gain in penetration rate, but the optimizer simultaneously cut torque by 5.3 percent and mechanical specific energy by 21.3 percent by shifting toward a hydraulically assisted strategy with lower rotary speed and increased flow. Wells B and C, both operated far from their ideal settings, showed predicted penetration rate improvements of 66.9 and 68.4 percent respectively, achieved by abandoning weight-dominated drilling in favor of rotation-dominated strategies. In Well B, the absolute changes were substantial: recommended weight on bit dropped from 34.5 to 11.8 kilopounds, torque fell by nearly 4,900 pound-feet, and predicted penetration rate rose from 8.4 to 14 meters per hour. Notably, the optimizer recovered established rock-mechanics principles, favoring rotary-speed-driven strategies in soft formations and balanced weight-and-speed strategies in harder rock, without ever being explicitly programmed with them.</p>
<p>The authors are candid about the limits of these figures. All reported improvements are surrogate-model predictions, not field-validated results, and the framework has not yet been connected to real-time data acquisition systems or tested in an actual drilling campaign. Generalization was demonstrated only by interpolation within a single carbonate field; performance in sandstones, shales, or geologically distinct reservoirs remains unproven. The study also acknowledges that standpipe pressure and drilling fluid pressure were held at measured values during optimization even though they are hydraulically coupled to flow rate, a simplification that means recommendations should be treated as indicative pending hydraulic verification. Practical deployment would also require smoothing the per-interval setpoint recommendations, since asking a drill crew to adjust parameters every ten meters is neither realistic nor necessarily safe.</p>
<p>Still, the architecture of the framework points clearly toward the future of the discipline. Once trained, the LSTM models deliver predictions in two to five milliseconds on a standard processor, fast enough for real-time advisory use at the rig site without retraining. The full pipeline runs offline in roughly twenty hours, generating a library of Pareto-optimal recommendations indexed by formation properties that a driller could consult as conditions change. The framework is explicitly positioned as an advisory tool rather than an autonomous control system, informing human decisions rather than replacing them. If field trials confirm the predicted gains, the implications extend well beyond a single Iranian oil field: a transparent, physics-constrained recipe for teaching machines to drill smarter could reshape the economics of one of the most capital-intensive industries on the planet, one optimized meter of rock at a time.</p>
<p><strong>Subject of Research:</strong> Machine learning and multi-objective optimization of drilling performance in heterogeneous carbonate reservoirs</p>
<p><strong>Article Title:</strong> Drilling performance enhancement in heterogeneous carbonate reservoirs: An integrated machine-learning and multi-objective optimization approach</p>
<p><strong>Article References:</strong> Davoodi, S. (2026). Drilling performance enhancement in heterogeneous carbonate reservoirs: An integrated machine-learning and multi-objective optimization approach. <em>Results in Engineering, 32</em>, Article 113178. <a href="https://doi.org/10.1016/j.rineng.2026.113178" rel="noopener noreferrer">https://doi.org/10.1016/j.rineng.2026.113178</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> Not provided</p>
<p><strong>Keywords:</strong> drilling optimization, rate of penetration, LSTM neural networks, NSGA-III, carbonate reservoirs, mechanical specific energy, SHAP interpretability, Asmari Formation, machine learning, torque prediction, multi-objective optimization, drilling engineering</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">218238</post-id>	</item>
	</channel>
</rss>
