Neural Networks Give Markowitz’s 70-Year-Old Portfolio Formula a Confidence Boost

More than seventy years after Harry Markowitz introduced Modern Portfolio Theory, the mathematical framework that won him a Nobel Prize is getting a twenty-first-century upgrade. A team of researchers at K. N. Toosi University of Technology in Tehran has unveiled a hybrid framework called Confidence-MPT, which fuses deep learning forecasts into the classical machinery of mean-variance optimization. The study, published in Neural Computing and Applications, tackles a weakness that has haunted institutional investors for decades: the tendency of traditional portfolio models to fall apart precisely when markets become most turbulent.

The core problem is well understood among quantitative finance practitioners. Markowitz’s framework asks investors to weigh expected returns against covariance, the statistical measure of how assets move together, and to select the allocation that delivers the best return per unit of risk. But the expected returns and covariances it consumes are typically estimated from historical data using backward-looking statistical assumptions. When markets undergo structural breaks, sudden regime changes, or volatility spikes of the kind seen during the COVID-19 pandemic, those estimates become stale almost overnight. Portfolios that looked optimal on paper can turn fragile, forcing panicked rebalancing at the worst possible moments.

Confidence-MPT addresses this fragility by inserting a Long Short-Term Memory neural network into the heart of the optimization pipeline. LSTM networks are a class of recurrent neural architectures specifically designed to learn long-range temporal dependencies in sequential data, making them well suited to financial time series where patterns can span weeks or months. In the proposed system, the LSTM is trained on historical price data to produce three simultaneous outputs: a forecast of future returns, an estimate of future volatility, and a novel quantity the authors call predictive confidence, which captures how certain the network is about its own predictions.

The third output is what distinguishes this approach from earlier attempts to marry machine learning with portfolio construction. Rather than blindly feeding neural network forecasts into the Markowitz optimizer, Confidence-MPT dynamically adjusts the expected return vector and the covariance matrix according to both the confidence level and the volatility forecasts. When the network is highly confident and predicted volatility is low, the optimizer can lean more aggressively into the forecasts. When confidence drops or volatility is expected to rise, the framework pulls back, effectively shrinking the influence of uncertain predictions on the final allocation. The result is a portfolio construction process that knows not only what it expects, but how much it trusts its own expectations.

Technically, the workflow proceeds in two stages. First, a scaling and sequencing routine converts raw price series into normalized input windows of fixed length, which are used to train the multi-output LSTM. Second, the trained model supplies confidence-adjusted estimates of the mean return vector and covariance matrix to a classical optimizer, which recomputes portfolio weights. The system then compares the new weights against the previous allocation and applies decision thresholds: if a weight change exceeds a buy threshold, the framework signals a purchase; if it falls below a sell threshold, it signals a sale; otherwise the position is held. This thresholding mechanism is a deliberate design choice aimed at controlling turnover, the costly churn of buying and selling that erodes returns through transaction costs.

To test whether this added intelligence actually pays off, the researchers benchmarked Confidence-MPT against a battery of established strategies using fifteen years of daily stock data from the Dow Jones Industrial Average, sourced from publicly available Yahoo Finance data. The comparison set included the Constant Rebalanced Portfolio, Buy and Hold, Exponentiated Gradient, Dynamic CRP, and the Universal Portfolio, a well-known family of online portfolio selection algorithms that have long served as reference points in the literature. The evaluation was reinforced with Monte Carlo simulations and efficient frontier visualizations, which map out the full landscape of risk-return trade-offs available to an investor under each approach.

The findings are notable for what they do and do not claim. Confidence-MPT did not produce the highest raw returns among the strategies tested, and the authors are candid about that. What the framework delivered instead was a compelling trade-off between performance, risk control, and turnover. Its allocations remained more stable over time than those of competing methods, and it exhibited improved drawdown characteristics during turbulent periods, meaning the peak-to-trough losses investors would have endured were comparatively contained. In practical terms, a portfolio that whipsaws between extreme allocations may win on paper in backtests, but the version that holds steady through a crisis is often the one that survives in the real world.

The Monte Carlo analysis and frontier plots add a further layer of insight by showing how incorporating predictive confidence reshapes the entire risk-return landscape rather than merely shifting a single point on it. By adjusting the inputs to the optimizer, confidence weighting changes which combinations of assets appear efficient, altering the position of the maximum Sharpe ratio portfolio and the minimum-risk portfolio alike. The appendices to the paper present these visualizations in detail, highlighting optimal portfolios under both baseline and alternative scenario assumptions, and demonstrating how the adjusted Sharpe distributions differ when LSTM-based predictions are used in place of purely historical estimates.

The study arrives amid a broader wave of research applying machine learning to investment management, from deep reinforcement learning agents that learn trading policies directly from market data, to hybrid systems that use support vector machines for stock pre-selection before optimization, to knowledge-distilled architectures that connect Markowitz optimization with Bellman equations. A systematic literature review published in 2025 catalogued the rapid expansion of deep learning applications in portfolio management, and recent work has explored robustifying Markowitz under model ambiguity and non-Gaussian return distributions. What sets Confidence-MPT apart within this crowded field is its explicit focus on predictive certainty as a first-class input to optimization, rather than treating the neural network as a black-box oracle whose forecasts are accepted at face value.

For investors and asset managers, the appeal of the framework lies in its realism and scalability. It relies on freely available price data, standard neural network tooling, and a classical optimization core that is well understood by practitioners, making it a plausible candidate for real-world deployment rather than a laboratory curiosity. The authors, Ehsan Ameri, Majid Mirzaee Ghazani, and Donya Rahmani, position the method as a tool for robust portfolio construction in dynamic and uncertain market environments, and their contribution underscores a growing consensus in data-driven finance: the future of portfolio optimization may lie not in replacing the classical frameworks, but in teaching them when to trust the machines that advise them.

Subject of Research: Machine learning-enhanced portfolio optimization integrating LSTM predictions into Modern Portfolio Theory

Article Title: Confidence-MPT: a machine learning-enhanced framework for robust portfolio optimization

Article References: Ameri, E., Ghazani, M. M., & Rahmani, D. (2026). Confidence-MPT: a machine learning-enhanced framework for robust portfolio optimization. Neural Computing and Applications, 38(19), Article 763. https://doi.org/10.1007/s00521-026-12515-z

Image Credits: AI Generated

DOI: 10.1007/s00521-026-12515-z

Keywords: portfolio optimization, Modern Portfolio Theory, LSTM neural networks, machine learning, quantitative finance, risk management, deep learning, covariance estimation, drawdown, Monte Carlo simulation, Dow Jones Industrial Average, financial engineering