Now a research team from China Southern Power Grid and its Energy Development Research Institute has unveiled a planning framework that confronts this problem head-on. Writing in Frontiers in Energy Research, they describe a transmission network expansion planning method in which a deep reinforcement learning agent learns to build new lines sequentially while treating dynamic grid strength not as a static boundary condition but as an actively managed indicator that fluctuates with real-time renewable output. The work addresses a gap that conventional planning models have largely overlooked: the coupling between investment decisions, alternating-current power flow, and a stability index that has no compact closed form.

The algorithmic difficulty is central to the story. Classical transmission network expansion planning is either solved by mathematical programming, which demands that the feasible region be expressed as closed-form mixed-integer convex constraints, or by heuristics that repeatedly evaluate a fixed analytical objective. The short-circuit ratio, however, depends on the network’s Thevenin impedance and instantaneous renewable injections through a non-convex, topology-dependent mapping that must be recomputed for every candidate topology, operating scenario, and contingency. This couples binary investment decisions, the AC power-flow state, and per-scenario stability evaluation into a single non-convex problem whose constraint set explodes with the number of scenarios and N-1 cases, rendering exact mathematical programming intractable and leaving heuristics unable to embed the stability index analytically.

To tame the uncertainty of wind and solar generation, the team first needed a smarter way to distill a year of operational data into representative scenarios. Conventional clustering schemes typically group raw samples or hand-crafted statistical descriptors such as means, variances, and ramp rates, treating each time window as a static feature point and discarding the underlying nonlinear temporal dynamics. As a result, windows with similar averages but markedly different fluctuation rhythms or persistence are easily merged, and the resulting typical scenarios may misrepresent the multi-scale dynamic behavior that drives both renewable accommodation and grid-strength stress.

The researchers turned to the Koopman operator framework for a principled remedy. By lifting the nonlinear generation process into a latent space in which its evolution is approximately linear, a neural Koopman embedding exposes interpretable spectral attributes, including modal frequency, decay, and activation strength, that compactly summarize the dynamics of each window. The team built an encoder-linear-decoder architecture trained with multi-step consistency and reconstruction losses, regularized with stability and sparsity priors on the linear operator. After convergence, eigendecomposition of the learned operator yields approximate Koopman modes whose eigenvalues encode both persistence and oscillation frequency. Clustering in this spectral-feature space with K-Means therefore groups scenarios by genuine dynamical similarity rather than instantaneous magnitude. Applied to 8,760 hourly records of historical wind output and load, the pipeline produced six representative daily scenarios with a silhouette coefficient of 0.58, a relative error in mean output of just 3.2 percent, and probability coverage of 96 percent of the annual samples.

With the scenario set fixed, the framework quantifies voltage support using the Multiple Renewable-energy Stations Short-Circuit Ratio, or MRSCR. Physically, at each interconnection node this index is the ratio between the grid’s short-circuit support and the composite load equivalently mapped to that node by multiple renewable plants through network coupling, capturing both the local plant’s injection and the influence of other plants via mutual impedances. The index increases with stronger short-circuit support or weaker coupling and decreases with higher injections, stronger coupling, or unfavorable phase differences. Because time-varying renewable outputs directly modify the denominator’s composite equivalent load while network changes simultaneously affect the numerator and the mutual-coupling terms, the MRSCR margin rises or falls across scenarios and can even drop below threshold. The team adopted a station-side requirement of roughly 2.5 to 3.3, refined from the widely accepted classification in which a short-circuit ratio below about 2 denotes a very weak connection prone to control-loop instability and above 3 a strong connection.

The planning problem itself was then reformulated as a Markov Decision Process. The state represents the grid topology at each decision step, the action is the discrete decision to construct a single line from a candidate set, and the reward is the negative of the total cost, combining annualized investment and maintenance costs at each step with the expected operational cost, including network loss, wind curtailment, and load shedding, delivered as a large terminal reward when the agent stops. Crucially, the aggregated MRSCR margin enters the reward as a penalty and incentive term, steering the agent away from weak node-scenario pairs during policy search. Because calculating the true reward for a single action would require solving thousands of mixed-integer nonlinear programs across all scenarios and contingencies, the team pre-trained two lightweight graph neural network surrogates on 24,000 topology-scenario labelled pairs, achieving validation mean absolute percentage errors of 3.2 percent for operational cost and 5.1 percent for the stability margin.

The agent itself is a dueling Graph Neural Network-based Double Deep Q-Network. The policy GNN takes the grid topology as input and learns latent feature representations for nodes and edges by aggregating neighborhood information, capturing complex topological dependencies. Its graph-level embedding feeds two separate streams, one estimating the value of being in a state and the other estimating the relative advantage of each action, a dueling structure that stabilizes learning by decoupling state value from action value. DDQN further mitigates the overestimation bias of standard Q-learning by decoupling action selection, performed by the online network, from action evaluation, performed by a periodically synchronized target network. Training over 5,000 episodes showed DDQN beginning significant learning progress around step 1,000 and converging within 2,000 steps, with cumulative reward stabilizing at approximately 1.85, roughly double the best DQN configuration, and a post-convergence reward curve far smoother than DQN’s oscillating trajectories.

Validated on the CEPRI-VC-88 system, a representative high-renewable-penetration standard test network with 100 buses, 2.4 gigawatts of installed renewable capacity against 6.3 gigawatts of conventional generation, and a 500-kilovolt direct-current line delivering 0.8 gigawatts, the framework produced striking results. The initial grid suffered an annual wind curtailment rate of 12.8 percent, driven by congestion and insufficient delivery capability at renewable interconnection points. As the DDQN agent sequentially reinforced the network, curtailment fell monotonically, and the final plan reduced the annual rate to 1.5 percent, cutting curtailed energy from 500 gigawatt-hours to 59 gigawatt-hours out of 3,900 gigawatt-hours available. Compared with the standard Deep Q-Network and Particle Swarm Optimization baselines, DDQN achieved the highest MRSCR margin of 1.57, reduced line construction costs by approximately 4.32 million dollars relative to PSO, and delivered a total planning cost of 73.88 million dollars, the most cost-efficient expansion strategy among the methods tested.

Perhaps most importantly, the dynamic-stability requirement was enforced in two complementary stages. During policy search the MRSCR margin acted as a soft constraint within the reward, and the candidate plan returned by the agent was then subjected to an exact feasibility verification in which the index was recomputed for every node and every typical scenario using the full, non-surrogate impedance model across all N-1 contingencies. The minimum exact margin over all node-scenario pairs confirmed that the planned network satisfies the voltage-support requirement in every representative scenario, with no scenario of inadequate short-circuit ratio remaining. The authors acknowledge that the residual gap between surrogate prediction and the exact index, although bounded and corrected in this work, may grow on larger systems, and they point toward tighter surrogate fidelity and direct embedding of safety-constrained reinforcement learning as future directions. The results demonstrate that this learning-based approach provides a powerful and forward-looking paradigm for grid planning, effectively balancing economic, renewable accommodation, and dynamic stability objectives to foster a more resilient power grid.

Subject of Research: A deep reinforcement learning planning framework that embeds dynamic short-circuit ratio constraints into grid expansion decisions reduced annual wind curtailment from 12.8% to 1.5% and eliminated all inadequate-stability scenarios on the CEPRI-VC-88 test system.

Article Title: Voltage support strength-constrained transmission network expansion planning for renewable-integrated grids via deep reinforcement learning

Article References: Li, J., Wang, K., Li, Y., Guo, X., Yuan, K., Li, H., Luo, W., & Chen, L. (2026). Voltage support strength-constrained transmission network expansion planning for renewable-integrated grids via deep reinforcement learning. Frontiers in Energy Research, 14, Article 1869996. https://doi.org/10.3389/fenrg.2026.1869996

Image Credits: AI Generated

DOI: 10.3389/fenrg.2026.1869996

Keywords: deep reinforcement learning, power grid planning, renewable energy integration, short-circuit ratio, transmission network expansion, voltage stability, Neural Koopman, wind curtailment, inverter-based resources, grid strength, Voltage, support

The research focuses on one of the most demanding charging environments in Türkiye: the Bolu-Elmalık region, the busiest charging location on the Anatolian Highway that connects Istanbul and Ankara, one of the country’s most heavily trafficked intercity corridors. Seventeen charging stations in the region were analyzed, and crucially, the study did not rely on simulated or synthetic data. Real-time consumption measurements were obtained directly from the local distribution system operator, Sakarya Elektrik Dağıtım A.Ş., known as SEDAS. This grounding in operational grid data gives the findings a credibility that laboratory-scale experiments often lack, because the irregular, spiky, and highly variable consumption patterns of highway charging stations are exactly the kind of signal that defeats naive forecasting approaches.

The context for this work is a market in the midst of a genuine boom. While Türkiye’s electric vehicle market initially lagged behind Europe’s, recent years have seen a dramatic acceleration, driven by regulations issued by the Electricity Market Regulatory Authority, a rapid increase in the number of charging operators and installed charging stations, and the arrival of electric vehicles priced comparably to conventional cars. The entry of domestically produced electric vehicles into the market has further accelerated adoption. As the authors note, this surge in vehicle numbers translates directly into rapidly rising energy demand, which in turn necessitates new investments in power grids and the development of flexible, accessible grid infrastructure. Forecasting is the foundation of that planning process.

At the heart of the study lies a two-level hybrid stacking ensemble model, an architecture that combines the strengths of several different learning algorithms rather than betting on any single one. In the first stage, three primary learners make independent predictions of hourly consumption: the Extra Trees Regressor, the LightGBM Regressor, and the XGBoost Regressor. All three belong to the family of tree-based ensemble methods, which build large collections of decision trees and aggregate their outputs, but they differ in how those trees are constructed and how aggressively they correct their own errors. Extra Trees introduces additional randomness in tree splitting to reduce variance, while LightGBM and XGBoost are gradient boosting methods that build trees sequentially, with each new tree trained to fix the residual mistakes of its predecessors.

The clever part of the stacking design is what happens next. Instead of simply averaging the three base learners’ outputs, the model feeds their predictions into a second-stage meta-learner built on Ridge Regression, a regularized form of linear regression. Ridge Regression, originally introduced by Hoerl and Kennard in 1970, adds a penalty term that shrinks coefficients and guards against overfitting, which is particularly valuable when the inputs to the meta-learner, the outputs of correlated tree models, are themselves highly interrelated. By letting a simple, stable linear model learn the optimal weighting of the three powerful but heterogeneous tree models, the stacking framework captures complex nonlinear patterns in the first stage while maintaining accuracy and stability in the final prediction. This division of labor is precisely what allowed the hybrid model to significantly outperform every individual base learner on its own.

Before any modeling began, the researchers confronted a problem that plagues many machine learning applications in energy systems: multicollinearity among input variables. When predictors are strongly correlated with one another, models can become unstable and their interpretations misleading. The team assessed this using Variance Inflation Factor analysis, a standard statistical diagnostic that quantifies how much the variance of an estimated coefficient is inflated by correlation among the predictors, allowing problematic variables to be identified and handled prior to model training. This preprocessing step reflects a broader lesson for applied machine learning: careful statistical hygiene before training often matters as much as the sophistication of the algorithm itself.

Interpretability received equally serious attention. The researchers applied SHAP analysis, short for SHapley Additive exPlanations, a technique rooted in cooperative game theory that assigns each input feature a contribution value for every individual prediction. Developed by Lundberg and Lee, SHAP has become the gold standard for explaining the behavior of complex ensemble models, and here it served two purposes: identifying the most influential attributes driving the consumption forecasts and pinpointing which of the seventeen stations exerted the greatest influence on model estimates. For grid operators, this kind of transparency is not a luxury. Understanding why a model predicts a demand surge, and which stations or temporal patterns drive it, transforms a black-box forecast into an actionable planning tool.

The performance numbers tell a compelling story. In addition to the R² of 0.979, the hybrid model achieved a mean absolute error of 69.906 kilowatt-hours and a root mean square error of 100.745 kilowatt-hours in hourly consumption forecasting. In practical terms, this means the model can track the hourly load profile of a busy highway charging hub with errors small enough to be genuinely useful for operational decisions. The authors emphasize that the approach aims to achieve high accuracy and stability in time-series consumption forecasting by combining the powerful learning capabilities of tree-based heterogeneous models under a regularized linear meta-model, a formulation that balances flexibility with robustness in a way single models struggle to match.

The implications extend well beyond one highway corridor in Türkiye. Accurate forecasting of load profiles and consumption patterns at electric vehicle charging stations enables improvements across a range of critical grid functions, including optimal grid planning, demand-side management, grid flexibility, load shifting, and peak shaving. Peak shaving, in particular, is a pressing concern: uncoordinated fast charging can create sharp demand spikes that force utilities to invest in expensive peaking capacity or risk overloading local transformers. A reliable hourly forecast allows operators to anticipate those spikes, shift flexible loads, deploy storage strategically, and defer costly infrastructure upgrades. As electric vehicle adoption accelerates globally, the gap between charging demand and grid capacity will widen in many regions, and tools like this stacking ensemble offer a way to manage that transition intelligently rather than reactively.

The study was carried out within the GARDEN project, short for Grid-Aware Decarbonization of Electricity-driven Neighbourhoods, and was supported by the Scientific and Technological Research Council of Türkiye under the 1071 Programme within the Driving Urban Transitions Partnership, co-funded by the European Commission. The authors gratefully acknowledge SEDAS for providing the charging data that made the analysis possible. While data privacy considerations mean the underlying dataset cannot be shared, the methodology itself, combining multicollinearity screening, heterogeneous tree-based base learners, a regularized meta-learner, and explainability analysis, offers a replicable blueprint for distribution system operators anywhere facing the same challenge. As the electric vehicle revolution rolls onward, the grids that power it will increasingly depend on models like this one to see the demand coming before it arrives.

Subject of Research: Hybrid machine learning forecasting of regional electric vehicle charging demand from real distribution grid data

Article Title: Regional EV charging demand estimation based on real grid data using a hybrid stacking ensemble model

Article References: Dursun, İ., & Erkara, A. (2026). Regional EV charging demand estimation based on real grid data using a hybrid stacking ensemble model. Cluster Computing, 29(13), Article 739. https://doi.org/10.1007/s10586-026-06533-8

Image Credits: AI Generated

DOI: 10.1007/s10586-026-06533-8

Keywords: EV charging demand forecasting, machine learning, stacking ensemble, XGBoost, LightGBM, Extra Trees, Ridge Regression, SHAP, power grid planning, electric vehicles, time-series forecasting, smart grids