Explainable AI helps deep learning predict cloud server loads in real time

Every second of every day, the world’s data centers make split-second decisions about where to place workloads, when to spin up new virtual machines, and how to keep energy bills from spiraling out of control. Behind those decisions sits a deceptively simple question: how much load will each host carry in the next few minutes? A new study published in Cluster Computing by Shabnam Bawa, RajKumar Tekchandani, and Prashant Singh Rana of the Thapar Institute of Engineering and Technology in Patiala, India, tackles that question with a deep temporal forecasting framework that is not only accurate but also willing to explain itself. The work, published on 27 September 2026, reports a predictive performance of approximately 91 percent and the lowest average absolute percentage error among the state-of-the-art models the authors compared against.

The motivation is straightforward economics and engineering. In cloud computing, host-level load prediction is described by the authors as indispensable for optimizing resource utilization, balancing load across machines, and minimizing energy consumption. Overprovision a data center and you waste electricity on idle servers; underprovision it and applications stall, latency climbs, and service-level agreements are violated. Yet forecasting host load is notoriously difficult because of two persistent obstacles the paper identifies: inefficiency in feature extraction and the sheer variability of workloads. Traffic on a cloud host is a chaotic mixture of scheduled jobs, bursty user requests, and background processes, and the signals that actually drive future load are buried inside that noise.

What distinguishes this study from many earlier forecasting efforts is its embrace of explainable artificial intelligence, or XAI. Deep learning models are famously opaque: they can produce a number, but they rarely tell an operator why. The researchers incorporated explainability techniques, most prominently SHAP, which stands for SHapley Additive exPlanations, into their framework. SHAP, originally introduced by Scott Lundberg and Su-In Lee in 2017, borrows from cooperative game theory and assigns each input feature a contribution value for a given prediction, distributing credit among features in a mathematically consistent way. In this work, the authors report that SHAP outperformed other explainability approaches due to its consistent and transparent evaluations, and they used it for systematic feature importance analysis across their forecasting models.

A second pillar of the study is its dataset. Rather than relying on synthetic traces or borrowed benchmarks, the team generated a real time-series dataset by running multiple applications in the form of containers on virtual machines. This is a meaningful design choice. Containers have become the dominant packaging unit for modern cloud applications, and their resource footprints differ from those of monolithic virtual machines. By instrumenting a live environment in which containerized applications competed for host resources, the researchers captured load dynamics that more closely resemble production conditions. The dataset has been made publicly available on GitHub, which the authors state was generated by them, giving other researchers a chance to reproduce and extend the results.

On the modeling side, the proposed deep temporal framework was benchmarked against a formidable lineup of deep learning architectures that are widely used for time-series forecasting. The comparison set included CNN-LSTM hybrids, which combine convolutional feature extraction with recurrent sequence modeling; GRU networks, a streamlined variant of the recurrent family; temporal convolutional networks, known as TCNs, which use dilated causal convolutions to capture long-range temporal dependencies; sequence-to-sequence models; autoencoders; and graph neural networks, or GNNs. Each of these architectures brings a different inductive bias to the forecasting problem, and the breadth of the comparison matters because no single architecture dominates every workload regime.

Evaluation was carried out with a standard battery of regression metrics: accuracy, mean absolute percentage error, abbreviated as MAPE, root mean square error, or RMSE, and mean square error, or MSE. These metrics probe different aspects of forecast quality. MAPE expresses error as a percentage of the true value, making it easy to interpret operationally, while RMSE and MSE penalize large misses more heavily, which is critical in cloud management where a single badly underestimated load spike can trigger throttling or outages. Across this suite, the proposed model achieved the lowest average absolute percentage error and reached roughly 91 percent predictive performance, which the authors describe as a higher level of accuracy in workload prediction compared to current cutting-edge models.

The technical significance of combining deep temporal modeling with SHAP-based explanation goes beyond leaderboard numbers. When a forecasting model reveals which features drive its predictions, operators gain actionable insight into what actually causes load on their hosts. If, for example, the explanation analysis consistently highlights certain resource counters or temporal patterns as dominant, capacity planners can prioritize monitoring those signals and design scheduling policies around them. Explainability also builds trust: cloud providers are understandably reluctant to let a black-box model automatically trigger migrations or shutdowns, but a model whose reasoning can be audited is far easier to certify for operational use. The authors’ finding that SHAP delivered consistent and transparent evaluations suggests it can serve as a reliable interpretability layer in such pipelines.

The study situates itself within a rapidly growing literature on cloud workload prediction. Prior work has explored artificial neural networks tuned with adaptive differential evolution, auto-adaptive learning for dynamic cloud environments, CNN-LSTM models for resource utilization forecasting, and uncertainty-aware predictions with transfer learning. Recent years have also seen transformer-based and attention-driven architectures migrate from natural language processing into time-series domains ranging from financial markets to wildfire spread. The new framework’s contribution is to pull two threads together that had largely run in parallel: high-performing deep temporal forecasting and post-hoc explainability, delivered in a real-time, cloud-native setting with a container-based dataset.

The energy angle deserves particular emphasis. Data centers are among the fastest-growing consumers of electricity worldwide, and the referenced literature in the paper explicitly connects information and communications technologies to sustainable development goals. Accurate short-term load forecasting is one of the levers available for greener computing: if a scheduler can anticipate which hosts will be underutilized, it can consolidate workloads and power down idle machines before they burn energy doing nothing. A forecasting framework that reaches about 91 percent predictive performance with a low percentage error could therefore translate directly into measurable energy savings, provided the predictions are fast enough to act on, which is precisely the real-time capability the framework is designed to deliver.

Limitations and open questions remain, as with any study. The dataset, while generated from real containerized applications, comes from the authors’ own experimental environment, and generalization to hyperscale production clusters with radically different workload mixes will need further validation. The authors note there was no external funding for the study and declare no conflict of interest, and all three researchers contributed equally, with Bawa handling conceptualization, methodology, programming, formal analysis, and the original draft. Still, the combination of a publicly available real-world dataset, a rigorous multi-architecture comparison, and a transparent explanation layer marks this as a notable step toward cloud platforms that can not only predict their own future load but also show their work. As operators and regulators increasingly demand accountability from automated systems, forecasting models that can explain their reasoning may prove to be the ones that actually get deployed.

Subject of Research: Explainable deep learning for real-time cloud host load forecasting

Article Title: An explainable deep temporal framework for cloud-based real-time load forecasting

Article References: An explainable deep temporal framework for cloud-based real-time load forecasting. (n.d.). https://doi.org/10.1007/s10586-026-06599-4

Image Credits: AI Generated

DOI: 10.1007/s10586-026-06599-4

Keywords: cloud computing, load forecasting, deep learning, explainable AI, SHAP, time series, containers, virtual machines, CNN-LSTM, GRU, temporal convolutional network, energy efficiency