The challenge that motivated the work is structural. Airspace is divided into sectors, and each sector’s complexity depends on two kinds of relationships that are difficult to model together. Spatially, sectors are connected both by simple geographical adjacency, meaning they share a border, and by dynamic traffic flows, since aircraft entering one sector typically exited another, creating dependencies that shift with the daily rhythm of departures and arrivals. Temporally, complexity evolves across multiple time scales at once: fast fluctuations driven by individual climbing and descending aircraft, medium-term waves tied to airport scheduling, and long-range dependencies that link morning traffic management decisions to afternoon congestion. Existing spatio-temporal prediction frameworks, including the graph neural networks that have dominated traffic forecasting in recent years, tend to rely on static graphs that freeze these relationships in place and on shallow temporal alignment that struggles to connect patterns separated by long gaps in time. The result is a systematic weakness precisely where forecasters need the most help: high-complexity situations and long prediction horizons.

MAST-LLM, which stands for a Multimodal Adaptive Spatio-Temporal framework enhanced by Large Language Models, addresses these weaknesses in three coordinated stages. The first stage is a temporal alignment phase built on a Mixture-of-Experts architecture. A Mixture-of-Experts model is a neural network design in which multiple specialized subnetworks, the experts, each process the input, and a gating mechanism learns to weight their contributions depending on the character of the data at hand. In MAST-LLM, this design lets the framework capture heterogeneous temporal patterns, so that the distinct rhythms of different air traffic variables can each be handled by appropriately specialized experts. Critically, this phase also aligns domain-specific air traffic sequences with the representations that a pre-trained language model has already learned. Rather than forcing raw aviation data into a model built for text, the framework translates traffic dynamics into a form that the language model’s internal representations can meaningfully encode, bridging the gap between two very different data worlds.

The second stage is a full spatio-temporal fine-tuning phase, in which the framework integrates adaptive multimodal spatial representations with multi-scale temporal features. The word multimodal here refers to the combination of different kinds of information about the airspace, such as structural spatial relationships and dynamic traffic measurements, into a shared representation that can adapt as conditions change rather than remaining fixed. The centerpiece of this stage is a mechanism the authors call Bidirectional Spatio-Temporal Attention, or BSTA. Attention mechanisms, first popularized by the transformer architecture underlying modern language models, allow a network to weigh the relevance of every element of its input against every other element. BSTA extends this idea so that spatial and temporal information interact in both directions: spatial structure informs how temporal patterns are interpreted, and temporal evolution informs how spatial relationships are weighted. This joint interaction modeling is what allows the framework to reason about the airspace as a single coupled system rather than as separate spatial and temporal problems stitched together.

The third stage exploits the property that makes large language models attractive for this task in the first place: their capacity for global reasoning and long-range dependency modeling. Language models are trained on sequences in which meaning can depend on context established thousands of tokens earlier, and their architectures are built to preserve and use that distant context. By establishing a unified representation that captures both local dynamics, the minute-to-minute behavior of individual sectors, and global contextual dependencies, the patterns that propagate across an entire region’s airspace over hours, MAST-LLM inherits this long-context strength. The authors argue that this is precisely what earlier frameworks lacked: a way for a prediction about one sector at one moment to draw on evidence from distant sectors and distant times within a single coherent computation.

The empirical results reported in the paper are striking. In extensive experiments, MAST-LLM achieved superior performance at short- and medium-term forecasting horizons and remained competitive at longer horizons, with improvements of up to 9.5 percentage points in accuracy and 12.9 percentage points in macro F1-score over the strongest baselines. The macro F1-score is a particularly meaningful metric here because it averages the F1-score, which balances precision and recall, across all complexity classes, ensuring that improvements on rare but dangerous high-complexity conditions count as much as improvements on routine ones. The authors supplemented the headline numbers with comprehensive ablation studies, which remove individual components to verify that each one contributes, along with factor importance analyses, sensitivity analyses, and visualization analyses that together confirm the effectiveness and robustness of every core element of the design. Statistical significance was assessed with paired two-sided t-tests against the strongest baseline, with exact p-values reported in the paper’s appendix.

The work builds on a substantial lineage of research into both airspace complexity and spatio-temporal machine learning. Measures of air traffic complexity stretch back decades, from early workload prediction studies by Chatterji and Sridhar to probabilistic complexity measures in three-dimensional airspace developed by Prandini and colleagues, and to spatiotemporal graph indicators proposed by Isufaj and collaborators. On the machine learning side, the framework draws on the spatio-temporal graph convolutional networks introduced by Yu, Yin, and Zhu in 2018 and the diffusion convolutional recurrent networks of Li and colleagues from the same year, as well as more recent attention-based architectures such as GMAN and PDFormer. Notably, the same research group had previously developed MAST-GNN, a multimodal adaptive spatio-temporal graph neural network for the same prediction task, and MAST-LLM can be seen as an evolution of that line of work, replacing static graph reasoning with the adaptive, language-model-driven approach.

The study also sits within a rapidly growing movement to apply large language models to time-series and traffic problems. Recent research has shown that pre-trained language models can be reprogrammed for general time-series analysis, as in the One Fits All work of Zhou and colleagues, and for dedicated forecasting frameworks such as Time-LLM by Jin and colleagues and LLM4TS by Chang and colleagues. Parallel efforts have applied these ideas to wind power and wind speed forecasting with BERT4ST, STELLM, and STCA-LLM, to spatio-temporal imputation with GATGPT, and to urban traffic prediction with ST-LLM plus. A 2026 survey by Long and colleagues in IEEE Transactions on Big Data catalogues the accelerating adoption of language models across traffic forecasting applications. MAST-LLM distinguishes itself within this crowded field by combining the Mixture-of-Experts alignment strategy with bidirectional spatio-temporal attention, a pairing the authors present as tailored to the specific structure of airspace dynamics rather than borrowed wholesale from other domains.

The practical implications could be considerable. Accurate complexity forecasts feed directly into demand-capacity balancing, the process by which air navigation service providers decide how much traffic each sector can safely absorb and where flow restrictions should be imposed. Better predictions, especially at medium and long horizons, give managers more lead time to reroute flights, adjust sector configurations, and staff control positions appropriately, potentially reducing both delays and controller overload. The authors have made the airspace complexity dataset used in the study publicly available through a project repository, lowering the barrier for other groups to build on the approach. The research was supported by funders including the National Natural Science Foundation of China and the Ministry of Education of China, and the authors note that generative AI tools were used to assist with language refinement of the manuscript, with all content reviewed and verified by the team.

For the field of air traffic management, the study offers a proof of concept that the reasoning machinery of large language models, originally built for human language, can be redirected toward the physical dynamics of the sky. For the broader machine learning community, it adds to mounting evidence that pre-trained language models serve as powerful general-purpose sequence models whose learned representations transfer far beyond text. Whether such frameworks can be deployed in the safety-critical, certification-heavy environment of real air traffic control remains an open question, and the authors’ results, while strong, come from benchmark evaluation rather than live operations. Still, as global air traffic continues to grow toward and beyond pre-pandemic levels, tools that can anticipate when a sector is about to become unmanageable, minutes or hours in advance, address one of the most consequential prediction problems in transportation, and MAST-LLM demonstrates that the newest generation of AI models may be up to the task.

Subject of Research: Large language model-driven multimodal spatio-temporal prediction of air traffic complexity

Article Title: MAST-LLM: A large language model-driven multimodal adaptive spatio-temporal framework for air traffic complexity prediction

Article References: Cheng, R., Fan, J., Zhang, C., Wu, M., Chen, R., Chai, M., & Wang, A. (2026). MAST-LLM: A large language model-driven multimodal adaptive spatio-temporal framework for air traffic complexity prediction. Applied Intelligence, 56(15), Article 442. https://doi.org/10.1007/s10489-026-07469-7

Image Credits: AI Generated

DOI: 10.1007/s10489-026-07469-7

Keywords: air traffic complexity, large language models, spatio-temporal prediction, mixture of experts, attention mechanism, graph neural networks, air traffic management, time series forecasting, Applied Intelligence, machine learning, airspace sectors, macro F1-score