Seeing soccer strategy: GAF images and convolutional LSTM predict match tactics

In a development that sits at the unlikely intersection of computer vision, sports analytics and deep learning, researchers have shown that the tactical story of a soccer match can be transformed into something that looks like abstract art and then read by an artificial intelligence with remarkable predictive power. Saif Ur Rehman Khan of the German Research Center for Artificial Intelligence (DFKI), Sajib Mistry of Curtin University in Australia, and Novarun Deb of the University of Calgary in Canada have developed a machine learning pipeline that converts raw match event data into images using a mathematical technique known as the Gramian Angular Field, and then feeds those images into a convolutional long short-term memory network to classify a team’s strategy as being on a winning or losing trajectory. The work, published in Neural Computing and Applications, reports that the system correctly forecast game outcomes for the Italian giants Juventus in 83 percent of cases and for AC Milan in 67 percent of cases, and that meaningful predictions can be made as early as the sixtieth minute of a match.

The central insight behind the study is a conceptual translation rather than a new algorithm in isolation. Traditional models of soccer performance treat match data as a multivariate time series, a stream of numbers representing passes, shots, fouls, positions and other events unfolding minute by minute. Convolutional neural networks, the engines behind most modern image recognition breakthroughs, are extraordinarily good at extracting spatial patterns from images but cannot directly consume such numerical streams. The researchers sidestepped this mismatch by encoding the multivariate time series into a two-dimensional visual representation. In a Gramian Angular Field transformation, each data point in the series is rescaled and converted into an angle, and then every possible pair of points is combined through trigonometric operations to fill a matrix whose rows and columns correspond to time. The result is a symmetric, texture-rich image in which the passage of the match is expressed as pictorial structure. Periods of tactical coherence appear as smooth, regular patterns, while chaotic stretches of play manifest as turbulent, high-frequency textures. In effect, the model sees the match.

The data underlying the experiment comes from the 2018 event stream dataset of the Italian League, a public collection of spatio-temporal match events that has become a benchmark resource for computational soccer research. Every touch, pass, duel, shot and foul is recorded with a timestamp and a location on the pitch, producing a dense multivariate signal for each team in each game. Rather than predicting isolated outcomes such as win or loss from static summary statistics, the authors’ model learns to read the evolving shape of a team’s play and classify whether the strategy being executed at a given moment is trending toward victory or defeat. This framing is important because it reframes prediction as a form of live strategy assessment, closer to what a coaching staff might want from an analytics dashboard than to the pre-match forecasting offered by bookmakers and traditional statistical models.

The architecture doing the reading is a convolutional long short-term memory network, or ConvLSTM, a hybrid design that first appeared in the atmospheric sciences, where it was used to forecast precipitation by treating radar maps as a sequence of images. ConvLSTM combines two powerful ideas. The convolutional component applies learned filters across the image grid, detecting local visual motifs much like the filters in any image classification network. The LSTM component, a form of recurrent neural network equipped with memory gates that regulate what information is retained and what is discarded, processes the sequence of these images over time, capturing how the visual signature of a team’s play evolves from the first whistle to the last. The gates of an LSTM allow the network to maintain information across long time horizons while mitigating the vanishing gradient problems that plague simple recurrent architectures, which makes the model well suited to a sport in which tactical patterns can build gradually over an hour of play before culminating in a decisive moment.

In training and evaluation, the model ingested GAF-transformed representations of each match as a temporal sequence of images and learned to associate particular visual trajectories with winning or losing outcomes. The results varied with the strength and stylistic consistency of the teams studied. For Juventus, the club that dominated Italian soccer in the late 2010s, the model achieved an accuracy of 83 percent, suggesting that the Turin side’s tactical identity left a distinctive and learnable imprint on the transformed images. For AC Milan, the accuracy of 67 percent, while well above chance, hints that the model’s power depends on how reproducible a team’s winning patterns are. The difference itself is scientifically informative, because it indicates that the visual fingerprints of strategy are not universal abstractions but club-specific signatures that the network must learn for each side.

Perhaps the most practically significant finding is the temporal one. The authors report that the system can deliver reliable predictions from the sixtieth minute onward, meaning that roughly two-thirds of the way through a match, the visual signature of a team’s play already encodes enough information to forecast the outcome with substantial confidence. In a professional context, this opens the door to genuinely real-time decision support. A tactical analyst watching a live feed could, in principle, receive an assessment from the model indicating whether the current strategy is trending toward success or failure, and a coaching staff could respond with substitutions or formation changes while there is still time for those interventions to matter. This moves sports analytics from retrospective performance review into the realm of in-game intelligence, a shift that could reshape how technical areas operate.

The methodology also has implications beyond the touchline. The Gramian Angular Field encoding is a general-purpose technique for converting any multivariate time series into an image, and the authors position their work within a growing literature that exploits this trick across domains, from finance to hydrology to medical signal analysis. By demonstrating that the approach works on the noisy, adversarial, high-dimensional environment of professional soccer, the study strengthens the case that image-based representations of time series can capture dynamics that conventional feature engineering misses. Soccer is a particularly demanding testbed: the data is irregular, the underlying strategies are hidden from direct observation, and the outcome depends on interactions between two adaptive opponents, each of which is trying to suppress the other’s patterns.

The study builds on a body of research that has steadily advanced computational soccer analysis. Earlier work has applied network science to passing structures, measured spatial and temporal entropy in league-wide event data, and used neural networks to predict match winners from more conventional feature sets. Reviews of machine learning in soccer have documented a rapid expansion of techniques, and dedicated models such as recurrent architectures trained on event streams have produced competitive results. What distinguishes the new work is the specific marriage of image transformation with sequential deep learning. Where prior approaches either flattened time into static features or processed raw sequences without spatial structure, the GAF-plus-ConvLSTM combination preserves both the spatial texture of multivariate events and the temporal ordering of the match, giving the network access to a richer representation than either dimension alone could provide.

The authors are transparent about the collaborative nature of the project, acknowledging that the majority of the experiments were carried out by two undergraduate students, Darsh Patel and Het Patel, during a summer internship under the supervision of Dr. Novarun Deb at IIIT Vadodara in India. The research received no dedicated funding, and the authors declare no competing financial interests. Data from the study will be made available on request, a policy that should facilitate replication and extension by other groups interested in visual representations of sports data. The interdisciplinary authorship, spanning artificial intelligence research in Germany, electrical and software engineering in Canada, and computing in Australia, reflects the increasingly international character of sports analytics as a research field.

Whether this technology finds its way into actual dugouts remains to be seen, and the study is candid that its predictions arrive late enough in a match that their value for live intervention, while real, is bounded by the sixty-minute threshold. There are also broader questions about generalization: a model trained on one league and two flagship clubs may need substantial retraining to read the tactical dialects of other teams and competitions, and the inherent unpredictability of soccer sets a ceiling on what any model can achieve. Still, the core demonstration stands. A soccer match, expressed as a sequence of Gramian Angular Field images and read by a convolutional LSTM, is not merely noise; it is a legible document, and machines are learning to read it. As clubs continue to invest heavily in data science departments, techniques like this one, which turn the chaotic flow of play into analyzable structure, are likely to move from academic papers to training-ground software, changing how the world’s most popular sport is understood, coached and, ultimately, played.