The motivation behind the work stems from a well-known blind spot in classical forecasting. Autoregressive models such as ARIMA and vector autoregression excel at capturing short-term statistical structure in price series, but they treat the market as a closed system. They cannot ingest exogenous information flows such as breaking news, earnings guidance, or macroeconomic events, and they ignore cross-asset structure like sectoral co-movements. When regimes shift, patterns learned from past prices can be invalidated overnight by information that never enters the model. Deep learning models, including long short-term memory networks, improve on this by handling multivariate, nonlinear data, yet most published approaches still analyze a single data source or modality, limiting their effectiveness in highly volatile conditions.

The new architecture addresses these gaps with three parallel branches. The first is a long short-term memory network, a type of recurrent neural network that uses gated memory cells to carry information across many time steps without the vanishing gradient problems that plague conventional recurrent networks. The LSTM branch processes multivariate sequences of stock prices and technical indicators, including exponential moving averages, the moving average convergence/divergence signal, parabolic SAR, Bollinger bands, and stochastic oscillators, all normalized before training. Its job is to extract the temporal fingerprints of each stock’s behavior over recent days.

The second branch is a graph convolutional network, and this is where the model departs most sharply from prior work. Markets are systems of interacting assets: stocks move together in time-varying clusters, and information often diffuses across related companies. Rather than fixing these relationships in advance, as many graph-based approaches do with static industry hierarchies or long-window correlations, the researchers compute a Pearson correlation matrix over the most recent closing-price sequences for all seventeen stocks, add self-loops, and apply symmetric degree normalization. This dynamic adjacency matrix is rebuilt every prediction day, so the graph topology evolves with the market. When correlations strengthen, decay, or invert around a shock, the network’s message passing reflects the new reality rather than a stale snapshot. Each stock node is summarized by seven statistics of its recent series: mean, trimmed mean, standard deviation, trimmed standard deviation, skewness, kurtosis, and trend slope.

The third branch handles language. General-purpose language models often struggle with the specialized terminology and scarcity of labeled data in finance, so the team uses FinBERT, a BERT variant pretrained on the Reuters TRC2-financial corpus of roughly 46,000 documents and fine-tuned on the Financial PhraseBank, a set of 4,845 sentences annotated by finance professionals. FinBERT has been reported to outperform even GPT-4 on financial sentiment benchmarks. For each stock and each day, the model scores every news headline as positive, neutral, or negative, sums the positive and negative scores to determine the day’s overall tone, and then extracts the embedding of the single most representative headline. A separately fine-tuned FinBERT head also produces an uptrend or downtrend signal from the news corpus itself.

Fusion is where the three modalities meet. The embeddings produced by the GCN, LSTM, and FinBERT branches are concatenated and passed through dense layers that refine the joint representation, and a final sigmoid neuron outputs the probability that a given stock will rise the next day. The researchers emphasize that this is more than late concatenation of independent encoders: because the graph branch conditions each asset on its peers, the fused representation is simultaneously context-aware through text and structure-aware through dynamic graphs, while the sequence branch retains sensitivity to temporal dependencies. An ablation study confirmed that removing either the GCN or the FinBERT component degrades performance, with the full model achieving the best average portfolio gains in thirteen of seventeen uptrend cases and ten of seventeen downtrend cases.

The experimental design is unusually demanding. The team evaluated seventeen stocks across five sectors, from technology giants like Apple and NVIDIA to healthcare and real estate firms, over two contrasting periods: an uptrend from July to December 2021 and a severe downtrend from January to September 2022, a stretch the authors note ranks among the worst markets since the 2008 financial crisis. Models were retrained daily in a sliding-window fashion, predicting one day ahead. Against baselines including ARIMA, gradient boosted trees, plain LSTMs, bidirectional LSTMs, and several convolutional sequence-to-sequence architectures, the proposed model delivered competitive F1-scores, leading on stocks such as IBM, NVIDIA, Prologis, and American Tower in at least one market phase. Gradient boosted trees often posted the highest F1-scores, but with an important caveat: they could train on price data reaching back to 2010, while the multimodal model was constrained to the period from 2021 onward, when aligned news data became available.

The most compelling findings emerged from portfolio simulations, where each model’s daily predictions triggered simulated buy and sell decisions starting from ten thousand dollars. Here a disconnect appeared between classification metrics and actual profitability. On Adobe, the proposed model scored lower on F1 than ARIMA and LSTM, yet it delivered average gains of 1.9 percent while ARIMA lost 9.14 percent and LSTM lost 1.62 percent. The authors explain that binary metrics weight every day equally, whereas a model that correctly calls trends on days with large price swings captures genuinely profitable opportunities. Across the full multi-stock swing trading strategy, the proposed model averaged a 7.64 percent gain in the uptrend and a mere 0.34 percent loss in the downtrend, compared with a catastrophic 40.3 percent loss for buy-and-hold and double-digit losses for most baselines. On Apple, it achieved average gains of 24.23 percent in the uptrend and 3.96 percent even in the downtrend, and on Google during the downturn it was the only model to finish positive.

Transparency was a deliberate design goal. The system includes an explainability layer that produces gradient-based feature importance scores for the LSTM branch, time-window relevance plots, correlation heatmaps revealing which stocks most influenced a prediction, and daily sentiment histograms highlighting the most influential news item. These visualizations give analysts a window into why the model expects a rise or fall, rather than presenting an opaque signal. Computationally, the approach is practical: a full cold-start training run of five hundred epochs takes about an hour and a half on a consumer-grade GPU, and daily fine-tuning, with the FinBERT encoder frozen, fits comfortably within a nightly batch window.

The authors are candid about limitations. The model depends on timely and clean news coverage, cannot yet support intraday latency, and its reliance on aligned multimodal data restricts how far back training history can extend. Future work will explore additional modalities, including earnings call transcripts, press releases, and options-implied volatility features such as the term structure of implied volatility and skew, which could provide early warning of regime shifts and crash risk. For now, the study offers a persuasive demonstration that markets cannot be understood through prices alone: the words investors read and the invisible threads connecting companies carry real predictive signal, and a model that listens to all of them at once, while continuously updating its map of who moves whom, may be better prepared for the next storm than anything watching a single chart.

Subject of Research: Multimodal deep learning combining graph convolutional networks, LSTM, and financial language models for stock market trend prediction

Article Title: GCN-FinBERT-LSTM: a graph convolutional deep fusion model for multimodal stock market prediction

Article References: Chen, P., & Corizzo, R. (2026). GCN-FinBERT-LSTM: a graph convolutional deep fusion model for multimodal stock market prediction. International Journal of Data Science and Analytics, 22(1), Article 334. https://doi.org/10.1007/s41060-026-01301-8

Image Credits: AI Generated

DOI: 10.1007/s41060-026-01301-8

Keywords: deep learning, stock market prediction, graph convolutional networks, FinBERT, LSTM, multimodal fusion, sentiment analysis, time series forecasting, financial news, portfolio simulation, dynamic graphs, technical indicators