<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>multivariate time series forecasting &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/multivariate-time-series-forecasting/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Tue, 22 Sep 2026 16:56:35 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.1</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>multivariate time series forecasting &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>New AI Model Learns Hidden Time Delays Between Variables to Sharpen Time Series Forecasts</title>
		<link>https://scienmag.com/new-ai-model-learns-hidden-time-delays-between-variables-to-sharpen-time-series-forecasts/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Tue, 22 Sep 2026 16:56:35 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[capturing variable lead-lag relationships]]></category>
		<category><![CDATA[deep learning]]></category>
		<category><![CDATA[delay-aware machine learning models]]></category>
		<category><![CDATA[DTLGSL]]></category>
		<category><![CDATA[dynamic graph learning]]></category>
		<category><![CDATA[dynamic time delays in variables]]></category>
		<category><![CDATA[energy consumption forecasting]]></category>
		<category><![CDATA[energy demand forecasting]]></category>
		<category><![CDATA[Graph Neural Networks]]></category>
		<category><![CDATA[graph neural networks for forecasting]]></category>
		<category><![CDATA[graph structure learning]]></category>
		<category><![CDATA[hospital vital signs analysis]]></category>
		<category><![CDATA[improved weather and traffic prediction]]></category>
		<category><![CDATA[innovative AI models for time series]]></category>
		<category><![CDATA[International Journal of Machine Learning and Cybernetics]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[multivariate time series data]]></category>
		<category><![CDATA[multivariate time series forecasting]]></category>
		<category><![CDATA[spatio-temporal modeling]]></category>
		<category><![CDATA[time series prediction]]></category>
		<category><![CDATA[time-lagged correlations]]></category>
		<category><![CDATA[time-lagged relation graph learning]]></category>
		<category><![CDATA[time-series forecasting]]></category>
		<category><![CDATA[traffic forecasting]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=206951</guid>

					<description><![CDATA[Researchers have developed a graph neural network model that learns dynamic time delays between variables in multivariate time series, improving forecasting accuracy across applications from traffic to energy.]]></description>
										<content:encoded><![CDATA[<p>Every second, the world produces torrents of multivariate time series data: traffic sensors counting vehicles across a city, electricity meters tracking the pulse of power grids, weather stations logging temperature and pressure, and hospital monitors streaming patient vital signs. Forecasting what comes next in such data is one of the most consequential challenges in modern machine learning, and a new study published in the International Journal of Machine Learning and Cybernetics offers a fresh and surprisingly intuitive insight into how to do it better. The key, according to researchers Xing Feng, Hongru Li, Shuang Wen, and Tianwei Yang of Northeastern University in Shenyang, China, lies in something most existing models overlook: the fact that relationships between variables in a time series are not only dynamic, but also delayed in time. One variable may lead another by minutes, hours, or days, and capturing that lag can make the difference between a mediocre forecast and a remarkably accurate one.</p>
<p>The research team introduced a model called Dynamic Time-Lagged Relation Graph Structure Learning, abbreviated DTLGSL, which addresses a persistent blind spot in the rapidly growing field of graph-based forecasting. Over the past several years, Graph Neural Networks, or GNNs, have become a dominant tool for multivariate time series prediction. The idea is elegant: represent each variable in the series as a node in a graph, and encode the correlations between variables as edges. Once the relationships are laid out as a network, message-passing algorithms can propagate information across the graph, allowing the model to exploit the fact that, say, traffic congestion at one intersection influences congestion at neighboring intersections. But the authors argue that this framework, powerful as it is, has been built on a simplifying assumption that does not hold in the real world.</p>
<p>That assumption is that relationships between variables are either instantaneous or fixed in time. In reality, the researchers note, variables in multivariate time series exhibit dynamic lagged correlations. A change in one sensor reading may only manifest in another sensor several time steps later, and crucially, that delay is not constant. It can shift as conditions evolve: a traffic bottleneck may propagate downstream faster during off-peak hours than during rush hour, or an upstream change in atmospheric pressure may influence temperature with a delay that varies by season. Existing studies, the authors point out, either ignore these time-delay relationships altogether or treat them as static, freezing the lag structure into a single fixed graph. Both approaches discard information that could be genuinely predictive, and both can actively mislead a model when the true lag structure drifts over time.</p>
<p>The DTLGSL model tackles the problem head-on by learning the lag structure itself as part of the forecasting task. The core mechanism works by identifying, for each pair of variables, the time offset that maximizes their correlation. In other words, rather than assuming two variables move together simultaneously, the model scans across possible delays and asks: at what lag do these two signals align most strongly? That optimal offset is taken as the lag time between the pair, and these learned lag times are then used to construct a dynamic time-lagged relation graph, a network whose edges encode not just that two variables are related, but how far apart in time their influence travels. This is a meaningful departure from conventional graph construction, where an edge typically represents a symmetric, contemporaneous similarity between two series.</p>
<p>What makes the approach particularly flexible is that the learned graph structure is not a one-time artifact. It is embedded directly within the prediction framework and continuously updated during training, so the model can refine its understanding of which variables lead and which follow as it sees more data. The design also combines two complementary sources of information: the intrinsic structural information of the data, meaning the stable underlying relationships among variables, and the dynamic input information, meaning the moment-to-moment fluctuations in the incoming series. By fusing these, the model can adapt its representation of variable relationships to both the enduring architecture of the system and its current state. The practical payoff, the authors explain, is that DTLGSL can accurately extract guiding information from leading variables. If one series reliably foreshadows another, the model learns to use the leader&#8217;s recent behavior as a signal for the follower&#8217;s future, which translates directly into sharper forecasts.</p>
<p>The intellectual roots of this idea stretch back further than deep learning. The study cites classic work on windowed cross-correlation and peak picking for analyzing variability in behavioral time series, as well as analyses of detrended time-lagged cross-correlation between nonstationary signals, techniques developed in psychology and physics long before neural networks dominated the field. There is also a clear lineage to vector autoregressive models, the statistical workhorses that have long acknowledged that variables can influence each other across time lags. What the new research contributes is a way to fold this lag-aware thinking into the modern graph neural network paradigm, and to do so dynamically rather than statically. The authors also build on their own earlier work, a time-lagged relation graph neural network published in Engineering Applications of Artificial Intelligence, extending it from a static lag representation to one that evolves with the data.</p>
<p>The experimental results reported in the paper support the central claim. In comparative prediction tasks, DTLGSL achieved better prediction results than existing methods, and the authors found that explicitly taking dynamic time-delay relationships into account leads to better prediction performance than ignoring them. The study situates itself against a crowded field of recent competitors, including dynamic spatio-temporal graph networks with adaptive propagation, dynamic hypergraph structure learning, evolving graph structure learning, adaptive graph structure learning with neural rough differential equations, and dynamic graph structure correction with nonadjacent correlations. Each of these methods has pushed forward the idea that the graph in a GNN should not be hand-crafted or frozen, but learned from data. DTLGSL&#8217;s distinguishing contribution is the explicit modeling of time offsets within that learned structure, an axis of variation that the authors argue has been underexplored even as graph learning itself has flourished.</p>
<p>The potential applications span a remarkable range of domains. The cited literature alone points to deep learning methods for network traffic prediction, probabilistic forecasting of renewable energy and electricity demand using graph-based denoising diffusion models, multi-granularity spatiotemporal fusion transformers for air quality prediction, and edge-cloud-assisted frameworks for multi-disease prediction from multivariate clinical data. In each of these settings, leading-lag relationships are not a curiosity but the essence of the problem: upstream traffic sensors foreshadow downstream congestion, wind farm output patterns precede grid load shifts, and early physiological changes can herald clinical deterioration. A forecasting framework that learns when, not just whether, variables influence each other could improve the lead time and reliability of predictions in all of these areas, with tangible consequences for infrastructure planning, energy management, environmental monitoring, and patient care.</p>
<p>The technical machinery behind DTLGSL draws on a broad toolkit of modern sequence modeling. The paper&#8217;s references span gated recurrent units and their gate variants, temporal pattern attention for multivariate forecasting, long-sequence transformers such as Informer and Autoformer, the PatchTST approach that treats a time series as a sequence of words, the inverted iTransformer architecture, and TimesNet&#8217;s temporal 2D-variation modeling. It also engages with foundational graph techniques, from spatio-temporal graph convolutional networks for traffic forecasting and Graph WaveNet&#8217;s deep spatial-temporal modeling to adaptive graph convolutional recurrent networks, diffusion convolutional recurrent networks, and graph sparsification with graph convolutional networks. By anchoring its contribution within this ecosystem, the study positions lag-aware graph learning as a natural next step in a broader trajectory: models that increasingly discover the structure of the systems they forecast rather than having it prescribed in advance.</p>
<p>The work, supported by the National Natural Science Foundation of China under grant 62473093, arrives at a moment when the appetite for accurate multivariate forecasting has never been greater, and when the field is actively questioning the assumptions baked into its most popular architectures. The message of DTLGSL is deceptively simple: the timing of relationships matters, it changes, and it can be learned. For a discipline that has invested heavily in modeling how strongly variables are connected, the reminder that connections also have temporal texture, that influence travels across gaps of time that themselves shift with conditions, may prove to be one of those ideas that seems obvious in retrospect and transformative in practice. As graph-based forecasting continues to mature, models that capture the full temporal geometry of variable relationships, including their delays and their dynamics, are likely to define the next generation of predictive systems.</p>
<p><strong>Subject of Research:</strong> Dynamic time-lagged relation graph structure learning for multivariate time series forecasting</p>
<p><strong>Article Title:</strong> Dynamic time-lagged relation graph structure learning for multivariate time series forecasting</p>
<p><strong>Article References:</strong> Dynamic time-lagged relation graph structure learning for multivariate time series forecasting. (n.d.). <a href="https://doi.org/10.1007/s13042-026-03297-w" rel="noopener noreferrer">https://doi.org/10.1007/s13042-026-03297-w</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s13042-026-03297-w" rel="noopener noreferrer">10.1007/s13042-026-03297-w</a></p>
<p><strong>Keywords:</strong> multivariate time series forecasting, graph neural networks, dynamic graph learning, time-lagged correlations, time series prediction, graph structure learning, deep learning, spatio-temporal modeling, traffic forecasting, energy demand forecasting, machine learning, DTLGSL</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">206951</post-id>	</item>
		<item>
		<title>AI Model Sharpens Stock Forecasts With Convolutional Boost and Differential Attention</title>
		<link>https://scienmag.com/ai-model-sharpens-stock-forecasts-with-convolutional-boost-and-differential-attention/</link>
		
		<dc:creator><![CDATA[Denise Maddox]]></dc:creator>
		<pubDate>Sun, 13 Sep 2026 00:06:57 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[attention mechanisms]]></category>
		<category><![CDATA[auxiliary variable filtering in stock analysis]]></category>
		<category><![CDATA[Chinese A-share stocks]]></category>
		<category><![CDATA[Chinese and U.S. stock market prediction]]></category>
		<category><![CDATA[closing price prediction]]></category>
		<category><![CDATA[convolutional neural networks for stock prediction]]></category>
		<category><![CDATA[deep learning]]></category>
		<category><![CDATA[deep learning in finance]]></category>
		<category><![CDATA[differential attention]]></category>
		<category><![CDATA[differential attention mechanisms]]></category>
		<category><![CDATA[enhanced accuracy in stock price forecasting]]></category>
		<category><![CDATA[hybrid AI architectures for finance]]></category>
		<category><![CDATA[local price dynamics modeling]]></category>
		<category><![CDATA[multivariate time series]]></category>
		<category><![CDATA[multivariate time series forecasting]]></category>
		<category><![CDATA[noise reduction in stock market data]]></category>
		<category><![CDATA[Panzhihua University]]></category>
		<category><![CDATA[stock market forecasting]]></category>
		<category><![CDATA[temporal convolutional network]]></category>
		<category><![CDATA[TimeXer]]></category>
		<category><![CDATA[transformer models]]></category>
		<category><![CDATA[transformer-based financial models]]></category>
		<category><![CDATA[U.S.-listed stocks]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=199848</guid>

					<description><![CDATA[Researchers have enhanced the TimeXer forecasting model with a temporal convolutional network and differential attention, achieving lower stock prediction errors across Chinese and U.S. equities.]]></description>
										<content:encoded><![CDATA[<p>Financial markets are among the most unforgiving proving grounds for artificial intelligence. Prices move in patterns that are partly rhythmic and partly chaotic, and the auxiliary signals that seem to explain them—trading volumes, sector indices, macroeconomic indicators—can be just as noisy as the target series itself. A new study published in Complex &amp; Intelligent Systems tackles this dual challenge head-on, presenting an upgraded architecture called DAT-TimeXer that refines how deep learning models capture fleeting local price dynamics while filtering out unreliable relationships among market variables. The work, led by Sixing Liu, Quanxiang Lan, Jing Zhang, and Wei Feng of Panzhihua University in Sichuan, China, demonstrates measurable gains in forecasting closing prices across both Chinese A-share equities and U.S.-listed stocks.</p>
<p>The starting point for the research is TimeXer, a transformer-based framework that has attracted attention for its elegant division of labor in multivariate time series forecasting. TimeXer separates the problem into two branches: an endogenous branch, or Endo branch, dedicated to modeling the target sequence itself, and an exogenous branch, or Exo branch, that handles interactions with auxiliary variables. This Endo/Exo dual-branch design acknowledges a fundamental truth of financial modeling—the variable you want to predict behaves differently from the variables that merely correlate with it. By keeping the target-sequence dynamics in a protected channel, TimeXer avoids letting noisy external signals contaminate the core representation of the series being forecast.</p>
<p>Yet the authors identified two structural weaknesses in the original design. First, TimeXer relies on patch-level tokenization, chopping the input sequence into segments that the transformer processes as tokens. While efficient, this coarse-grained approach can underrepresent fine-grained local transitions—the sharp, short-lived moves that often carry the most actionable information in stock data. Second, the standard attention mechanism in the Exo branch treats all auxiliary variables through a single learned attention map, which can be sensitive to redundant or weakly informative inputs. In markets, where dozens of correlated indicators compete for the model&#8217;s attention, such sensitivity can amplify unstable cross-variable relations rather than suppress them.</p>
<p>DAT-TimeXer addresses the first weakness by inserting a temporal convolutional network, or TCN, before the tokenization stage. TCNs are well suited to this role because they encode causal and dilated local temporal patterns directly at the original resolution of the data. Causal convolutions ensure that the model only looks backward in time, preserving the integrity of forecasting, while dilated convolutions stack layers with exponentially increasing gaps, allowing the network to capture patterns across multiple time scales without sacrificing fine detail. By enriching the representation with these local features before the sequence is divided into patches, the TCN acts as a kind of high-fidelity preprocessor that guarantees the subtle, rapid transitions in closing prices survive the tokenization step intact.</p>
<p>The second innovation applies multi-head differential attention exclusively to the Exo branch. Differential attention is a relatively new concept in deep learning: instead of computing a single attention map per head, the mechanism computes two independently learned attention maps and contrasts them, taking their difference as the effective attention. The intuition is that genuine, informative dependencies will appear consistently in both maps, while noise-driven spurious attention will tend to cancel out. Applied to the auxiliary variables, this subtraction-based refinement filters redundant or weakly informative market signals before they ever interact with the Endo branch, all while leaving the target-sequence dynamics in the Endo branch untouched. The result is a cleaner, more disciplined exchange of information between the two branches of the model.</p>
<p>The experimental design reflects a careful concern for realism. The researchers evaluated the model on three Chinese A-share series and nine U.S.-listed stocks, using chronological splits rather than random shuffling—a critical choice in financial machine learning, since random splits allow the model to inadvertently peek at future information. Feature screening was performed using training data only, further guarding against information leakage. The team tested both one-step forecasting, where the model predicts the next closing price, and multi-step forecasting at horizons of 1, 3, 5, and 10 time steps, covering the short-term windows that matter most to traders and quantitative analysts.</p>
<p>The results were consistent. DAT-TimeXer achieved the lowest mean forecasting errors among all compared models in the one-step evaluations, and it maintained lower errors across every evaluated multi-step horizon. To ensure the gains were not artifacts of a single market regime or a lucky configuration, the authors conducted cross-asset ablation studies, chronological subperiod analyses, and statistical significance testing. Attention visualizations provided additional evidence that the differential attention module was genuinely refining auxiliary-variable dependencies rather than merely redistributing noise. The ablations confirmed that the two added components—pre-tokenization TCN enhancement and Exo-specific differential attention—contribute complementary benefits, each addressing a distinct failure mode of the baseline architecture.</p>
<p>Notably, the improvements did not come at an extravagant computational price. The added components introduce only moderate overhead relative to the original TimeXer, an important consideration for practitioners who must retrain and recalibrate forecasting models regularly as market conditions evolve. The authors have made the code available from the corresponding author upon reasonable request, and the paper itself is published open access under a Creative Commons Attribution 4.0 license, allowing researchers and quantitative developers to examine, reproduce, and build upon the work. The study was supported in part by the Panzhihua Key Laboratory of &#8220;Internet Plus&#8221; Big Data and Artificial Intelligence, the Sichuan Education Information Technology Project, the Panzhihua University Teaching and Research Project, and the Sichuan Provincial Engineering and Technology Center for Vanadium and Titanium Materials Project.</p>
<p>Beyond its immediate results, the study offers a broader lesson for the field of time series forecasting: architectural choices matter most when they respect the structure of the data. Patch-based transformers excel at long-range dependencies but can blur local detail; attention mechanisms excel at variable selection but can be seduced by redundancy. DAT-TimeXer shows that these weaknesses are not inherent limits but engineering problems with targeted solutions—a convolutional front end to preserve resolution, and differential attention to subtract noise from signal. As machine learning continues to migrate into domains where the cost of a bad prediction is measured in real money, this kind of structure-aware adaptation may prove more valuable than ever-larger models. For now, the work stands as a compelling demonstration that sometimes the smartest way to see the future of a market is to look more carefully—and more skeptically—at everything around it.</p>
<p><strong>Subject of Research:</strong> Enhancing the TimeXer transformer with temporal convolutional networks and differential attention for multivariate stock price forecasting</p>
<p><strong>Article Title:</strong> Enhancing TimeXer with TCN and differential attention for multivariate stock forecasting</p>
<p><strong>Article References:</strong> Liu, S., Lan, Q., Zhang, J., &amp; Feng, W. (2026). Enhancing TimeXer with TCN and differential attention for multivariate stock forecasting. <em>Complex &amp;amp; Intelligent Systems</em>. <a href="https://doi.org/10.1007/s40747-026-02500-3" rel="noopener noreferrer">https://doi.org/10.1007/s40747-026-02500-3</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s40747-026-02500-3" rel="noopener noreferrer">10.1007/s40747-026-02500-3</a></p>
<p><strong>Keywords:</strong> stock market forecasting, multivariate time series, TimeXer, temporal convolutional network, differential attention, transformer models, deep learning, closing price prediction, Chinese A-share stocks, U.S.-listed stocks, attention mechanisms, Panzhihua University</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">199848</post-id>	</item>
	</channel>
</rss>
