<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>sequence modeling &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/sequence-modeling/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Thu, 01 Oct 2026 11:14:18 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.2</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>sequence modeling &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>New AI Model Reads the Rhythms of Human Movement to Predict Where You Will Go Next</title>
		<link>https://scienmag.com/new-ai-model-reads-the-rhythms-of-human-movement-to-predict-where-you-will-go-next/</link>
		
		<dc:creator><![CDATA[Violet Maxwell]]></dc:creator>
		<pubDate>Thu, 01 Oct 2026 11:14:18 +0000</pubDate>
				<category><![CDATA[Earth Science]]></category>
		<category><![CDATA[advances in location-based services]]></category>
		<category><![CDATA[AI-based location prediction models]]></category>
		<category><![CDATA[deep learning]]></category>
		<category><![CDATA[deformable convolution]]></category>
		<category><![CDATA[Foursquare]]></category>
		<category><![CDATA[geographic patterns]]></category>
		<category><![CDATA[Gowalla]]></category>
		<category><![CDATA[human behavior and routine modeling]]></category>
		<category><![CDATA[human mobility]]></category>
		<category><![CDATA[Human movement pattern analysis]]></category>
		<category><![CDATA[location recommendation system improvements]]></category>
		<category><![CDATA[location-aware security systems]]></category>
		<category><![CDATA[location-based social networks]]></category>
		<category><![CDATA[MultiPerG convolution network]]></category>
		<category><![CDATA[next point of interest prediction]]></category>
		<category><![CDATA[periodic patterns]]></category>
		<category><![CDATA[POI recommendation]]></category>
		<category><![CDATA[predictive analytics for human mobility]]></category>
		<category><![CDATA[sequence modeling]]></category>
		<category><![CDATA[social analysis through movement data]]></category>
		<category><![CDATA[streams of check-in data analysis]]></category>
		<category><![CDATA[temporal convolutional network]]></category>
		<category><![CDATA[time bias in movement prediction]]></category>
		<category><![CDATA[trajectory mining]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=222290</guid>

					<description><![CDATA[Researchers have developed MultiPerG, a hierarchical convolutional network that learns multi-scale periodic and geographic patterns in human trajectories to predict a user's next point of interest more accurately than existing methods.]]></description>
										<content:encoded><![CDATA[<p>Every one of us is a creature of habit. We grab coffee at the same corner café each weekday morning, visit the gym on predictable evenings, and drift toward familiar neighborhoods on weekends. That deep regularity, hidden inside the streams of check-ins we leave on platforms like Foursquare and Yelp, is exactly what a team of Chinese researchers set out to capture. In a study published in the open-access journal Vicinagearth, they introduce MultiPerG, a Multiple Periodic Geography convolution network designed to predict a person&#8217;s next point of interest, or POI, with unprecedented accuracy. The work matters because next-location prediction underpins a surprising range of services, from intelligent signal processing and social analysis to location-aware security systems, and because the researchers argue that most existing approaches have been reading our movement histories in fundamentally the wrong way.</p>
<p>The core problem, as the authors describe it, is that conventional recommendation systems treat a user&#8217;s trajectory as a simple sequence of visits and then model only the consecutive correlations between neighboring check-ins. That strategy is vulnerable to what the team calls time bias. Real people deviate from their routines: a commuter catches a later train, a lunch appointment shifts by forty minutes, an errand is skipped one week and doubled up the next. Sequence models that latch onto exact consecutive orderings are easily corrupted by these deviations and by random noise in the data. Worse, most methods ignore periodicity altogether or rely on pre-specified intervals and fixed ranges, hard-coded assumptions that prevent the model from learning the true rhythm of a user&#8217;s life adaptively. The researchers also identified a second blind spot: geography. Existing systems tend to reason about spatial proximity at a single, fine-grained scale, even though human mobility is organized hierarchically across neighborhoods, cities, and regions.</p>
<p>Before building their model, the team examined real-world data from Foursquare and found striking statistical evidence for both kinds of regularity. Users&#8217; trajectories showed multi-span temporal patterns, meaning activity tendencies differ across periods such as weekdays versus rest days, and multi-interval patterns, in which a person returns to the same location after a roughly fixed gap, such as every day or every four hours. Spatially, different users roam across regions of very different extent, from a few city blocks to entire metropolitan areas. These observations framed the design brief for MultiPerG: the model needed to discover periodic patterns at multiple intervals and spans without being told what they are, tolerate the small biases that come with human behavior, and read geographic structure at multiple scales simultaneously.</p>
<p>Architecturally, MultiPerG is a hierarchical framework built on the foundations of temporal convolutional networks, or TCNs, a family of sequence models that use causal convolutions, which prevent information from the future leaking into the past, and dilated convolutions, which deliberately skip positions to widen the network&#8217;s receptive field. The researchers transform a user&#8217;s check-in history into a sequence feature map, a matrix analogous to an image in computer vision, by segmenting the week into equal one-hour gaps over seven days. Candidate locations are likewise converted into a geography feature map by gridding GPS coordinates into equal-area units, and this map is built hierarchically so that each level represents a coarser spatial granularity. A codebook stores the coordinates of every location across all scale levels, allowing the network to look up where any given POI sits within the multi-scale geographic structure.</p>
<p>The heart of the innovation lies in three novel kinds of deformable blocks. The first two handle time. A multi-interval deformable tree layer arranges dilated causal convolutions into a binary-tree structure, with left and right branches preserving the outermost elements of each segment. The convolutions carry learnable deformable offsets, a technique borrowed from deformable convolutional networks in computer vision, which let the sampling positions of each kernel float slightly rather than sitting at fixed intervals. In practice, these offsets absorb the consecutive time bias and accidental fluctuations produced by deviant visits, so the model can still detect that a user returns to a place roughly every day even when the actual visits drift by an hour or two. A second, segment-tree-structured layer works in the complementary direction, combining adjacent segments of the sequence into progressively larger spans so that patterns like day-long or month-long routines emerge adaptively. The outputs of the interval and span layers are then multiplied together to form a joint periodic representation of the user&#8217;s habits.</p>
<p>The third block addresses space. The geo-span learning layer stacks two-dimensional dilated causal convolutions across the hierarchical levels of the geography feature map, capturing spatial dependence at scales ranging from fine urban units up to broad regions. The authors note a subtle problem with this design: when locations are discretized onto maps, noise arises because two places that fall into the same unit at one scale may belong to distinct sections at a finer scale. To suppress this, they introduce a custom non-linear activation function called tan, described as the counterpart of tanh in the complex domain via Euler&#8217;s formula, whose steep gradient behavior approaching infinity amplifies large-scale influence while diminishing small-scale noise. After amplification and normalization, the outputs of all geographic levels are summed with adjusted weights, and the learned geographic patterns are combined with the periodic sequence patterns to produce, through a query embedding, a probability for every candidate location.</p>
<p>Training uses a cross-entropy loss summed over users, with randomly selected negative samples, and the network is optimized with Adam and mini-batch stochastic gradient descent. The team evaluated MultiPerG against eleven state-of-the-art baselines spanning four methodological families: CNN-based models such as Caser, CosRec, NextItNet and NASR; attention-based models including TiSASRec, STAN and ASPPA; the graph-neural-network-based CyGNet; and RNN-based models LSTPM and PLSPL. Experiments ran ten times on NVIDIA V100 GPUs with baselines fine-tuned for fairness, using four datasets: Foursquare check-ins from New York City and Tokyo, Yelp data from Tucson, and the full Gowalla dataset, filtered to remove inactive users and locations.</p>
<p>The results were decisive. MultiPerG outperformed every baseline on every recall metric at cutoffs of five, ten and twenty recommendations. On the New York and Tokyo datasets it improved Recall@5 by 5.5 and 6.4 percent respectively over the strongest competitor, the LSTM-based PLSPL, and on Gowalla the gains were larger still, at 10.5 percent for Recall@5 and 11.8 percent for Recall@10. The comparison also yielded interesting secondary findings: recurrent models excelled at personalized accuracy but lagged on generalized performance, while models built on temporal convolutional networks with large receptive fields, such as NASR and NextItNet, fared best among the CNN family. Ablation studies confirmed that every module earns its place. Removing the geo-span layer hurt most, underscoring how much geography contributes to next-POI prediction, while removing the interval layer cost slightly more than removing the span layer, suggesting interval periodicity is marginally more influential. Embedding dimensions of roughly 50 to 60 proved sufficient, and a modest geography map size of 128 units performed well.</p>
<p>Perhaps most compelling are the interpretability analyses. Heatmaps of the interval and span layer outputs for 32 New York users over 72 hours revealed a clear four-hour interval pattern during daytime hours, stronger relevance among midnight spans, and an overarching 24-hour daily repetition in both, matching the expected rhythm of human activity. The deformable offsets visibly corrected time bias in the trajectories. Geographic heatmaps, meanwhile, showed clustered high-relevance zones that align with users&#8217; real activity centers: in the New York data the hot zones match the densest check-in areas, and in Gowalla they correspond to Texas and California, the two states contributing the most data. The authors conclude that MultiPerG&#8217;s advantage stems precisely from its ability to explore periodic patterns, and they point toward future work on more variations of the geography blocks and more generalized periodicity recovery. For now, the study offers a vivid demonstration that the key to predicting where someone will go next lies not just in where they have been, but in the nested rhythms of time and space that shape every journey.</p>
<p><strong>Subject of Research:</strong> Next point-of-interest recommendation using periodic and geographic pattern learning in human trajectory data</p>
<p><strong>Article Title:</strong> MultiPerG: Multiple Periodic Geography convolution for next POI recommendation</p>
<p><strong>Article References:</strong> Wang, X., Wang, B., Wang, D., Wang, Z., Sun, G., Zhao, B., &amp; Chen, M. (2025). MultiPerG: Multiple Periodic Geography convolution for next POI recommendation. <em>Vicinagearth, 2</em>(1), Article 3. <a href="https://doi.org/10.1007/s44336-025-00012-1" rel="noopener noreferrer">https://doi.org/10.1007/s44336-025-00012-1</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s44336-025-00012-1" rel="noopener noreferrer">10.1007/s44336-025-00012-1</a></p>
<p><strong>Keywords:</strong> POI recommendation, human mobility, temporal convolutional network, periodic patterns, geographic patterns, deformable convolution, location-based social networks, sequence modeling, deep learning, trajectory mining, Foursquare, Gowalla</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">222290</post-id>	</item>
		<item>
		<title>Wavelet-Enhanced Mamba and Graph Networks Revolutionize Time Series Anomaly Detection</title>
		<link>https://scienmag.com/wavelet-enhanced-mamba-and-graph-networks-revolutionize-time-series-anomaly-detection/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Wed, 23 Sep 2026 01:46:57 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[anomaly detection]]></category>
		<category><![CDATA[cyberattack detection in IoT networks]]></category>
		<category><![CDATA[deep learning]]></category>
		<category><![CDATA[deep learning models for time series]]></category>
		<category><![CDATA[Graph neural network]]></category>
		<category><![CDATA[graph neural networks for data modeling]]></category>
		<category><![CDATA[healthcare sensor data anomaly detection]]></category>
		<category><![CDATA[Internet of Things]]></category>
		<category><![CDATA[Internet of Things sensor data analysis]]></category>
		<category><![CDATA[IoT sensors]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[Mamba]]></category>
		<category><![CDATA[Mamba sequence architecture in machine learning]]></category>
		<category><![CDATA[multi-modal data fusion in anomaly detection]]></category>
		<category><![CDATA[multivariate data]]></category>
		<category><![CDATA[real-time anomaly detection in industrial systems]]></category>
		<category><![CDATA[sequence modeling]]></category>
		<category><![CDATA[smart city traffic monitoring]]></category>
		<category><![CDATA[spacecraft telemetry anomaly detection]]></category>
		<category><![CDATA[state-space models]]></category>
		<category><![CDATA[time series]]></category>
		<category><![CDATA[time series anomaly detection]]></category>
		<category><![CDATA[wavelet analysis for signal processing]]></category>
		<category><![CDATA[wavelet transform]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=209641</guid>

					<description><![CDATA[Researchers in Beijing have unveiled a wavelet-enhanced model combining Mamba sequence modeling and graph neural networks that outperforms prevailing methods for detecting anomalies in multivariate time series from IoT systems.]]></description>
										<content:encoded><![CDATA[<p>The relentless growth of the Internet of Things has transformed ordinary environments into vast webs of interconnected sensors, each streaming measurements around the clock. From smart factories to hospital wards, from city traffic systems to orbiting spacecraft, the world now generates rivers of time series data faster than human operators can watch them. Buried within those streams are the signals that matter most: the sudden voltage spike that precedes a machine failure, the erratic heartbeat that foreshadows a cardiac event, the subtle sensor drift that hints at a cyberattack. A research team in Beijing has now introduced a machine learning model designed to catch precisely those signals, and their approach combines three of the most powerful ideas in modern artificial intelligence into a single architecture.</p>
<p>The study, led by Hanjie Xu of Zhongguancun Lab and Beihang University together with Ju Ren of Tsinghua University, Jie Liu of Beijing Information Science and Technology University, Zhenya Ma, Wang Huang of Central South University, and Jianwei Niu of Beihang University, was published in the International Journal of Machine Learning and Cybernetics. The team&#8217;s model, which fuses wavelet analysis, graph neural networks, and the newly popular Mamba sequence architecture, outperformed a wide range of established baselines in extensive benchmark testing. The work addresses one of the most persistent challenges in applied machine learning: detecting anomalies in multivariate time series, where dozens or hundreds of correlated sensor channels evolve together and a fault in one can ripple through the others in complex ways.</p>
<p>Each of the three components of the new model plays a distinct role. Wavelet representations, the first ingredient, give the network a way to see a signal at multiple resolutions simultaneously. Traditional Fourier analysis tells an engineer which frequencies exist in a signal but says little about when they occurred, a limitation known as the time frequency trade off. Wavelet transforms solve this by decomposing a signal into localized oscillations of different scales, so the model can capture both a slow drift lasting minutes and a sharp transient lasting milliseconds. By enhancing the raw inputs with these wavelet features, the architecture extracts far richer representations of each moment in the stream than models that read the raw sensor values alone.</p>
<p>The second ingredient, graph neural networks, addresses the fact that sensor data is rarely a set of independent channels. In a water treatment plant, a pressure sensor upstream is physically and causally linked to a flow sensor downstream; in a server cluster, the temperature readings of adjacent racks move in concert. Graph neural networks encode these relationships explicitly, treating each sensor as a node and the learned or measured dependencies as edges. Message passing across the graph allows the model to build a picture of how the whole system should behave as a coherent network, and to flag moments when that coherence breaks down. This topology learning capability, the authors argue, is essential for detecting anomalies that only become visible when several channels are viewed together.</p>
<p>The third component, Mamba, is one of the most talked about architectures in artificial intelligence today. Introduced by Albert Gu and Tri Dao in late 2023, Mamba is a selective state space model that processes sequences in linear time, in contrast to the quadratic cost of transformer attention. For time series workloads, where context windows can stretch across thousands of timesteps and the model must run on resource constrained edge devices, that efficiency matters enormously. Mamba&#8217;s selective mechanism lets the network decide dynamically which parts of the past to remember and which to forget, giving it a powerful ability to follow long range sequential patterns without the memory burden that attends older recurrent designs.</p>
<p>What makes the new model distinctive is the way these three ideas operate together rather than in sequence. The wavelet enhanced representations give the sequence model a frequency aware view of each channel, the graph neural network binds those views into a coherent picture of system wide behavior, and the Mamba backbone explores how the entire enriched representation evolves through time. In effect, the model asks three questions at once: how is each sensor oscillating, how are the sensors related, and how are those patterns changing? An anomaly is registered when any of these three questions produces an answer that deviates from what the model has learned to expect from normal operation.</p>
<p>The evaluation was extensive. The researchers tested their architecture against a broad collection of time series anomaly detection baselines, spanning the main families of methods that have dominated the field over the past decade. Those baselines include long short term memory networks, which have been used for everything from spacecraft telemetry to rail transit monitoring; variational autoencoders and generative adversarial networks that learn to reconstruct normal data and flag what they cannot reconstruct; transformer models such as TranAD and the Anomaly Transformer, which use attention to model dependencies across time; and earlier graph based detectors, including graph attention networks and graph deviation networks, which pioneered the topological view of multivariate data. Across this competitive landscape, the wavelet enhanced Mamba and graph network model outperformed many prevailing approaches.</p>
<p>The significance of the result extends beyond leaderboard positions. Anomaly detection sits at the foundation of industrial safety, cybersecurity, financial monitoring, and healthcare. Earlier studies in the literature the team cites show detectors deployed in industrial IoT systems, smart city traffic networks, financial markets analyzed with principal component analysis and neural networks, and clinical settings where deep learning reviews promise earlier warnings. Each of these domains has its own constraints: latency requirements that forbid heavy computation, noisy training sets, and distribution shifts that arise as machines age or seasons change. A detector that combines strong accuracy with linear time sequence processing and explicit modeling of sensor topology is therefore well matched to deployment realities, particularly at the network edge where IoT devices typically live.</p>
<p>The Mamba component deserves particular attention because it represents a broader shift in the machine learning community. Since the original Mamba paper appeared, researchers have rapidly adapted the architecture to forecasting and detection tasks, producing variants such as bidirectional Mamba for time series prediction, spatial temporal Mamba for multivariate anomaly detection, and Mamba based foundation models for general forecasting. By embedding Mamba within a graph structure and enhancing its inputs with wavelets, the Beijing team positions their model at the intersection of several active research fronts. The graph element draws on a lineage that runs from graph convolutional networks through temporal graph convolutional networks for traffic prediction to recent topological analysis methods, while the wavelet element revives a classical signal processing tool whose value modern deep learning has increasingly rediscovered.</p>
<p>The study also acknowledges the practical ecosystems in which such models must be validated. The references underpinning the work include widely used benchmarks such as the MIT BIH arrhythmia database for cardiac signals, spacecraft telemetry datasets with expert labeled anomalies, and secure water treatment testbeds used in adversarial cyberattack research. Datasets of this kind have shaped the field by providing realistic fault patterns against which methods can be calibrated, and the competitive advantage the new model demonstrated against baselines on this landscape suggests it generalizes across heterogeneous data regimes rather than being tuned to a single domain. The authors declare no conflict of interest, and the work received support reflected in the supervisory and funding roles of the senior researchers on the team.</p>
<p>Looking ahead, the research points toward anomaly detectors that are simultaneously faster, more aware of physical structure, and more sensitive to the fine grained dynamics of the systems they watch. As billions more devices come online, the volume of time series data will only grow, and the cost of missing a fault will continue to rise, whether measured in damaged equipment, lost revenue, compromised security, or human health. A model that can read a system through its frequencies, its connections, and its history at linear cost offers a template for the next generation of monitoring infrastructure. The Beijing team&#8217;s results suggest that the combination of wavelets, graphs, and selective state space models is more than a fashionable assembly of components; it is a coherent answer to the question of how machines can learn what normal looks like in an increasingly connected world, and how quickly they can notice when that normality shatters.</p>
<p><strong>Subject of Research:</strong> A wavelet-enhanced Mamba and graph neural network model for detecting anomalies in multivariate time series data from IoT systems.</p>
<p><strong>Article Title:</strong> Wavelet-enhanced Mamba and graph network-based model for time series anomaly detection</p>
<p><strong>Article References:</strong> Xu, H., Ren, J., Liu, J., Ma, Z., Huang, W., &amp; Niu, J. (2026). Wavelet-enhanced Mamba and graph network-based model for time series anomaly detection. <em>International Journal of Machine Learning and Cybernetics, 17</em>(10), Article 475. <a href="https://doi.org/10.1007/s13042-026-03250-x" rel="noopener noreferrer">https://doi.org/10.1007/s13042-026-03250-x</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s13042-026-03250-x" rel="noopener noreferrer">10.1007/s13042-026-03250-x</a></p>
<p><strong>Keywords:</strong> time series, anomaly detection, Mamba, graph neural network, wavelet transform, Internet of Things, machine learning, state space models, multivariate data, deep learning, IoT sensors, sequence modeling</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">209641</post-id>	</item>
	</channel>
</rss>
