<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>clustering algorithms &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/clustering-algorithms/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Thu, 08 Oct 2026 10:21:01 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>clustering algorithms &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>New Clustering Algorithm Sharpens the Hunt for Data Outliers</title>
		<link>https://scienmag.com/new-clustering-algorithm-sharpens-the-hunt-for-data-outliers/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Thu, 08 Oct 2026 10:21:01 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[ADPOD]]></category>
		<category><![CDATA[ADPOD clustering method]]></category>
		<category><![CDATA[advancements in clustering algorithms]]></category>
		<category><![CDATA[affinity density]]></category>
		<category><![CDATA[affinity density peak clustering]]></category>
		<category><![CDATA[anomaly detection]]></category>
		<category><![CDATA[anomaly detection in datasets]]></category>
		<category><![CDATA[Applied Intelligence]]></category>
		<category><![CDATA[clustering algorithms]]></category>
		<category><![CDATA[data mining]]></category>
		<category><![CDATA[data science clustering techniques]]></category>
		<category><![CDATA[density peak clustering algorithm]]></category>
		<category><![CDATA[density-peak clustering]]></category>
		<category><![CDATA[fraud detection in financial transactions]]></category>
		<category><![CDATA[improving data outlier separation]]></category>
		<category><![CDATA[k-nearest neighbors]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[machine learning for anomaly detection]]></category>
		<category><![CDATA[outlier]]></category>
		<category><![CDATA[outlier detection]]></category>
		<category><![CDATA[outlier detection in data clustering]]></category>
		<category><![CDATA[outlier detection in sensor data]]></category>
		<category><![CDATA[outlier identification in real-world data]]></category>
		<category><![CDATA[unsupervised learning]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=247034</guid>

					<description><![CDATA[Researchers at Yanshan University have developed ADPOD, an outlier detection algorithm that improves density-peak clustering with an affinity-based density measure, automatic cluster-center selection, and a relative distance metric.]]></description>
										<content:encoded><![CDATA[<p>Few problems in data science are as deceptively simple, or as consequential, as deciding which points in a dataset do not belong. A fraudulent credit-card transaction, a failing wind turbine, a malicious software bot, or a malfunctioning sensor in a hospital monitoring system all announce themselves in the same way: they look different from the crowd. A new algorithm described in Applied Intelligence by researchers at Yanshan University in Qinhuangdao, China, promises to make that judgment more reliable. The method, called ADPOD, short for affinity density peak clustering, builds on one of the most celebrated ideas in modern clustering and repairs several of its most persistent weaknesses. In experiments on both synthetic and real-world datasets, the authors report that it significantly outperforms state-of-the-art competitors at separating genuine anomalies from ordinary data.</p>
<p>The intellectual foundation of ADPOD is density-peak clustering, a technique introduced by Alex Rodriguez and Alessandro Laio in a landmark 2014 paper in Science. The core insight of that method was elegant: real cluster centers are points that sit in regions of high density while being far away from any other point of even higher density. Plotting density against distance to the nearest denser neighbor produces a characteristic pattern in which true cluster centers leap out as outliers of the decision graph itself. The approach became popular because it can identify clusters of arbitrary shape without requiring analysts to specify how many clusters exist in advance, and because it needs only a single pass over pairwise distances rather than the iterative refinement that k-means demands.</p>
<p>Yet for all its appeal, density-peak clustering has long carried well-known baggage. The original formulation estimates density by counting how many points fall within a fixed cutoff distance, a crude measure that ignores the fine-grained structure of the local neighborhood. Two points can have identical counts of nearby neighbors while occupying radically different positions in the geometry of the data. The method also traditionally requires a human to eyeball the decision graph and choose cluster centers by hand, which makes it difficult to deploy in automated pipelines. And when researchers tried to repurpose density-peak clustering for outlier detection, they discovered a deeper conceptual gap: the framework offered no effective relative-distance mechanism for deciding, point by point, whether an instance is normal or anomalous relative to the clusters around it.</p>
<p>ADPOD attacks each of these weaknesses in turn. The first and most fundamental innovation is a new way of measuring density, which the authors call affinity density. Instead of simply counting neighbors within a radius, the algorithm looks at the intersection between the k-nearest-neighbor sets of two samples, in other words, how many neighbors the two points share, and combines that overlap with the actual distances between them. This dual criterion captures something that raw counts cannot: the degree to which two points belong to the same local structure. Points that share many of the same closest companions are strongly affiliated, even if they are not literally adjacent, while points that share few or none are structurally isolated. The result is a density estimate that is sensitive to the shape and connectivity of the data rather than just its coarse packing.</p>
<p>The second step automates a task that previously demanded human judgment. ADPOD determines cluster centers automatically by computing the product of each point&#8217;s affinity density and its decision distance, the distance to the nearest point of higher density. Genuine cluster centers score high on both factors simultaneously: they sit in dense regions and are well separated from other dense regions. Taking the product means that a point must excel on both counts to be selected, which filters out false candidates that are merely isolated or merely dense. This removes the manual parameter tuning that has long been a bottleneck for practitioners who want to run density-peak methods at scale or embed them in systems where no expert is available to inspect the graphs.</p>
<p>Third, the algorithm replaces the raw Euclidean distance between data objects with a cluster relative distance. Rather than asking how far a point is from another point in absolute terms, ADPOD asks how far it is relative to the cluster structure it is being judged against. This matters because datasets rarely have uniform density. In a mixture of a tight, compact cluster and a loose, diffuse one, absolute distances systematically misjudge the diffuse cluster&#8217;s members, flagging legitimate points as suspicious simply because their neighborhood is spread out. A relative metric levels the playing field, evaluating each point against the local standards of its own cluster rather than against a global yardstick that favors compact regions.</p>
<p>The final component is a novel outlier factor that quantifies the degree of outlierness for every object in the dataset. Drawing together the affinity density, the automated cluster assignments, and the relative distance metric, this factor produces a score that ranks points by how anomalous they are, allowing analysts to set thresholds or inspect the most extreme cases first. The design reflects a broader trend in the field, visible in recent work on relative density ratios, local entropy, and granular-ball detectors: the recognition that a single global statistic is rarely sufficient, and that reliable detection requires combining local structural evidence with cluster-level context.</p>
<p>The experimental case for ADPOD rests on extensive testing across synthetic datasets, where the ground truth is known by construction, and real-world datasets, where it must be inferred. The authors evaluated performance using the area under the receiver operating characteristic curve, the standard measure introduced by Hanley and McNeil that captures how well a detector trades off true positives against false positives across all possible thresholds. Against a competitive field that includes LOF, the classic local-outlier-factor method from 2000; HBOS, a fast histogram-based scorer; ECOD, a recent approach based on empirical cumulative distribution functions; and a series of newer density-peak-derived detectors, ADPOD reportedly achieved significantly better results. The comparison set also spans graph-based methods, autoencoder approaches, and k-means variants with outlier removal, giving a broad picture of the current state of the art.</p>
<p>The practical stakes of this line of research are considerable. Outlier detection underpins fraud detection in finance, fault diagnosis in industrial robots and wireless sensor networks, cleaning of abnormal power-curve data from wind turbines, bot detection on social platforms, and anomaly monitoring over streaming text. In each of these settings, the cost of a missed anomaly can be severe, and the cost of a false alarm erodes trust in the system. Methods that require manual tuning are particularly ill-suited to these domains, where data arrives continuously and distributions drift over time. An algorithm that selects its own cluster centers and adapts its density estimates to local structure is a step toward detectors that can run unattended. The authors&#8217; own prior work, including a relative skewness density ratio outlier factor published in the same journal, shows a sustained research program aimed at exactly this kind of automation.</p>
<p>ADPOD also illustrates how a decade-old idea can keep yielding returns when its assumptions are reexamined. Rodriguez and Laio&#8217;s density peaks gave the community a powerful mental model of clustering as the search for high-density islands separated by low-density moats. What ADPOD demonstrates is that the model&#8217;s two central ingredients, density and distance, were both defined too narrowly. Density becomes richer when it incorporates neighborhood overlap, and distance becomes fairer when it is measured relative to cluster context. With those refinements in place, the same decision-graph logic that once required a trained eye to interpret can be computed, scored, and turned directly into an outlier ranking. For a field increasingly asked to make trustworthy automatic judgments about which data can be believed, that combination of conceptual clarity and hands-off operation may prove to be the algorithm&#8217;s most important feature.</p>
<p><strong>Subject of Research:</strong> Outlier detection using affinity density peak clustering</p>
<p><strong>Article Title:</strong> ADPOD: An outlier detection algorithm based on affinity density peak clustering</p>
<p><strong>Article References:</strong> ADPOD: An outlier detection algorithm based on affinity density peak clustering. (n.d.). <a href="https://doi.org/10.1007/s10489-026-07430-8" rel="noopener noreferrer">https://doi.org/10.1007/s10489-026-07430-8</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10489-026-07430-8" rel="noopener noreferrer">10.1007/s10489-026-07430-8</a></p>
<p><strong>Keywords:</strong> outlier detection, density-peak clustering, affinity density, anomaly detection, data mining, machine learning, clustering algorithms, k-nearest neighbors, unsupervised learning, Applied Intelligence, ADPOD, outlier</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">247034</post-id>	</item>
		<item>
		<title>New Clustering Framework Tames Massive High-Dimensional Data Without the Usual Bottleneck</title>
		<link>https://scienmag.com/new-clustering-framework-tames-massive-high-dimensional-data-without-the-usual-bottleneck/</link>
		
		<dc:creator><![CDATA[Juliet Wilcox]]></dc:creator>
		<pubDate>Thu, 24 Sep 2026 23:41:47 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[affinity graph]]></category>
		<category><![CDATA[anchor-based modeling]]></category>
		<category><![CDATA[clustering algorithms]]></category>
		<category><![CDATA[computational efficiency in clustering]]></category>
		<category><![CDATA[data mining]]></category>
		<category><![CDATA[document collection clustering]]></category>
		<category><![CDATA[gene expression data analysis]]></category>
		<category><![CDATA[high-dimensional data]]></category>
		<category><![CDATA[high-dimensional data clustering]]></category>
		<category><![CDATA[high-dimensional data visualization]]></category>
		<category><![CDATA[image data clustering]]></category>
		<category><![CDATA[large-scale data analysis]]></category>
		<category><![CDATA[Machine learning]]></category>
		<category><![CDATA[manifold regularization]]></category>
		<category><![CDATA[neural network-based clustering]]></category>
		<category><![CDATA[nonnegative matrix factorization]]></category>
		<category><![CDATA[representation learning]]></category>
		<category><![CDATA[scalability]]></category>
		<category><![CDATA[scalable data mining algorithms]]></category>
		<category><![CDATA[sensor stream data segmentation]]></category>
		<category><![CDATA[subspace clustering]]></category>
		<category><![CDATA[subspace clustering techniques]]></category>
		<category><![CDATA[tensor-based clustering methods]]></category>
		<category><![CDATA[unsupervised learning]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=213439</guid>

					<description><![CDATA[Researchers have unveiled a subspace clustering framework that preserves the structural fidelity of high-dimensional data while avoiding the prohibitive cost of full sample-to-sample affinity matrices.]]></description>
										<content:encoded><![CDATA[<p>Modern data rarely arrives in tidy, well-separated groups. Images, gene expression profiles, sensor streams, and document collections all tend to live on tangled, low-dimensional structures hidden inside spaces with thousands of dimensions. Subspace clustering has emerged as one of the most powerful mathematical tools for finding those hidden structures, modeling a dataset as a union of multiple linear or affine subspaces and assigning each point to the subspace where it truly belongs. Yet the technique has long suffered from a painful trade-off: the methods that capture structure most faithfully tend to collapse under the sheer scale of real-world data. A new study published in Data Mining and Knowledge Discovery by Mo Chen, Xuesong Yin, Qi Huang, Jianhao Ding, Guodao Zhang, and Xinjun Miao now offers a way to have both fidelity and scale, presenting a framework called Large-scale Structured Subspace Clustering, or LSSC.</p>
<p>The central obstacle the researchers set out to overcome is a computational one that has shaped the field for over a decade. Classical subspace clustering methods rely on a self-representation model, in which every data point is expressed as a linear combination of all the other points. The resulting coefficient matrix encodes the relationships that define cluster membership, and it is extraordinarily informative. The problem is its size. For n data points, the full sample-to-sample affinity matrix contains n squared entries, so a dataset of one million samples would demand a matrix with a trillion coefficients. Constructing, storing, and optimizing over such an object is prohibitive on any hardware, which is precisely why many theoretically elegant subspace clustering algorithms have remained confined to benchmark datasets of a few thousand points.</p>
<p>The LSSC framework breaks this bottleneck by replacing the full self-representation with a compact sample-to-anchor representation. Instead of allowing every point to be reconstructed from every other point, the method first selects a much smaller set of anchor points that serve as representative landmarks for the data. Each sample is then expressed as a nonnegative combination of these anchors alone. Because the number of anchors grows far more slowly than the number of samples, the coefficient matrix shrinks from n squared to a size proportional to n times the anchor count, turning an intractable optimization into a manageable one. Crucially, the nonnegativity constraint on the coefficients gives the representation a natural probabilistic flavor: each weight reflects how strongly a sample belongs to the neighborhood of a given anchor, which makes the downstream clustering step far more stable.</p>
<p>Compactness alone, however, is not enough. The authors identify a second, subtler failure mode in existing scalable methods: fast representations often fail to preserve the intrinsic structural relationships of the data when distributions become complex. Two points that sit close together on the same underlying manifold may end up with very different anchor coefficients simply because of how the anchors were sampled, and the resulting affinity graph can fragment genuine clusters. LSSC counters this with a locality-aware coefficient initialization, which seeds the optimization using neighborhood information so that the reconstruction process starts from a configuration already consistent with the local geometry of the data. This initialization acts like a well-chosen starting point in a rugged optimization landscape, steering the solution toward coefficients that respect the manifold rather than artifacts of sampling.</p>
<p>On top of that initialization, the framework applies distance-weighted structure regularization, a mechanism that explicitly encourages the learned representation to remain smooth with respect to the geometry of the data. Samples that are near each other in the original feature space are pushed toward similar anchor coefficients, weaving locality information directly into the optimization objective rather than bolting it on afterward. The framework also employs coefficient regularization to keep the representation compact and well-conditioned, suppressing degenerate solutions in which a sample spreads its weight indiscriminately across many anchors. Together, these four components—anchor-based reconstruction, locality-aware initialization, distance-weighted regularization, and coefficient regularization—form a single coherent objective that learns a structured, nonnegative representation without ever forming the full sample-to-sample affinity matrix.</p>
<p>The mathematical machinery behind the approach draws on a rich lineage of research. Low-rank representation, introduced by Liu and colleagues, and sparse subspace clustering, developed by Elhamifar and Vidal, established the foundational idea that imposing structure on self-representation coefficients reveals subspace membership. Nonnegative matrix factorization, famously connected by Lee and Seung to the way humans learn parts of objects, supplies the theoretical justification for the nonnegative coefficients at the heart of LSSC. More recent work on anchor graphs and landmark-based spectral clustering demonstrated that working with a reduced set of representative points can preserve much of the quality of full spectral methods at a fraction of the cost. LSSC synthesizes these threads, but its distinctive contribution is the integration of structure-preserving regularization into the anchor-based pipeline, addressing the structural fidelity problem that earlier fast methods left unresolved.</p>
<p>To test the framework, the team ran extensive experiments on nine benchmark datasets, comparing LSSC against a battery of established clustering algorithms using four standard evaluation metrics: clustering accuracy (ACC), normalized mutual information (NMI), Purity, and the adjusted rand index (ARI). The results were striking. Among the compared methods that completed all nine datasets, LSSC achieved the best overall average rank across all four metrics, indicating that its advantage is not confined to one type of data or one evaluation criterion but reflects a consistently strong performance profile. On the large-scale datasets, where many competitors either slowed to a crawl or failed outright, LSSC maintained competitive clustering quality while demonstrating the favorable scalability that the anchor-based design was built to deliver.</p>
<p>The authors are careful to characterize the limits of their method as well as its strengths, a candor that lends the study particular scientific value. Their experiments reveal that LSSC shows sensitivity to highly imbalanced data distributions, a scenario in which some clusters contain vastly more samples than others. This vulnerability is a known hazard of anchor-based approaches, since anchors tend to be drawn disproportionately from dense regions of the data, leaving sparse clusters underrepresented in the reconstruction basis. By documenting this weakness explicitly, the researchers provide a clear empirical map of where the framework should be deployed and where practitioners should exercise caution, an honest assessment that is all too rare in a field often driven by headline benchmark numbers.</p>
<p>The implications reach well beyond the machine learning community. Subspace clustering underpins applications from image segmentation and hyperspectral image analysis to single-cell RNA sequencing, where biologists attempt to sort thousands of individual cells into functional types based on high-dimensional gene expression. A method that scales gracefully while preserving structural fidelity could make such analyses feasible on datasets that are currently out of reach, and the same logic applies to speech processing, anomaly detection, and any domain where high-dimensional observations hide low-dimensional group structure. The work, supported by research grants from Zhejiang Province and Hangzhou Dianzi University, arrives at a moment when the volume of unlabeled data is exploding faster than the tools to organize it. By showing that structure and scale need not be enemies, LSSC offers a template for the next generation of clustering algorithms: representations that are compact by design, yet rich enough to remember the geometry that made the clusters real in the first place.</p>
<p><strong>Subject of Research:</strong> Scalable anchor-based subspace clustering for large high-dimensional datasets</p>
<p><strong>Article Title:</strong> Large-scale structured subspace clustering</p>
<p><strong>Article References:</strong> Chen, M., Yin, X., Huang, Q., Ding, J., Zhang, G., &amp; Miao, X. (2026). Large-scale structured subspace clustering. <em>Data Mining and Knowledge Discovery, 40</em>(6), Article 99. <a href="https://doi.org/10.1007/s10618-026-01268-x" rel="noopener noreferrer">https://doi.org/10.1007/s10618-026-01268-x</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10618-026-01268-x" rel="noopener noreferrer">10.1007/s10618-026-01268-x</a></p>
<p><strong>Keywords:</strong> subspace clustering, anchor-based modeling, representation learning, affinity graph, manifold regularization, nonnegative matrix factorization, data mining, unsupervised learning, scalability, high-dimensional data, clustering algorithms, machine learning</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">213439</post-id>	</item>
	</channel>
</rss>
