<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>over-smoothing &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/over-smoothing/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Thu, 08 Oct 2026 01:01:24 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>over-smoothing &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>New Graph AI Learns Without Gradient Descent, Cutting Training Time Dramatically</title>
		<link>https://scienmag.com/new-graph-ai-learns-without-gradient-descent-cutting-training-time-dramatically/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Thu, 08 Oct 2026 01:01:24 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[Applied Intelligence]]></category>
		<category><![CDATA[autoencoder]]></category>
		<category><![CDATA[autoencoder architectures]]></category>
		<category><![CDATA[deep learning]]></category>
		<category><![CDATA[efficient graph learning models]]></category>
		<category><![CDATA[extreme learning machine]]></category>
		<category><![CDATA[gradient descent]]></category>
		<category><![CDATA[gradient-free learning]]></category>
		<category><![CDATA[graph convolutional networks]]></category>
		<category><![CDATA[graph embedding]]></category>
		<category><![CDATA[graph embedding techniques]]></category>
		<category><![CDATA[Graph Neural Networks]]></category>
		<category><![CDATA[high-dimensional data compression]]></category>
		<category><![CDATA[knowledge graph representation]]></category>
		<category><![CDATA[link prediction]]></category>
		<category><![CDATA[node classification]]></category>
		<category><![CDATA[non-gradient-based deep learning]]></category>
		<category><![CDATA[Open Graph Benchmark]]></category>
		<category><![CDATA[over-smoothing]]></category>
		<category><![CDATA[protein interaction network analysis]]></category>
		<category><![CDATA[residual compensation]]></category>
		<category><![CDATA[scalable machine learning algorithms]]></category>
		<category><![CDATA[social network analysis]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=245966</guid>

					<description><![CDATA[Researchers at Fuzhou University have developed RCGELM-AE, a graph embedding model that trains in closed form without gradient descent while outperforming conventional graph autoencoders on link prediction and node classification benchmarks.]]></description>
										<content:encoded><![CDATA[<p>A team of researchers at Fuzhou University in China has unveiled a new deep learning architecture that learns meaningful representations of graph-structured data without ever computing a gradient. The model, called the Residual compensation graph Convolutional Generalized Extreme Learning Machine Autoencoder, or RCGELM-AE for short, is described in a study published in the journal Applied Intelligence. Its central promise is deceptively simple: keep the accuracy of modern graph autoencoders while abandoning the iterative, gradient-based training loops that dominate contemporary machine learning. In benchmark tests, the model matched or exceeded the performance of gradient-trained competitors while reducing running time by a striking margin, a result that could reshape how practitioners think about the cost of learning on networks.</p>
<p>Graph embedding, the task the model targets, sits at the heart of many modern data applications. Social networks, citation networks, knowledge graphs, protein interaction networks and recommendation systems all share a common mathematical structure: entities are nodes, relationships are edges, and nodes often carry rich attribute information such as text or numerical features. Graph embedding compresses this high-dimensional, sparse structure into compact low-dimensional vectors that downstream algorithms can consume. The quality of those vectors determines how well a system can predict missing links, classify nodes into categories, or cluster similar entities together. As graphs grow to millions of nodes, the efficiency of the embedding method becomes as important as its accuracy.</p>
<p>The dominant tools for this job are Graph Autoencoders, known as GAEs, which combine graph convolution operations with an encoder-decoder framework. Graph convolutions allow each node to aggregate information from its neighbors, weaving structural and attribute information into a single representation. But these models are trained with gradient descent, an iterative optimization procedure in which parameters are nudged repeatedly in the direction that reduces reconstruction error. The authors of the new study point out two persistent problems with this approach: convergence can be slow, particularly on large graphs, and the optimization landscape is riddled with local optima, meaning the model can settle into a mediocre solution that it cannot escape. Both issues translate into wasted computation and unpredictable quality.</p>
<p>RCGELM-AE takes a fundamentally different route by building on the Extreme Learning Machine Autoencoder, or ELM-AE, a family of models in which the input-to-hidden weights are randomly assigned and fixed, and the output weights are solved in closed form using linear algebra rather than iterative optimization. Because the hidden layer parameters never need to be tuned, training reduces to a single matrix computation, which is fast, stable and immune to the local optima that plague gradient descent. The generalized variant, GELM-AE, extends this idea with a regularization term that improves generalization. What plain GELM-AE lacks, however, is any notion of graph topology. It treats each node as an independent data point, blind to the edges that define the network. The new model closes that gap with two carefully engineered components.</p>
<p>The first component embeds graph convolution operations directly between the input and hidden layers of the autoencoder. In practical terms, before the random projection takes place, each node&#8217;s features are smoothed over its local neighborhood, so the representation that enters the hidden layer already carries information about who a node is connected to. This single, strategically placed convolution compensates for the inherent inability of GELM-AE to capture topological information, allowing the model to integrate structure and attributes in one pass without the deep stacks of propagation layers used in conventional graph neural networks.</p>
<p>The second component is a residual compensation mechanism, an idea inspired by the residual learning revolution in computer vision. Instead of stacking many graph propagation layers to extract deeper features, which is known to cause over-smoothing, a pathology in which node representations become indistinguishable as information is averaged over and over, RCGELM-AE feeds the reconstruction errors of the encoder back into the pipeline. These errors, the parts of the input the first encoding pass failed to capture, are treated as a new signal and encoded again, extracting deeper-level features layer by layer. Each compensation stage therefore adds representational depth without adding repeated graph smoothing, sidestepping the over-smoothing risk that limits the depth of conventional deep graph models while boosting the model&#8217;s expressive power.</p>
<p>The empirical results reported in the study are substantial. On link prediction tasks, where the goal is to infer missing or future connections between nodes, the model improved the area under the receiver operating characteristic curve, AUC, by 4.11 to 8.93 percent and average precision, AP, by 4.01 to 10.01 percent relative to the baselines. On node classification tasks, where each node must be assigned to a category, the F1-micro and F1-macro scores rose by 0.42 to 4.97 percent and 0.48 to 5.27 percent respectively. Crucially, these gains came with a notable reduction in running time, because the closed-form learning scheme replaces hundreds or thousands of gradient updates with a single solve.</p>
<p>The scalability evidence is perhaps the most compelling part of the study. The authors evaluated RCGELM-AE on two large benchmark graphs from the Open Graph Benchmark, ogbn-arxiv and ogbl-ppa, which contain substantially more nodes and edges than the datasets used in the main experiments. Running on a 24 GB NVIDIA GeForce RTX 3090 GPU, the model achieved the best AUC and AP scores on both datasets against representative gradient-trained baselines including GAE, VGAE, LGAE and DGNN. The total training times were remarkable: just 2.12 seconds on ogbn-arxiv and 9.53 seconds on ogbl-ppa. The baselines, by contrast, require repeated epoch-wise optimization, with each epoch costing a full pass of forward and backward computation. For iterative models the reported figure is only the average time per epoch, meaning their total cost is orders of magnitude higher.</p>
<p>The implications extend beyond raw speed. Gradient-free training eliminates a whole class of engineering headaches: learning-rate schedules, initialization sensitivity, early-stopping heuristics and the variance introduced by stochastic mini-batching all become irrelevant when the solution is computed analytically. That stability is attractive for applications where reliability matters, such as fraud detection on financial networks, drug discovery on molecular graphs, or knowledge graph completion in large-scale information systems. It also lowers the barrier for researchers and organizations without access to extensive GPU clusters, since a model that trains in seconds on a single consumer graphics card democratizes access to state-of-the-art graph learning.</p>
<p>The work, led by Xinyi Lin, Xiaoyun Chen, Shulan Zheng and Wenjian Chen of the College of Mathematics and Statistics at Fuzhou University, and supported by the Natural Science Foundation of Fujian Province, does not claim that gradient descent is obsolete. Random projection methods have their own trade-offs, and the fixed random layer must be wide enough to capture the relevant feature space. But the study makes a persuasive case that the deep learning community&#8217;s default assumption, that competitive graph representations require iterative optimization, deserves scrutiny. As graphs in science, commerce and social media continue to swell toward planetary scale, a framework that delivers better accuracy in a fraction of the time may prove less a curiosity and more a glimpse of where efficient machine learning is headed.</p>
<p><strong>Subject of Research:</strong> A gradient-descent-free graph embedding autoencoder combining graph convolution and residual compensation for efficient link prediction and node classification</p>
<p><strong>Article Title:</strong> RCGELM-AE: an efficient graph embedding deep model without gradient descent</p>
<p><strong>Article References:</strong> Lin, X., Chen, X., Zheng, S., &amp; Chen, W. (2026). RCGELM-AE: an efficient graph embedding deep model without gradient descent. <em>Applied Intelligence, 56</em>(14), Article 404. <a href="https://doi.org/10.1007/s10489-026-07437-1" rel="noopener noreferrer">https://doi.org/10.1007/s10489-026-07437-1</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10489-026-07437-1" rel="noopener noreferrer">10.1007/s10489-026-07437-1</a></p>
<p><strong>Keywords:</strong> graph embedding, extreme learning machine, autoencoder, gradient descent, graph convolutional networks, link prediction, node classification, residual compensation, over-smoothing, Open Graph Benchmark, deep learning, Applied Intelligence</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">245966</post-id>	</item>
		<item>
		<title>Hypergraph AI Reads Images and Text to Identify Tibetan Medicinal Plants With 98% Accuracy</title>
		<link>https://scienmag.com/hypergraph-ai-reads-images-and-text-to-identify-tibetan-medicinal-plants-with-98-accuracy/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Tue, 22 Sep 2026 21:46:13 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[AI accuracy in traditional medicine]]></category>
		<category><![CDATA[BERT]]></category>
		<category><![CDATA[combining visual and textual data for herbal identification]]></category>
		<category><![CDATA[Complex & Intelligent Systems]]></category>
		<category><![CDATA[deep learning for Tibetan pharmacopoeia]]></category>
		<category><![CDATA[DenseNet121]]></category>
		<category><![CDATA[fine-grained recognition]]></category>
		<category><![CDATA[herbal medicine image recognition challenges]]></category>
		<category><![CDATA[hypergraph neural network]]></category>
		<category><![CDATA[hypergraph neural networks for herbal classification]]></category>
		<category><![CDATA[image-text classification]]></category>
		<category><![CDATA[machine learning in traditional medicine]]></category>
		<category><![CDATA[medicinal plant classification]]></category>
		<category><![CDATA[MHCNet Tibetan herb recognition]]></category>
		<category><![CDATA[modal fusion]]></category>
		<category><![CDATA[multi-modal image and text analysis]]></category>
		<category><![CDATA[multimodal learning]]></category>
		<category><![CDATA[over-smoothing]]></category>
		<category><![CDATA[plant species recognition in Tibetan medicine]]></category>
		<category><![CDATA[Qinghai Minzu University]]></category>
		<category><![CDATA[small target object detection in herbal images]]></category>
		<category><![CDATA[Tibetan herbal medicine classification systems]]></category>
		<category><![CDATA[Tibetan medicinal plants identification]]></category>
		<category><![CDATA[Tibetan medicine]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=208023</guid>

					<description><![CDATA[Researchers in Qinghai have developed MHCNet, a hypergraph-based multimodal AI that classifies Tibetan medicinal plants with 98.11 percent accuracy by fusing image and text features.]]></description>
										<content:encoded><![CDATA[<p>Deep in the pharmacopoeia of Tibetan medicine lies a vast library of plants whose correct identification can mean the difference between a healing remedy and a useless or even harmful preparation. For centuries, that identification has depended on the trained eyes of practitioners, but a research team in Qinghai, China, now reports a machine learning system that can classify Tibetan medicinal materials with 98.11 percent accuracy by learning to read both photographs of the plants and the written descriptions that accompany them. The study, published in Complex &amp; Intelligent Systems, introduces a model called MHCNet, a multi-channel modal fusion hypergraph convolutional neural network designed specifically for the stubborn challenges of Tibetan herb recognition.</p>
<p>The problem the researchers set out to solve is deceptively simple to state and remarkably hard to solve. Many Tibetan medicinal materials appear in images as small targets that are easily occluded by soil, packaging, or neighboring objects. Field photographs are frequently degraded by strong light noise, which washes out the fine textural cues that distinguish one species from another. And unlike mainstream image recognition tasks, where millions of labeled examples exist, Tibetan medicine offers a comparatively small and specialized corpus, forcing algorithms to squeeze maximum information from every available sample.</p>
<p>MHCNet attacks these problems in stages. The visual pipeline begins with a modified version of DenseNet121, a convolutional architecture whose densely connected layers allow features to flow forward through the network without being diluted. The team reworked this backbone to better withstand small-target occlusion and strong light noise, producing visual features that remain robust even when the plant material occupies only a fraction of the frame. In parallel, a pre-trained Chinese BERT model digests the textual descriptions of each medicinal material, extracting contextual semantic features that capture how practitioners and pharmacists actually describe these plants in writing.</p>
<p>What happens next is where the architecture departs from conventional multimodal systems. Rather than simply concatenating image and text vectors, the model fuses the two modalities at the feature level and then computes Manhattan distance similarities across three representations for every sample: the image features, the text features, and the fused features. These similarity scores become the raw material for constructing three separate hypergraphs, one per modality. Unlike ordinary graphs, where an edge connects exactly two nodes, a hypergraph allows a single hyperedge to link many samples at once, which makes it a natural mathematical language for expressing the group-level structure of a dataset, where several specimens may share subtle family resemblances that pairwise connections cannot capture.</p>
<p>The researchers then designed a multi-channel hypergraph neural network to perform collaborative learning across these three hypergraphs simultaneously. This design choice directly addresses a well-known failure mode in multimodal learning called over-smoothing. When image and text features are fused too early and propagated through too many layers, their distinctive information tends to blur together until every node looks like every other node, and classification accuracy collapses. By keeping each modality on its own channel and letting the channels exchange information in a controlled way, MHCNet preserves the complementary strengths of vision and language instead of averaging them into mush.</p>
<p>A final innovation targets the fine-grained detail problem. Standard hypergraph construction, once fixed, is static: the neighborhoods defined at the start of training remain locked in place even as the network learns better representations. MHCNet inserts a feed-forward network after the first hypergraph convolution layer, which iteratively optimizes and dynamically adjusts the reconstruction of the hypergraph structure itself. In effect, the model keeps rewriting its own map of which samples belong together, refining the fine-grained relationships that a one-time construction would miss. This feedback loop between representation learning and graph structure is the mechanism the authors credit with resolving the inadequacy of fine-grained features during hypergraph construction.</p>
<p>The team evaluated the system on a self-built dataset of paired Tibetan medicine images and texts, a resource assembled to reflect the real conditions under which these materials are photographed and documented. On this benchmark, MHCNet achieved a recognition accuracy of 98.11 percent, a figure the authors present as evidence that the model effectively captures high-order cross-modal correlations, the intricate web of relationships that spans what a plant looks like and how it is described. For a domain where a misidentified root or flower can invalidate a traditional formulation, that margin of reliability matters.</p>
<p>The implications extend well beyond one dataset. Tibetan medicine is a pillar of traditional healthcare across the Qinghai-Tibet Plateau and surrounding regions, and its digital and intelligent development, the authors argue, hinges on accurate automated identification of medicinal plants. A dependable image-text classifier could support pharmacy quality control, help digitize herbarium collections, assist practitioners in remote clinics, and provide a verification layer for commercial supply chains where adulteration and mislabeling are persistent concerns. Because the model learns from text as well as images, it can leverage the descriptive knowledge embedded in centuries of written tradition, effectively allowing the literature itself to participate in the classification process.</p>
<p>Methodologically, the study adds to a growing body of work showing that hypergraph structures, long a niche tool in machine learning, are exceptionally well suited to fine-grained recognition problems where samples form complex higher-order clusters. The multi-channel strategy also offers a template for other multimodal tasks, from botanical surveys to medical imaging paired with clinical notes, wherever practitioners worry that naive fusion will smooth away the very distinctions that matter. The authors suggest the approach provides a reliable, generalizable solution for the intelligent identification of Tibetan medicines, and the architecture&#8217;s modularity, with separate vision, language, and fusion channels feeding a shared hypergraph learner, invites adaptation to other domains rich in paired visual and textual data.</p>
<p>The work was carried out by JianFu Chen, Jingru Ma, Zhaohui Zhang, and Yan Sun at the Key Laboratory of Artificial Intelligence Application Technology of the State Ethnic Affairs Commission, based at the School of Intelligent Science and Engineering of Qinghai Minzu University in Xining, together with Jiuchang Pei of Qinghai Provincial Tibetan Hospital, a collaboration that pairs computer science expertise with clinical knowledge of Tibetan pharmacology. Funding came from the Special Project of the Key Research and Development and Transformation Program of Qinghai Province, the Qinghai Provincial Natural Science Foundation, and the National Natural Science Foundation of China. Published as a peer-reviewed open access article, the study arrives at a moment when traditional medicine systems worldwide are racing to digitize their knowledge, and it demonstrates that the tools of modern artificial intelligence, thoughtfully adapted, can honor the fine distinctions on which those traditions depend.</p>
<p><strong>Subject of Research:</strong> A multimodal hypergraph neural network for classifying Tibetan medicinal materials from paired image and text data.</p>
<p><strong>Article Title:</strong> A multi-channel modal fusion hypergraph convolutional neural network for Tibetan medicinal material classification</p>
<p><strong>Article References:</strong> Chen, J., Ma, J., Zhang, Z., Sun, Y., &amp; Pei, J. (2026). A multi-channel modal fusion hypergraph convolutional neural network for Tibetan medicinal material classification. <em>Complex &amp;amp; Intelligent Systems</em>. <a href="https://doi.org/10.1007/s40747-026-02388-z" rel="noopener noreferrer">https://doi.org/10.1007/s40747-026-02388-z</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s40747-026-02388-z" rel="noopener noreferrer">10.1007/s40747-026-02388-z</a></p>
<p><strong>Keywords:</strong> Tibetan medicine, hypergraph neural network, multimodal learning, modal fusion, medicinal plant classification, DenseNet121, BERT, fine-grained recognition, over-smoothing, image-text classification, Qinghai Minzu University, Complex &amp; Intelligent Systems</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">208023</post-id>	</item>
	</channel>
</rss>
