<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>lightweight deep learning models &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/lightweight-deep-learning-models/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Fri, 11 Sep 2026 13:41:40 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.1</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>lightweight deep learning models &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>MSENet: Lightweight Deep Learning for Inertial Localization and Wireless Sensing</title>
		<link>https://scienmag.com/msenet-lightweight-deep-learning-for-inertial-localization-and-wireless-sensing/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Fri, 11 Sep 2026 13:41:36 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[accuracy versus computational cost in deep learning]]></category>
		<category><![CDATA[deep neural network architecture for low-power applications]]></category>
		<category><![CDATA[deep neural network optimization for embedded devices]]></category>
		<category><![CDATA[drift correction in inertial navigation]]></category>
		<category><![CDATA[drone and robot indoor positioning]]></category>
		<category><![CDATA[edge-computing for robotic localization]]></category>
		<category><![CDATA[IMU data processing]]></category>
		<category><![CDATA[indoor navigation with neural networks]]></category>
		<category><![CDATA[Inertial localization deep learning]]></category>
		<category><![CDATA[Inertial sensor-based localization]]></category>
		<category><![CDATA[lightweight deep learning models]]></category>
		<category><![CDATA[lightweight neural networks for IMU-based navigation]]></category>
		<category><![CDATA[multi-stage deep learning for motion tracking]]></category>
		<category><![CDATA[multi-stage neural network architectures]]></category>
		<category><![CDATA[neural network optimization for embedded systems]]></category>
		<category><![CDATA[noise reduction in inertial measurement units]]></category>
		<category><![CDATA[power-efficient deep learning models for edge devices]]></category>
		<category><![CDATA[power-efficient inertial measurement unit analysis]]></category>
		<category><![CDATA[real-time inertial navigation systems]]></category>
		<category><![CDATA[real-time inertial-based tracking]]></category>
		<category><![CDATA[sensor fusion for accurate indoor localization]]></category>
		<category><![CDATA[sensor fusion for indoor positioning]]></category>
		<category><![CDATA[trajectory estimation with neural networks]]></category>
		<category><![CDATA[wireless sensing for autonomous systems]]></category>
		<category><![CDATA[wireless sensing in indoor environments]]></category>
		<guid isPermaLink="false">https://scienmag.com/msenet-lightweight-deep-learning-for-inertial-localization-and-wireless-sensing/</guid>

					<description><![CDATA[Every time a delivery robot loses its way in a warehouse corridor, or a fitness tracker reports a distance that is obviously wrong, the culprit is usually the same small set of sensors: the inertial measurement unit, or IMU. These tiny packages of accelerometers and gyroscopes sit at the heart of modern navigation, tracking motion [&#8230;]]]></description>
										<content:encoded><![CDATA[<p>Every time a delivery robot loses its way in a warehouse corridor, or a fitness tracker reports a distance that is obviously wrong, the culprit is usually the same small set of sensors: the inertial measurement unit, or IMU. These tiny packages of accelerometers and gyroscopes sit at the heart of modern navigation, tracking motion by measuring acceleration and rotation hundreds of times per second. They are cheap, they consume almost no power, and they work where satellite signals cannot reach — indoors, underground, in tunnels, in the depths of a factory floor. Yet they have always carried a fundamental weakness. Estimating position from IMU data requires integrating noisy measurements over time, and the noise compounds with every calculation, causing the estimated trajectory to drift ever further from reality. Researchers have long turned to deep neural networks to tame this drift, but the networks that perform best are precisely the ones too large and power-hungry to run on the edge devices where inertial navigation matters most. Now, a team of Chinese researchers reports a new architecture that appears to break this trade-off, achieving accuracy comparable to state-of-the-art models while cutting computational cost dramatically.</p>
<p>The new framework, called MSENet, short for Multi-Stage Extraction Network, was described in a study published in the journal Mobile Networks and Applications. The team, led by Gan Yuxi of Tsinghua University and including collaborators from Guangxi University of Science and Technology, Shenzhen Jinzhi Technology, Xinjingjie Digital Health, the Shenzhen Institute of Information Technology, and WeiKang Intelligence Technology, set out to solve a problem that has become acute with the explosion of the Internet of Things, mobile robotics, and wireless sensor networks: how to deliver high-accuracy inertial positioning with low latency and low power consumption on hardware that fits in a shoe, a drone, or a palm-sized robot.</p>
<p>The core insight behind MSENet lies in how it extracts information from raw IMU signals. Instead of relying on a single, monolithic feature-extraction pipeline, the network employs a multi-stage strategy in which motion representations are built up progressively across several processing stages. Each stage refines the temporal understanding of the motion captured by the accelerometer and gyroscope, allowing the model to capture both fine-grained, short-term fluctuations and longer-term patterns of human or robotic movement. According to the authors, this design enhances the temporal motion representation while simultaneously reducing computational overhead, because the early stages can use lightweight operations to filter and condense the signal before more expressive layers operate on a more compact representation. The approach echoes lessons learned in efficient computer-vision architectures such as MobileNetV2, MnasNet and EfficientNet, which the authors cite as inspiration, but adapts them to the peculiarities of inertial data — continuous, high-frequency waveforms rather than discrete images.</p>
<p>The benchmarks the team chose are the de facto standards of the field. RIDI, or Robust IMU Double Integration, introduced by researchers at the European Conference on Computer Vision in 2018, tests how well a model can reconstruct a trajectory from raw inertial readings alone. RONIN, short for Robust Neural Inertial Navigation in the Wild, presented at the IEEE International Conference on Robotics and Automation in 2020, pushes the challenge further with real-world pedestrian data collected in diverse environments. On both benchmarks, MSENet achieves accuracy comparable to IMUNet, an efficient regression architecture published in IEEE Transactions on Instrumentation and Measurement in 2024 that represents the current state of the art. But the comparison tells only half the story. MSENet achieves this parity while reducing the number of model parameters by 69.95 percent and the number of floating-point operations, or FLOPs, by 44.75 percent — a reduction so large that it changes what kind of hardware the model can realistically run on.</p>
<p>Perhaps the more impressive result comes from the RONIN-UNSEEN dataset, a split of the benchmark containing environments and motion patterns the network never encountered during training. Generalization — the ability to perform well on data unlike the training set — has been a persistent weakness of learned inertial navigation systems, which often overfit to the specific gait patterns, sensor orientations and building layouts they were trained on. On this challenging unseen set, MSENet reduces the Absolute Trajectory Error by 11.5 percent and the Relative Trajectory Error by 4.3 percent compared with state-of-the-art methods. In practical terms, absolute trajectory error measures how far the estimated final position deviates from the true position over an entire walk or route, while relative trajectory error captures local accuracy over shorter segments. A model that is both smaller and more generalizable is a rare combination in deep learning, where efficiency gains typically come at the cost of robustness.</p>
<p>The significance of these numbers becomes clear when one considers where inertial navigation must actually live. The accelerometers and gyroscopes in a smartphone, a smartwatch, a wearable medical monitor or an autonomous warehouse robot are governed by strict power and thermal budgets. A deep network with millions of parameters may achieve impressive accuracy on a laboratory GPU, but it cannot run in real time on a microcontroller drawing milliwatts. Earlier efforts to address this include TinyOdom, a hardware-aware neural inertial navigation system published in the Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies in 2022, which demonstrated that aggressive efficiency constraints could be built into neural navigation from the ground up. MSENet extends this line of thinking with a multi-stage extraction design that squeezes more representational power out of every parameter.</p>
<p>The problem the researchers are attacking is as old as inertial navigation itself. Traditional systems rely on Kalman filtering and other probabilistic estimation techniques, often fusing IMU data with auxiliary sensors such as shoe-mounted detectors, radio signals or camera feeds to correct the inevitable drift. Landmark work in the mid-2000s, including Foxlin&#8217;s pedestrian tracking system with shoe-mounted inertial sensors, showed how zero-velocity updates — brief moments when the foot is planted and the sensor is momentarily still — could reset accumulated error. But these methods require careful engineering, specialized hardware placement or external references, and they degrade when those aids are unavailable. Learned approaches such as IONet, presented at the AAAI Conference on Artificial Intelligence in 2018, and later RONIN and IMUNet, took a different route: train a neural network end to end to map raw IMU waveforms directly to position or velocity, letting the model learn to recognize and compensate for sensor noise, bias and drift on its own. The price of that flexibility has been computational weight, and MSENet is an attempt to pay less of it.</p>
<p>The applications extend well beyond counting steps. In dense urban canyons where satellite signals bounce off buildings, in underground transit systems, in disaster-response scenarios where GPS is jammed or absent, and in the coordinated fleets of autonomous mobile robots now populating factories and hospitals, reliable inertial positioning is the silent backbone of every navigation stack. The authors frame their work explicitly in the context of wireless sensing and the Internet of Things, noting that inertial localization is increasingly a component of wireless sensor networks where edge devices must compute locally to reduce latency, preserve bandwidth and protect privacy. A navigation model small enough to run on the sensor node itself, rather than shipping raw data to a server, aligns with a broader industry trend toward edge intelligence — the migration of machine-learning inference from the cloud to the point of data collection.</p>
<p>The research was supported in part by the National Key Research and Development Program of China, under Grant No. 2025YFE0103200, reflecting the strategic weight that national funding programs now place on autonomous navigation and sensing technologies. The author team spans academia and industry in a pattern that has become characteristic of Chinese applied AI research: Gan Yuxi and Xia Yin from Tsinghua University&#8217;s Department of Computer Science and Technology, Jiongxun Lin from Guangxi University of Science and Technology, Zhihu Jin and Xiao Chen from Shenzhen Jinzhi Technology, Daoquan Huang from Xinjingjie Digital Health, and Bao Peng from the Shenzhen Institute of Information Technology. According to the published contribution statement, Gan Yuxi conceived the study, designed the MSENet framework, implemented the algorithms and led the experiments, with the co-authors dividing responsibilities across data processing, validation, performance evaluation and supervision. Correspondence for the study is handled by Jiongxun Lin.</p>
<p>The paper was received on 5 June 2026, accepted on 2 September 2026, and published in the journal&#8217;s 11 September 2026 issue under the exclusive license of Springer Science and Business Media. The article&#8217;s data availability statement notes that no new datasets were generated or analysed beyond the public benchmarks used in evaluation, meaning the headline results — the 69.95 percent parameter reduction, the 44.75 percent FLOP reduction, the 11.5 percent improvement in absolute trajectory error — can be independently checked against the widely available RIDI and RONIN data by any laboratory with the model weights and standard evaluation protocols. That reproducibility is a quiet but important feature in a field where benchmark claims have sometimes been difficult to replicate.</p>
<p>What remains to be seen is how far the multi-stage extraction philosophy can scale. The benchmarks cover pedestrian motion, and the authors position the framework for smart robots, wearable technology, motion detection and edge computing more broadly — but robot dynamics, with rapid turns, vibrations and payloads, present distributions of inertial signal quite unlike human gait. The generalization results on RONIN-UNSEEN are encouraging on this front, suggesting the learned temporal representations are not merely memorizing walking patterns. If the same efficiency-accuracy balance holds on robotic platforms and across heterogeneous sensor hardware, MSENet could join a growing toolbox of lightweight neural navigators that make precise, self-contained positioning a default capability of the billions of low-power devices now coming online. For a technology whose central paradox — sensors that get better the smaller and smarter they become — has defined its limits for decades, a 70 percent cut in model size with accuracy to spare is the kind of result that reshapes what engineers dare to attempt on a circuit board the size of a fingernail.</p>
<div class="scienmag-article-metadata"><strong>Subject of Research:</strong> A lightweight deep learning framework, MSENet, for inertial localization from raw IMU data on resource-constrained edge devices.</p>
<p><strong>Article Title:</strong> MSENet: An Efficient and Lightweight Deep Learning Framework for Inertial Localization and Wireless Sensing Applications</p>
<p><strong>Article References:</strong> Yuxi, G., Lin, J., Jin, Z., Chen, X., Huang, D., Peng, B., &amp; Yin, X. (2026). MSENet: An Efficient and Lightweight Deep Learning Framework for Inertial Localization and Wireless Sensing Applications. <em>Mobile Networks and Applications</em>. <a href="https://doi.org/10.1007/s11036-026-02549-x" target="_blank" rel="noopener noreferrer">https://doi.org/10.1007/s11036-026-02549-x</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s11036-026-02549-x" target="_blank" rel="noopener noreferrer">10.1007/s11036-026-02549-x</a></p>
<p><strong>Keywords:</strong> Inertial navigation, Deep learning, Wireless sensor networks, Lightweight neural network, Edge computing, Smart robots, IMU positioning, Trajectory estimation</p>
</div>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">192699</post-id>	</item>
		<item>
		<title>Lightweight Residual Mamba Model for Power Equipment Defect Detection</title>
		<link>https://scienmag.com/lightweight-residual-mamba-model-for-power-equipment-defect-detection/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Thu, 09 Apr 2026 13:40:34 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[AI-based defect recognition]]></category>
		<category><![CDATA[automated power grid inspection]]></category>
		<category><![CDATA[defect recognition algorithms]]></category>
		<category><![CDATA[electrical equipment fault diagnosis]]></category>
		<category><![CDATA[image-based defect classification]]></category>
		<category><![CDATA[infrastructure reliability enhancement]]></category>
		<category><![CDATA[lightweight deep learning models]]></category>
		<category><![CDATA[lightweight residual Mamba model]]></category>
		<category><![CDATA[machine learning in power transmission]]></category>
		<category><![CDATA[power equipment defect detection]]></category>
		<category><![CDATA[power grid monitoring technology]]></category>
		<category><![CDATA[power transmission system maintenance]]></category>
		<guid isPermaLink="false">https://scienmag.com/lightweight-residual-mamba-model-for-power-equipment-defect-detection/</guid>

					<description><![CDATA[In the relentless pursuit of enhancing the reliability and efficiency of power transmission systems, a groundbreaking study has emerged from a team of researchers led by Jindong, C., Weijie, S., and Shan, G. Their innovative work, published in Scientific Reports in 2026, unveils a novel approach to defect recognition and classification in power transmission equipment [&#8230;]]]></description>
										<content:encoded><![CDATA[<p>In the relentless pursuit of enhancing the reliability and efficiency of power transmission systems, a groundbreaking study has emerged from a team of researchers led by Jindong, C., Weijie, S., and Shan, G. Their innovative work, published in Scientific Reports in 2026, unveils a novel approach to defect recognition and classification in power transmission equipment using a lightweight model residual framework known as Mamba. This advancement marks a significant leap forward in the automated inspection and maintenance of critical infrastructure, harnessing the power of artificial intelligence and machine learning to address long-standing challenges in power grid monitoring.</p>
<p>Power transmission equipment is fundamental to the seamless delivery of electricity across vast distances, serving as the backbone of modern energy systems. However, the integrity of this equipment is frequently compromised by various defects arising from environmental stressors, aging, mechanical wear, and unforeseen operational anomalies. Traditional inspection methods, often reliant on manual visual examination or bulky, hardware-intensive imaging systems, struggle to provide timely and accurate defect assessments, hindering maintenance protocols and increasing the risk of power outages.</p>
<p>The study introduces the concept of a lightweight residual model, specifically tailored for image defect recognition in power transmission apparatuses. This model, coined as the residual Mamba, signifies a departure from conventional deep learning models that are frequently computationally intensive and impractical for real-time deployment in the field. By optimizing the residual network architecture, Mamba adeptly balances model complexity and performance, enabling rapid inference while maintaining high recognition accuracy.</p>
<p>Delving into the technical fabric of the residual Mamba, the model leverages residual learning principles, which facilitate the training of deep neural networks by mitigating the vanishing gradient problem. This is accomplished through skip connections that allow the model to learn identity mappings, effectively enabling deeper architectures without performance degradation. The lightweight nature of Mamba arises from a reduction in parameters and computational overhead through architectural pruning and efficient convolutional operations, making it an ideal candidate for deployment on embedded systems or mobile inspection devices in substations and transmission corridors.</p>
<p>A core aspect of the study is the comprehensive dataset curated for training and validating the residual Mamba model. The researchers amassed a vast repository of high-resolution images depicting a spectrum of defect types commonly encountered in power transmission equipment — from corrosion, cracks, and surface pitting to insulator damage and conductor abnormalities. This dataset ensured sufficient representation of diverse defect morphologies under varied environmental conditions, bolstering the model’s robustness and generalizability.</p>
<p>Extensive experimentation demonstrated that residual Mamba consistently outperformed existing lightweight and heavyweight models in both defect detection accuracy and classification precision. The model exhibited a remarkable capability to discern subtle defect signatures that often elude traditional machine vision algorithms, attributable to its sophisticated residual learning scheme and fine-tuned feature extraction layers. Furthermore, the inference speed achieved by Mamba facilitates near real-time processing, a critical attribute for on-site inspections where timely decision-making is paramount.</p>
<p>The implications of this research extend beyond mere defect detection efficiency. Automated, AI-driven inspection systems empowered by models like residual Mamba significantly reduce human error and labor costs associated with routine maintenance. They also enhance the predictive maintenance paradigm by enabling proactive identification of deterioration patterns, thus preventing catastrophic failures and optimizing equipment lifecycle management. This directly translates into heightened grid reliability and operational safety, especially in vulnerable or remote areas where access constraints pose significant challenges.</p>
<p>From a computational perspective, the residual Mamba model exemplifies the trend towards scalable AI solutions capable of running on resource-constrained platforms without compromising performance. This is particularly pertinent for power utilities aiming to retrofit existing infrastructure with smart monitoring capabilities without incurring prohibitive expenses associated with hardware upgrades. The model’s modular design also allows for seamless integration with edge computing ecosystems, fostering decentralized analytics and reducing dependency on cloud-based services.</p>
<p>Addressing potential concerns related to deployment, the authors meticulously evaluated the model’s resilience to noise and environmental variability. They verified that residual Mamba maintains consistent performance even under conditions of image distortion caused by weather phenomena, variable lighting, or partial occlusions. Such robustness is vital for real-world applicability, where inspection conditions are rarely ideal and can adversely impact traditional image recognition techniques.</p>
<p>Moreover, the research team explored the interpretability of the residual Mamba model, employing visualization techniques to elucidate the salient features triggering defect classification. This transparency enhances trust in AI-driven systems among field engineers and decision-makers, facilitating adoption by providing insights into the model’s decision-making process. It also aids in refining the model by pinpointing areas where misclassification or uncertainty arise, guiding iterative improvements.</p>
<p>Looking ahead, the study proposes several avenues for future research and practical deployment. These include expanding the model’s capabilities to detect and analyze emergent defect types as power systems evolve and integrating multimodal sensor data such as infrared thermography and acoustic signals. The combination of diverse data modalities promises a more holistic understanding of equipment health, further propelling the field of intelligent infrastructure monitoring.</p>
<p>The introduction of the residual Mamba lightweight model marks a pivotal step in the convergence of AI and power system maintenance. By marrying sophisticated deep learning architectures with pragmatic resource considerations, this study offers a scalable pathway for utilities worldwide to enhance their asset monitoring frameworks. Such technological advancements portend a future where power grids are not only smarter and more resilient but also more responsive to the ever-increasing demands of modern energy consumption.</p>
<p>The broader societal impact of this research cannot be overstated. Enhanced defect recognition capabilities contribute to minimizing electrical service disruptions, which in turn underpins economic stability, public safety, and environmental sustainability. Reliable power transmission ensures that essential services—from healthcare and communication to transportation and manufacturing—operate uninterrupted, thereby elevating quality of life and fostering technological progress.</p>
<p>In conclusion, the study authored by Jindong and colleagues encapsulates the synergistic potential of machine learning, computer vision, and power engineering. It provides a compelling testament to how lightweight, efficient AI models like residual Mamba can revolutionize traditional industrial processes. As the global energy landscape continues to transform, such innovations will be indispensable in ensuring the robustness and adaptability of critical infrastructure, solidifying the foundation for a smarter and more resilient energy future.</p>
<hr />
<p><strong>Subject of Research</strong>: Defect recognition and classification in power transmission equipment using lightweight residual neural network models.</p>
<p><strong>Article Title</strong>: Study on image defect recognition and classification of power transmission equipment based on lightweight model residual Mamba.</p>
<p><strong>Article References</strong>:</p>
<p class="c-bibliographic-information__citation">Jindong, C., Weijie, S., Shan, G. <i>et al.</i> Study on image defect recognition and classification of power transmission equipment based on lightweight model residual Mamba. <i>Sci Rep</i> (2026). https://doi.org/10.1038/s41598-026-45856-9</p>
<p><strong>Image Credits</strong>: AI Generated</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">150101</post-id>	</item>
	</channel>
</rss>
