<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>INT8 quantization &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/int8-quantization/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Wed, 21 Oct 2026 13:03:06 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>INT8 quantization &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>AMG-based real-time prosthetic hand control: Cross-subject evaluation and embedded implementation</title>
		<link>https://scienmag.com/amg-based-real-time-prosthetic-hand-control-cross-subject-evaluation-and-embedded-implementation/</link>
		
		<dc:creator><![CDATA[Denise Maddox]]></dc:creator>
		<pubDate>Wed, 21 Oct 2026 13:03:06 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[5-DOF prosthetic hand]]></category>
		<category><![CDATA[acoustomyography]]></category>
		<category><![CDATA[acoustomyography versus electromyography]]></category>
		<category><![CDATA[AMG-based]]></category>
		<category><![CDATA[AMG-based prosthetic hand control]]></category>
		<category><![CDATA[cross-subject evaluation]]></category>
		<category><![CDATA[embedded embedded system for real-time prosthesis]]></category>
		<category><![CDATA[embedded inference]]></category>
		<category><![CDATA[embedded microcontroller implementation]]></category>
		<category><![CDATA[gesture classification accuracy in able-bodied users]]></category>
		<category><![CDATA[gesture recognition]]></category>
		<category><![CDATA[INT8 quantization]]></category>
		<category><![CDATA[laboratory proof of concept for prosthetic control]]></category>
		<category><![CDATA[low-latency prosthetic control system]]></category>
		<category><![CDATA[multi-channel muscle activity sensing]]></category>
		<category><![CDATA[neural networks]]></category>
		<category><![CDATA[proof of concept]]></category>
		<category><![CDATA[prosthetic hand]]></category>
		<category><![CDATA[real-time]]></category>
		<category><![CDATA[real-time gesture recognition]]></category>
		<category><![CDATA[six-channel acoustic sensor bracelet]]></category>
		<category><![CDATA[STM32 microcontroller]]></category>
		<category><![CDATA[surface muscle sensing]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=329239</guid>

					<description><![CDATA[A six-channel acoustomyography bracelet recognized five hand gestures with 95.3% mean accuracy in an online test on a microcontroller-controlled 5-DOF prosthetic-hand prototype, but the able-bodied volunteer study did not establish clinical benefit.]]></description>
										<content:encoded><![CDATA[<p>A six-channel acoustomyography bracelet translated muscle activity into commands for a 5-DOF prosthetic-hand prototype, with an embedded classifier recognizing five hand gestures in real time among able-bodied volunteers who had not supplied data for model development. In the online experiment, the system achieved a mean accuracy of 95.3% across five additional participants, while the complete processing chain ran on an STM32F769I microcontroller in 118.3 milliseconds after each 400-millisecond signal window became available. The results establish a laboratory proof of concept rather than a clinical validation: all participants were able-bodied, the gestures were sustained and cued, and functional outcomes such as unintended activation, grasp success and task-completion time were not measured.</p>
<p>Acoustomyography, or AMG, differs from the surface electromyography commonly used to control powered prostheses. Rather than measuring electrical potentials at the skin, the forearm-worn system uses microphones to record mechanical and low-frequency acoustic emissions associated with muscle contraction. Its six sensors are distributed circumferentially around the forearm, but they were not intended to isolate particular flexor, extensor or rotator muscle groups. Because acoustic vibrations can propagate mechanically through surrounding tissues, individual channels were not interpreted as measurements of single muscles. The investigators said this transduction principle motivates investigation of AMG as an alternative or complementary motor signal, but the study did not establish an advantage over sEMG because no matched sEMG measurements were collected from the same participants under the same gestures, repetitions and evaluation splits.</p>
<p>The offline dataset comprised 500 recordings from 10 healthy, right-handed adults, five men and five women, with an age of 28 ± 5 years. Each participant performed 10 repetitions of hand close, hand open, fine pinch, tripod grip and index-finger point. Every trial was a pre-cued, sustained gesture lasting approximately three to four seconds at a comfortable moderate contraction level, with three to five seconds of rest between trials. No measurement normalized contraction intensity to a maximum voluntary contraction. The bracelet remained in the same predefined forearm region, with limited proximal–distal adjustment permitted for individual morphology, although bracelet tension, contact pressure and repositioning repeatability were not quantified as independent variables. Signals from the six electret microphones were digitized at 1,000 Hz with a 24-bit laboratory acquisition system. The stored amplitudes were treated as relative acoustic values because no channel-level calibration was performed.</p>
<p>Before classification, each retained gesture interval was divided into 400-millisecond windows with 200-millisecond hops, producing 50% overlap. A fourth-order Butterworth filter digitally band-limited the signals to 1–100 hertz, although the microphones’ documented lower response began at 15 hertz, so this range described the preprocessing rather than the physical analog bandwidth. Each window was converted into a 138-dimensional feature vector. For every channel, the researchers calculated four time-domain statistics—mean, standard deviation, skewness and kurtosis—13 mel-frequency cepstral coefficients, or MFCCs, and six discrete-wavelet-transform statistics. A three-level Daubechies-4 decomposition supplied the wavelet descriptors. Feature-wise z-score normalization used statistics estimated from the relevant training split. Window duration, MFCC dimensionality and model configuration were selected on the same 10-participant development dataset later used for held-out evaluation, a design that the authors said could leave an unquantified optimistic model-selection bias in the leave-one-subject-out results.</p>
<p>The deployed classifier was a one-dimensional convolutional neural network operating on the engineered 138-feature sequence rather than on raw acoustic samples. In subject-mixed testing, in which the same participants could appear in training and test partitions, its accuracy was 95.0%, with 1,174 of 1,236 test windows classified correctly and a 95% Wilson confidence interval of approximately 93.6–96.1%. The more demanding leave-one-subject-out test, in which each participant was entirely excluded from training in turn, produced a mean accuracy of 90.6%, a median of 93.0% and a range of 70–96%. Nine participants achieved at least 89%, while one reached 70%, showing that cross-subject performance was not uniform. A radial-basis-function support vector machine performed better offline, reaching 97.0% in the subject-mixed setting and 94.6% across held-out participants; it outperformed the neural network in nine of ten paired folds, with a two-sided Wilcoxon signed-rank result of W = 1 and p = 0.004. The support vector machine was therefore not the network against which the embedded prototype could be directly compared, because the study did not preserve the trained model’s support-vector count or make a complete memory comparison.</p>
<p>The convolutional model was selected for the embedded prototype not because it was the more accurate offline classifier, but because its fixed feed-forward architecture could be converted through the TensorFlow/Keras-to-STM32Cube.AI workflow. The network contained 82,193 parameters, of which 82,009 were trainable. Its convolution operated on a fixed ordering of heterogeneous engineered descriptors and channel boundaries, so the authors did not interpret its local interactions as a physically homogeneous temporal or anatomical axis. Post-training INT8 quantization used 1,000 representative feature vectors and reduced accuracy by 0.4 percentage points, from 95.0% to 94.6%, while the deployed model occupied approximately 98 KB of flash memory. Feature extraction from 50 representative recordings on the workstation and embedded C implementation differed by less than 2% on average across the 138 dimensions, although that comparison tested the numerical implementations for matched inputs rather than directly comparing the 24-bit laboratory and 12-bit microcontroller acquisition chains.</p>
<p>On the 216-megahertz STM32F769I, the measured processing time for a completed 400-millisecond window was 118.3 milliseconds. With 50% overlap, a new window became available every 200 milliseconds, leaving 81.7 milliseconds before the next update. Spectral processing was the largest expense: fast Fourier transforms across six 512-point inputs took 45.3 milliseconds, the mel filterbank and logarithm took 18.7 milliseconds, and the discrete cosine transform took 13.9 milliseconds. Wavelet decomposition required 15.1 milliseconds, filtering 5.2 milliseconds, time-domain statistics 1.8 milliseconds, feature normalization 0.7 milliseconds and INT8 neural-network inference 17.6 milliseconds. The system used 320 KB of the microcontroller’s 2 MB flash memory and 85 KB of its 512 KB SRAM. The 118.3-millisecond figure covered filtering, feature extraction, normalization and inference; it did not include the 400-millisecond signal-acquisition interval, communication outside the measured code path, actuator activation or the mechanical movement of the hand.</p>
<p>The real-time trial moved beyond replaying stored signals. Five additional right-handed able-bodied adults, three men and two women aged 23–27, produced 250 trials through the STM32’s 12-bit analog-to-digital converters. Each trial followed a gesture instruction, transition, sustained contraction and relaxation. Before classification, a global root-mean-square activity gate rejected windows below an empirically selected threshold of 80 least significant bits, corresponding to 64.45 mV at the analog-to-digital converter input. Active predictions were converted into pulse-width-modulated commands for the 5-DOF prosthetic-hand prototype. Only sustained-contraction windows that passed the gate were scored, with rest and transition periods excluded. Mean accuracy was 95.3%, with a standard deviation of 1.7 percentage points and individual results from 92.7% to 97.3%; fine pinch was the least accurately recognized gesture, with a mean class rate of 92.9%. This online result should not be directly equated with the 90.6% leave-one-subject-out offline result because the scoring conditions and participant groups differed.</p>
<p>Several limitations constrain what the demonstration means. The offline and real-time cohorts contained only 15 able-bodied participants in total, so the findings cannot yet be assumed to apply to people with upper-limb amputation, whose residual-limb anatomy, musculature, socket mechanics and sensor coupling may differ. Participants performed discrete gestures under controlled conditions, while bracelet displacement and tension, arm posture, contraction intensity, fatigue, external vibration, environmental noise and day-to-day variation were not systematically tested. The study also did not quantify false commands during unconstrained rest, performance during transitions, object-grasp success, task-completion time or the mechanical response of the hand. Although a 400-millisecond statistical analysis found that 95.26% of 54,504 channel-wise windows met a predefined combined Augmented Dickey–Fuller and KPSS criterion, those overlapping windows were nested within only 500 recordings from 10 people and were not 54,504 independent observations. The authors consequently described the result as local compatibility with the statistical criterion, not proof that the signals were broadly or spectrally stationary.</p>
<p>Overall, the work shows that acoustic muscle sensing, engineered feature extraction and compact neural-network inference can be integrated into a real-time prosthetic-control pipeline under controlled laboratory conditions. The next steps identified by the investigators are repeated-session measurements, deliberate changes in sensor placement, explicit rest and transition conditions, continuous closed-loop tasks and direct paired AMG–sEMG comparisons using identical participants, gestures, repetitions, training and test partitions, metrics and computational constraints. Evaluation in a larger population including intended prosthesis users will also be necessary before the system can be considered a clinically validated alternative to established myoelectric interfaces.</p>
<p><strong>Subject of Research:</strong> Cross-subject acoustomyography and embedded neural-network control of a 5-DOF prosthetic-hand prototype</p>
<p><strong>Article Title:</strong> AMG-based real-time prosthetic hand control: Cross-subject evaluation and embedded implementation</p>
<p><strong>Article References:</strong> Shili, W. E., Serrestou, Y., Raoof, K., &amp; Yacoub, S. (2026). AMG-based real-time prosthetic hand control: Cross-subject evaluation and embedded implementation. <em>Results in Engineering, 32</em>, Article 113567. <a href="https://doi.org/10.1016/j.rineng.2026.113567" rel="noopener noreferrer">https://doi.org/10.1016/j.rineng.2026.113567</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1016/j.rineng.2026.113567" rel="noopener noreferrer">10.1016/j.rineng.2026.113567</a></p>
<p><strong>Keywords:</strong> acoustomyography, prosthetic hand, gesture recognition, surface muscle sensing, embedded inference, STM32 microcontroller, INT8 quantization, neural networks, cross-subject evaluation, proof of concept, AMG-based, real-time</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">329239</post-id>	</item>
		<item>
		<title>Simulated federated TinyML detector runs classroom behavior analysis on a microcontroller</title>
		<link>https://scienmag.com/simulated-federated-tinyml-detector-runs-classroom-behavior-analysis-on-a-microcontroller/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Tue, 20 Oct 2026 20:17:45 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[classroom analytics]]></category>
		<category><![CDATA[classroom behavior detection on microcontrollers]]></category>
		<category><![CDATA[edge computing for behavior analysis]]></category>
		<category><![CDATA[edge inference]]></category>
		<category><![CDATA[embedded AI for education]]></category>
		<category><![CDATA[federated]]></category>
		<category><![CDATA[federated learning]]></category>
		<category><![CDATA[federated learning for TinyML]]></category>
		<category><![CDATA[federated learning simulation in classroom settings]]></category>
		<category><![CDATA[INT8 quantization]]></category>
		<category><![CDATA[lightweight object detection models]]></category>
		<category><![CDATA[low-power AI inference on Cortex-M4F]]></category>
		<category><![CDATA[microcontroller deployment]]></category>
		<category><![CDATA[microcontroller-based machine learning]]></category>
		<category><![CDATA[model pruning]]></category>
		<category><![CDATA[multi-class classroom activity recognition]]></category>
		<category><![CDATA[object detection]]></category>
		<category><![CDATA[privacy-focused federated AI training]]></category>
		<category><![CDATA[privacy-preserving AI]]></category>
		<category><![CDATA[privacy-preserving artificial intelligence]]></category>
		<category><![CDATA[real-time]]></category>
		<category><![CDATA[student behavior detection]]></category>
		<category><![CDATA[TinyML]]></category>
		<category><![CDATA[TinyML deep learning models]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=322292</guid>

					<description><![CDATA[A simulated five-client study found that a compressed federated student-behavior detector retained 95.64% mAP@0.5 and ran at 15.43 FPS on a microcontroller.]]></description>
										<content:encoded><![CDATA[<p>A simulated federated-learning study found that a compressed student-behavior detector retained 95.64% mAP@0.5 on the SCB-Dataset5 test set while running at 15.43 frames per second on a 120 MHz Arm Cortex-M4F microcontroller. The study evaluated a privacy-preserving framework that kept classroom images and annotations on simulated clients during training, exchanged model updates with a server and subsequently ran local inference on embedded hardware.</p>
<p>The research, published in Discover Artificial Intelligence, used SCB-Dataset5, which contains 7,428 classroom images and 106,830 annotated instances across 20 categories. These included student behaviors such as hand-raising, reading, writing, talking, yawning, phone use and leaning on a desk, together with teacher actions and classroom objects. The images were divided into 5,199 training images, 1,114 validation images and 1,115 test images, and all inputs were resized to 320 by 320 pixels.</p>
<p>The detector combined depthwise separable convolutional blocks, lightweight multi-scale feature fusion and a shallow detection head. Its output tensor contained three candidate boxes at each of 1,600 spatial locations, with each candidate representing four bounding-box coordinates, one objectness score and 20 class scores. The primary federated experiment simulated five clients, each corresponding to a classroom, school or edge node. In the non-independent and identically distributed evaluation, class allocations across those clients were generated with Dirichlet concentration parameters of 1.0, 0.5 and 0.1 to represent mild, moderate and severe heterogeneity.</p>
<p>Each simulated client trained locally and sent updated model parameters to a central server rather than transmitting raw images, labels or bounding-box annotations. Proximal regularization penalized excessive divergence of local updates from the global model. On the main SCB-Dataset5 test set, centralized training produced 98.12% F1-score, 98.42% mAP@0.5 and 86.35% mAP@0.5:0.95. The proximal federated model achieved the same 98.12% F1-score, along with 98.39% mAP@0.5 and 86.21% mAP@0.5:0.95.</p>
<p>Under the non-IID partition, standard FedAvg produced 96.24% F1-score and 96.58% mAP@0.5, compared with 98.12% F1-score and 98.39% mAP@0.5 for the proximal strategy. Performance declined gradually as heterogeneity increased: the proximal approach retained 97.84% F1-score under mild skew, 97.21% under moderate skew and 96.34% under severe skew. In an extended client-scalability simulation, mAP@0.5 decreased from 97.42% with five clients to 96.24% with 30 clients, while estimated communication cost rose from 2.37 MB to 14.22 MB per communication round.</p>
<p>The aggregated global model was then compressed through batch-normalization folding, 40% structured channel pruning, 20 epochs of post-pruning fine-tuning and full-integer INT8 quantization. Weights used per-channel symmetric INT8 quantization, activations used per-tensor asymmetric INT8 quantization, and biases were accumulated in INT32. The final compressed federated model achieved 95.52% F1-score, 95.64% mAP@0.5 and 78.86% mAP@0.5:0.95. Relative to the uncompressed federated model, its storage fell by 69.2% and its measured latency declined by 65.3%.</p>
<p>Embedded tests ran on an NXP FRDM-K64F development board with a 32-bit Arm Cortex-M4F processor, 1 MB of Flash memory and 256 KB of SRAM. The compressed model occupied 228.9 KB, while the complete TensorFlow Lite Micro runtime used 118.3 KB of SRAM for the tensor arena, activation and input/output buffers, and post-processing space. Each 320-by-320 image took 64.8 milliseconds through the full on-device path, including INT8 execution, output decoding, confidence filtering at 0.25 and non-maximum suppression at an IoU threshold of 0.50. Camera acquisition and image transmission were not included in that timing.</p>
<p>Diagnostic privacy tests indicated lower, but not eliminated, exposure relative to centralized full-precision training. Membership-inference attack accuracy fell from 67.84% in centralized FP32 training to 55.92% in the federated TinyML configuration; reconstruction PSNR declined from 21.62 dB to 14.86 dB, and model-inversion success fell from 38.71% to 12.58%. In a stress test with 30% malicious clients, mAP@0.5 was 94.12%. The method did not include secure aggregation, differential privacy, trust weighting or robust aggregation, and no direct board-level power measurements were reported.</p>
<p>Cross-dataset evaluation followed dataset-specific fine-tuning rather than zero-shot testing. The compressed federated INT8 model achieved 93.58% mAP@0.5 on UK_Dataset and 92.28% on SiTBehavior, below its SCB-Dataset5 result. The study was a computational federated simulation rather than a live multi-school deployment, and most evidence came from SCB-Dataset5, with limited validation on two additional datasets. Real-classroom testing, direct energy measurements, heterogeneous-hardware evaluation and stronger privacy and malicious-client defenses remain necessary before wider use.</p>
<p><strong>Subject of Research:</strong> Evaluation of a simulated federated TinyML framework for detecting student behaviors in smart classrooms</p>
<p><strong>Article Title:</strong> A real-time federated TinyML framework for student behavior detection in smart classrooms</p>
<p><strong>Article References:</strong> Yahyati, C., Lamaakal, I., El Makkaoui, K., &amp; Ouahbi, I. (2026). A real-time federated TinyML framework for student behavior detection in smart classrooms. <em>Discover Artificial Intelligence, 6</em>(1), Article 1282. <a href="https://doi.org/10.1007/s44163-026-02362-1" rel="noopener noreferrer">https://doi.org/10.1007/s44163-026-02362-1</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s44163-026-02362-1" rel="noopener noreferrer">10.1007/s44163-026-02362-1</a></p>
<p><strong>Keywords:</strong> student behavior detection, federated learning, TinyML, microcontroller deployment, INT8 quantization, model pruning, classroom analytics, privacy-preserving AI, object detection, edge inference, real-time, federated</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">322292</post-id>	</item>
		<item>
		<title>AI Coach in Your Pocket: Deep Learning System Delivers Real-Time Sports Pose Correction</title>
		<link>https://scienmag.com/ai-coach-in-your-pocket-deep-learning-system-delivers-real-time-sports-pose-correction/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Thu, 15 Oct 2026 23:38:23 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[affordable sports training technology]]></category>
		<category><![CDATA[AI-based athletic form improvement]]></category>
		<category><![CDATA[AI-driven athletic performance analysis]]></category>
		<category><![CDATA[biomechanics]]></category>
		<category><![CDATA[deep learning]]></category>
		<category><![CDATA[deep learning pose estimation]]></category>
		<category><![CDATA[edge computer sports coaching]]></category>
		<category><![CDATA[edge computing]]></category>
		<category><![CDATA[high-resolution computer vision models for sports]]></category>
		<category><![CDATA[HRNet]]></category>
		<category><![CDATA[instant sports movement correction]]></category>
		<category><![CDATA[INT8 quantization]]></category>
		<category><![CDATA[Jetson Nano]]></category>
		<category><![CDATA[knowledge distillation]]></category>
		<category><![CDATA[lightweight human pose detection models]]></category>
		<category><![CDATA[mobile sports coaching systems]]></category>
		<category><![CDATA[MobileNet V3]]></category>
		<category><![CDATA[pose estimation]]></category>
		<category><![CDATA[real-time athlete biomechanical feedback]]></category>
		<category><![CDATA[real-time feedback]]></category>
		<category><![CDATA[sports pose correction]]></category>
		<category><![CDATA[sports technology]]></category>
		<category><![CDATA[sports training AI on embedded hardware]]></category>
		<category><![CDATA[TensorRT]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=279310</guid>

					<description><![CDATA[A new deep learning system distills a high-accuracy pose estimation model into a lightweight edge-deployable AI coach that corrects athletes' form in real time with statistically proven results.]]></description>
										<content:encoded><![CDATA[<p>For decades, high-quality technical coaching has been a luxury. Elite athletes work with trainers who dissect every squat, shot, and lift frame by frame, while amateur athletes are left to guess at their own flaws based on brief verbal cues. A new open-access study published in Discover Artificial Intelligence by Yuan Liu of Shaanxi University of Science and Technology presents a system designed to close that gap: a deep learning platform that watches an athlete through a camera, estimates their body pose in real time, spots biomechanical errors, and delivers corrective feedback instantly—all on a small, affordable edge computer rather than a cloud server.</p>
<p>The core challenge the study tackles is a familiar one in applied artificial intelligence. The most accurate human pose estimation models, such as the high-resolution HRNet architecture that has set benchmarks in computer vision, are computationally enormous. They maintain rich, high-resolution feature representations throughout the network to pinpoint anatomical keypoints precisely, but their massive parameter counts and floating-point operation demands make them far too heavy to run at interactive speeds on mobile or embedded hardware. Meanwhile, the lightweight models that do fit on edge devices have traditionally sacrificed the accuracy needed for professional-grade movement analysis. The result has been a landscape dominated by offline analysis tools that process video after the fact, useful for post-game statistics but useless for correcting a flawed movement while it is actually happening.</p>
<p>Liu&#8217;s solution is built on knowledge distillation, a technique in which a large, high-performing teacher model transfers its learned expertise to a compact student model. In this system, a pre-trained HRNet serves as the teacher, supervising a student built on the MobileNet-V3 architecture. The training objective combines a standard mean squared error for heat-map regression with a distillation loss that penalizes divergence between the student&#8217;s intermediate feature maps and the teacher&#8217;s, aligned through one-by-one convolutions and bilinear interpolation across four of HRNet&#8217;s stage outputs. By learning to mimic not just the teacher&#8217;s final answers but its internal representations, the student captures postural nuances far beyond what a model of its size could achieve through conventional training alone.</p>
<p>The compression pipeline does not stop at distillation. The student model is then subjected to 8-bit integer quantization, which slashes the network&#8217;s memory footprint from 15.5 megabytes to 6.2 megabytes and accelerates inference by roughly 75 percent. Finally, the quantized model is deployed through NVIDIA&#8217;s TensorRT inference engine, which extracts further speed gains through hardware-aware optimization. The results of the ablation experiments trace each contribution in turn: distillation alone lifted accuracy from 84.2 percent to 90.1 percent mean Average Precision with negligible speed cost, quantization traded less than one percentage point of accuracy for dramatic efficiency, and TensorRT pushed the frame rate higher still. The finished system reaches 92.4 percent mAP while running at 45.8 frames per second on an NVIDIA Jetson Nano—a single-board computer typical of portable sports-analysis devices.</p>
<p>Those numbers represent what the author describes as the optimal precision-speed balance among mainstream edge pose estimation models. Compared head to head on the study&#8217;s self-built dataset, the system outperformed the heavyweight OpenPose reference by 3.9 percentage points of accuracy while running roughly nine times faster, beating it 45.8 FPS to 5.2 FPS. Against Google&#8217;s lightweight BlazePose and MoveNet models, it posted large accuracy advantages—14.2 and 15.9 percentage points respectively—while remaining competitive in speed. The complete model weighs in at just 12.3 megabytes, versus 209 megabytes for OpenPose, making it genuinely practical for local deployment on phones and embedded platforms.</p>
<p>Accurate pose estimation is only half the story; the system&#8217;s real innovation lies in what it does with the keypoints. The biomechanical correction engine treats the athlete&#8217;s limbs as a series of interconnected vectors. For any joint of interest—an elbow during a shot, a knee during a lift—the angle is calculated from the dot product of the adjacent limb vectors, taking the arccosine of the normalized result. That angle is then compared against predefined professional standard ranges for each phase of the movement. When the measured value drifts outside the threshold, the system immediately triggers a correction cue, translated by the feedback layer into intuitive visual or audio instructions. Because the logic is grounded in joint-angle thresholds rather than subjective pattern matching, the feedback is quantitative, specific, and traceable to established biomechanical principles.</p>
<p>Keeping that feedback truly instantaneous required serious software engineering. Traditional sequential pipelines stall because the processor waits for inference to finish before grabbing the next frame, producing lag and dropped frames. Liu&#8217;s architecture instead separates video acquisition, model inference, and user-interface rendering into independent threads that communicate through thread-safe high-speed queues. A frame-skipping mechanism prioritizes the most recent data, so the interface always reflects the athlete&#8217;s current position rather than a stale one. This asynchronous design is what allows the system to hold a frame rate above 45 FPS on the Jetson Nano while keeping the interface responsive even under heavy computational load—a requirement the author identifies as essential for interactive coaching.</p>
<p>The performance claims were put to a statistical test in a two-week controlled user study involving 40 athletes of mixed skill levels, randomly assigned to either an experimental group using the real-time feedback system or a control group receiving conventional coaching. The primary metric was the Posture Standard Rate, defined as the percentage of movement cycles in which joint angles stayed within professional biomechanical thresholds. At baseline the two groups were statistically indistinguishable, at roughly 62 to 63 percent. After two weeks, the experimental group reached 89.4 percent, versus 71.2 percent for the control group—a difference the author reports as highly significant, with the improvement gap of 26.9 percent versus 8.1 percent also statistically robust. Athletes using the system reported being able to adjust their center of gravity and limb extension mid-movement, preventing the reinforcement of bad habits, while control participants often struggled to visualize the specific errors their coaches described.</p>
<p>Validation was conducted on a dual-dataset strategy: a self-built repository of 5,000 high-definition video clips of basketball and weightlifting movements—chosen for their complex biomechanical demands—annotated by professional coaches, plus the public UCF101 dataset used solely to confirm that the distilled model&#8217;s skeletal features preserved discriminative action semantics. Training ran on an RTX 3060 workstation with PyTorch 1.12, before cross-platform optimization via OpenVINO and deployment-grade acceleration through TensorRT. The study is honest about its limits: extreme outdoor glare and dynamic backgrounds can still introduce noise into the heat-map regression, and the quantization process sacrificed some high-resolution spatial features needed to resolve self-occlusions during rapid maneuvers. The author suggests future work on multi-modal sensor fusion to compensate, and proposes integrating augmented reality glasses so corrective cues could be projected directly into an athlete&#8217;s field of view.</p>
<p>The broader significance of the work is its demonstration that professional-grade movement analysis no longer requires expensive hardware, cloud connectivity, or a specialist on standby. Because all processing happens locally, the system protects user privacy and works without a persistent internet connection, making it viable for gyms, schools, and home training. With a movement library currently covering basketball and weightlifting—and ambitions to expand into gymnastics and martial arts—the platform points toward a future in which the kind of instant, data-driven feedback once reserved for elite training facilities becomes a standard feature of everyday athletic practice. For amateur athletes worldwide, the pocket coach may be closer than it seems.</p>
<p><strong>Subject of Research:</strong> Real-time athlete pose estimation and biomechanical error correction using knowledge distillation on edge devices</p>
<p><strong>Article Title:</strong> Research on real-time athlete movement and pose estimation and error correction system based on deep learning</p>
<p><strong>Article References:</strong> Liu, Y. (2026). Research on real-time athlete movement and pose estimation and error correction system based on deep learning. <em>Discover Artificial Intelligence, 6</em>(1), Article 1505. <a href="https://doi.org/10.1007/s44163-026-02229-5" rel="noopener noreferrer">https://doi.org/10.1007/s44163-026-02229-5</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s44163-026-02229-5" rel="noopener noreferrer">10.1007/s44163-026-02229-5</a></p>
<p><strong>Keywords:</strong> pose estimation, knowledge distillation, deep learning, biomechanics, edge computing, MobileNet-V3, HRNet, TensorRT, INT8 quantization, sports technology, real-time feedback, Jetson Nano</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">279310</post-id>	</item>
		<item>
		<title>Tiny AI brain lets a $10 microcontroller remember hidden objects and grab them</title>
		<link>https://scienmag.com/tiny-ai-brain-lets-a-10-microcontroller-remember-hidden-objects-and-grab-them/</link>
		
		<dc:creator><![CDATA[Cassandra Pierce]]></dc:creator>
		<pubDate>Mon, 05 Oct 2026 11:45:48 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[compact AI models for physical tasks]]></category>
		<category><![CDATA[embedded robotics]]></category>
		<category><![CDATA[ESP32]]></category>
		<category><![CDATA[ESP32 microcontroller applications]]></category>
		<category><![CDATA[imitation learning]]></category>
		<category><![CDATA[INT8 quantization]]></category>
		<category><![CDATA[inverse kinematics]]></category>
		<category><![CDATA[inverse kinematics in small robots]]></category>
		<category><![CDATA[low-power AI for robots]]></category>
		<category><![CDATA[LSTM]]></category>
		<category><![CDATA[microcontroller]]></category>
		<category><![CDATA[microcontroller-based AI]]></category>
		<category><![CDATA[neural memory for robotic manipulation]]></category>
		<category><![CDATA[object permanence]]></category>
		<category><![CDATA[object permanence in robotics]]></category>
		<category><![CDATA[object tracking during occlusion]]></category>
		<category><![CDATA[occlusion]]></category>
		<category><![CDATA[recurrent neural networks]]></category>
		<category><![CDATA[robotic manipulation]]></category>
		<category><![CDATA[small-scale AI for autonomous object handling]]></category>
		<category><![CDATA[Tiny-STM neural network]]></category>
		<category><![CDATA[TinyML]]></category>
		<category><![CDATA[vision-based object recognition in constrained hardware]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=237852</guid>

					<description><![CDATA[Researchers have built Tiny-STM, a 68.4-kilobyte LSTM controller with a simple coordinate memory that lets an ESP32 microcontroller track objects through visual occlusion and complete physical pick-and-place tasks with an observed 85 percent success rate.]]></description>
										<content:encoded><![CDATA[<p>Robots that can reason about objects they cannot currently see have long been the preserve of data-center-scale artificial intelligence, with vision-language-action models built on tens of billions of parameters and racks of GPUs. A new open-access study in Discover Informatics now demonstrates a strikingly different approach: a robotic manipulation controller small enough to run entirely on an ESP32 microcontroller, yet capable of tracking objects through visual occlusion and completing physical pick-and-place tasks with an observed success rate of 85 percent. The system, called Tiny-STM, packs a recurrent neural network, an external coordinate memory, and analytical inverse kinematics into just 68.4 kilobytes of quantized model weights.</p>
<p>The core insight behind Tiny-STM is that object permanence, the cognitive ability to understand that things continue to exist when hidden from view, does not require a learned memory mechanism of the kind used in large transformer-based systems. Instead, the researchers, Swarnajit Bhattacharya of National Yang Ming Chiao Tung University in Taiwan and Ian Chao of the University of Washington, paired a standard four-gate Long Short-Term Memory network with a deterministic four-slot coordinate bank. Each slot stores the most recently observed three-dimensional position of one task object. When a cube disappears behind a stack of other blocks, its stored coordinate simply holds steady until the camera sees it again, a scheme the authors describe as a zero-order-hold update rule.</p>
<p>The architecture itself is deliberately conventional. The LSTM takes a seven-dimensional input vector combining the vector from the gripper tip to the target object&#8217;s stored position, the current tip position, and a one-dimensional infrared range reading from a Sharp GP2Y0A41SK0F sensor mounted on the gripper. A hidden state of 128 dimensions feeds a linear output layer that predicts an incremental three-dimensional displacement of the end effector. With 70,019 parameters in total, the network is tiny by modern standards, and after INT8 quantization through the TensorFlow Lite Micro pipeline it occupies just 68.4 KB, a small fraction of the ESP32&#8217;s 520 KB of static RAM.</p>
<p>Training relied on remarkably little data. The authors manually guided a Waveshare 5-DOF RoArm-M3 robotic arm through exactly 30 pick-and-place demonstrations, recording joint angles, cube centroids from a side-mounted camera, and infrared range measurements at each control step. Backpropagation through time with mean-squared-error loss and the Adam optimizer at a learning rate of 0.001 produced the deployed checkpoint. This data efficiency stands in sharp contrast to imitation-learning platforms such as ALOHA, which achieve 80 to 90 percent success on fine-grained bimanual tasks but require roughly ten minutes of teleoperated demonstrations and substantially more powerful compute.</p>
<p>The division of labor between hardware components is a key part of the design. A host PC or single-board computer captures camera frames and performs deterministic color-thresholding segmentation, converting detected pixel centroids into three-dimensional workspace coordinates through a calibrated pinhole camera model. The camera was calibrated with 25 checkerboard images using Zhang&#8217;s method, yielding a mean reprojection error of 0.3 pixels, while camera-to-base extrinsic calibration over 12 known points achieved a root-mean-square alignment error of 1.18 millimeters. The ESP32 then handles everything on the control side: the recurrent forward pass, analytical inverse kinematics, and PWM servo command generation, all in a measured 2.80 milliseconds.</p>
<p>The inverse kinematics routine reduces the five-degree-of-freedom arm problem to a planar three-degree-of-freedom calculation, exploiting the fact that the task uses a top-down grasp with a vertically oriented gripper. Base rotation comes from an arctangent of the target coordinates, while the shoulder and elbow angles follow from two-link geometry via the law of cosines. The authors handle three degenerate cases explicitly: base singularity when the target lies on the rotation axis, arm singularity near full extension where the Jacobian becomes ill-conditioned, and unreachable targets outside the geometric annulus defined by the link lengths, which are simply rejected so the arm retains its previous pose.</p>
<p>Physical evaluation consisted of 20 trials in which the arm sorted four labeled cubes from randomized positions into an ordered arrangement, including a vertical stacking sequence in which the fourth block becomes completely hidden behind the first three before its final grasp. The single deployed INT8 checkpoint completed 17 of 20 trials, an observed success rate of 85.0 percent with a two-sided 95 percent exact binomial confidence interval of 62.1 to 96.8 percent. The authors are careful to note that this interval describes uncertainty in the 20 observed outcomes of one checkpoint, not variability across independently trained models, since the original training seed and stopping rule were not retained.</p>
<p>The three failures are instructive. Mechanical backlash in the servo gearboxes introduced joint-level positional uncertainty of roughly 1.5 to 2.5 millimeters, which can accumulate across joints. Fixed color thresholds proved vulnerable to strong lighting changes and shadows that shifted pixel values out of range, degrading the segmentation masks. And when an occluded object was physically moved while hidden, the stored coordinate became stale, causing the controller to reach toward a position where the object no longer was; the gripper tolerance is approximately 18 millimeters. The authors formalize this limitation in a corollary showing that if an occluded object is displaced, the memory error grows at least in proportion to the displacement.</p>
<p>On latency, the measured ESP32 computation of 2.80 milliseconds combines with the nominal 33.3-millisecond camera period at 30 frames per second, profiled segmentation and Wi-Fi communication times, and a datasheet-based actuator response allowance to yield an aggregated end-to-end latency estimate of 92.6 milliseconds, equivalent to roughly 10.8 hertz. The authors emphasize that this figure is an estimate assembled from components rather than a single timed end-to-end measurement. Peak SRAM usage on the microcontroller was 94.8 KB, or 18.23 percent of capacity, leaving substantial headroom. Offline comparisons suggest the FP32 model would occupy 273.5 KB with an estimated 11.20 milliseconds of inference, underscoring the value of INT8 quantization for embedded deployment.</p>
<p>The study is notable as much for its honesty about boundaries as for its results. The authors explicitly state that no ablation was performed to separate the contribution of the coordinate memory from that of the recurrent state, that no numerical comparison with RT-2, OpenVLA, TinyVLA, or Diffusion Policy is possible given different tasks and hardware, and that the color-thresholding front end was never validated against ground-truth masks. Future work, they write, should include matched ablation studies with multiple training seeds, documented reproducibility protocols, perception validation, tests of behavior when occluded objects are displaced, and scaling experiments beyond four tracked objects. Even so, Tiny-STM offers a compelling demonstration that a form of object permanence can live in 68 kilobytes, bringing occlusion-aware manipulation within reach of the cheapest embedded hardware.</p>
<p><strong>Subject of Research:</strong> Lightweight recurrent neural network controllers with external coordinate memory for occlusion-aware robotic manipulation on microcontrollers</p>
<p><strong>Article Title:</strong> Lightweight LSTM-based memory architecture for occlusion-aware robotic manipulation on microcontrollers</p>
<p><strong>Article References:</strong> Bhattacharya, S., &amp; Chao, I. (2026). Lightweight LSTM-based memory architecture for occlusion-aware robotic manipulation on microcontrollers. <em>Discover Informatics, 1</em>(1), Article 23. <a href="https://doi.org/10.1007/s44564-026-00023-0" rel="noopener noreferrer">https://doi.org/10.1007/s44564-026-00023-0</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s44564-026-00023-0" rel="noopener noreferrer">10.1007/s44564-026-00023-0</a></p>
<p><strong>Keywords:</strong> TinyML, LSTM, robotic manipulation, object permanence, occlusion, ESP32, microcontroller, imitation learning, inverse kinematics, INT8 quantization, embedded robotics, recurrent neural networks</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">237852</post-id>	</item>
	</channel>
</rss>
