<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>TinyML &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/tinyml/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Tue, 20 Oct 2026 20:17:45 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>TinyML &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>Simulated federated TinyML detector runs classroom behavior analysis on a microcontroller</title>
		<link>https://scienmag.com/simulated-federated-tinyml-detector-runs-classroom-behavior-analysis-on-a-microcontroller/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Tue, 20 Oct 2026 20:17:45 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[classroom analytics]]></category>
		<category><![CDATA[classroom behavior detection on microcontrollers]]></category>
		<category><![CDATA[edge computing for behavior analysis]]></category>
		<category><![CDATA[edge inference]]></category>
		<category><![CDATA[embedded AI for education]]></category>
		<category><![CDATA[federated]]></category>
		<category><![CDATA[federated learning]]></category>
		<category><![CDATA[federated learning for TinyML]]></category>
		<category><![CDATA[federated learning simulation in classroom settings]]></category>
		<category><![CDATA[INT8 quantization]]></category>
		<category><![CDATA[lightweight object detection models]]></category>
		<category><![CDATA[low-power AI inference on Cortex-M4F]]></category>
		<category><![CDATA[microcontroller deployment]]></category>
		<category><![CDATA[microcontroller-based machine learning]]></category>
		<category><![CDATA[model pruning]]></category>
		<category><![CDATA[multi-class classroom activity recognition]]></category>
		<category><![CDATA[object detection]]></category>
		<category><![CDATA[privacy-focused federated AI training]]></category>
		<category><![CDATA[privacy-preserving AI]]></category>
		<category><![CDATA[privacy-preserving artificial intelligence]]></category>
		<category><![CDATA[real-time]]></category>
		<category><![CDATA[student behavior detection]]></category>
		<category><![CDATA[TinyML]]></category>
		<category><![CDATA[TinyML deep learning models]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=322292</guid>

					<description><![CDATA[A simulated five-client study found that a compressed federated student-behavior detector retained 95.64% mAP@0.5 and ran at 15.43 FPS on a microcontroller.]]></description>
										<content:encoded><![CDATA[<p>A simulated federated-learning study found that a compressed student-behavior detector retained 95.64% mAP@0.5 on the SCB-Dataset5 test set while running at 15.43 frames per second on a 120 MHz Arm Cortex-M4F microcontroller. The study evaluated a privacy-preserving framework that kept classroom images and annotations on simulated clients during training, exchanged model updates with a server and subsequently ran local inference on embedded hardware.</p>
<p>The research, published in Discover Artificial Intelligence, used SCB-Dataset5, which contains 7,428 classroom images and 106,830 annotated instances across 20 categories. These included student behaviors such as hand-raising, reading, writing, talking, yawning, phone use and leaning on a desk, together with teacher actions and classroom objects. The images were divided into 5,199 training images, 1,114 validation images and 1,115 test images, and all inputs were resized to 320 by 320 pixels.</p>
<p>The detector combined depthwise separable convolutional blocks, lightweight multi-scale feature fusion and a shallow detection head. Its output tensor contained three candidate boxes at each of 1,600 spatial locations, with each candidate representing four bounding-box coordinates, one objectness score and 20 class scores. The primary federated experiment simulated five clients, each corresponding to a classroom, school or edge node. In the non-independent and identically distributed evaluation, class allocations across those clients were generated with Dirichlet concentration parameters of 1.0, 0.5 and 0.1 to represent mild, moderate and severe heterogeneity.</p>
<p>Each simulated client trained locally and sent updated model parameters to a central server rather than transmitting raw images, labels or bounding-box annotations. Proximal regularization penalized excessive divergence of local updates from the global model. On the main SCB-Dataset5 test set, centralized training produced 98.12% F1-score, 98.42% mAP@0.5 and 86.35% mAP@0.5:0.95. The proximal federated model achieved the same 98.12% F1-score, along with 98.39% mAP@0.5 and 86.21% mAP@0.5:0.95.</p>
<p>Under the non-IID partition, standard FedAvg produced 96.24% F1-score and 96.58% mAP@0.5, compared with 98.12% F1-score and 98.39% mAP@0.5 for the proximal strategy. Performance declined gradually as heterogeneity increased: the proximal approach retained 97.84% F1-score under mild skew, 97.21% under moderate skew and 96.34% under severe skew. In an extended client-scalability simulation, mAP@0.5 decreased from 97.42% with five clients to 96.24% with 30 clients, while estimated communication cost rose from 2.37 MB to 14.22 MB per communication round.</p>
<p>The aggregated global model was then compressed through batch-normalization folding, 40% structured channel pruning, 20 epochs of post-pruning fine-tuning and full-integer INT8 quantization. Weights used per-channel symmetric INT8 quantization, activations used per-tensor asymmetric INT8 quantization, and biases were accumulated in INT32. The final compressed federated model achieved 95.52% F1-score, 95.64% mAP@0.5 and 78.86% mAP@0.5:0.95. Relative to the uncompressed federated model, its storage fell by 69.2% and its measured latency declined by 65.3%.</p>
<p>Embedded tests ran on an NXP FRDM-K64F development board with a 32-bit Arm Cortex-M4F processor, 1 MB of Flash memory and 256 KB of SRAM. The compressed model occupied 228.9 KB, while the complete TensorFlow Lite Micro runtime used 118.3 KB of SRAM for the tensor arena, activation and input/output buffers, and post-processing space. Each 320-by-320 image took 64.8 milliseconds through the full on-device path, including INT8 execution, output decoding, confidence filtering at 0.25 and non-maximum suppression at an IoU threshold of 0.50. Camera acquisition and image transmission were not included in that timing.</p>
<p>Diagnostic privacy tests indicated lower, but not eliminated, exposure relative to centralized full-precision training. Membership-inference attack accuracy fell from 67.84% in centralized FP32 training to 55.92% in the federated TinyML configuration; reconstruction PSNR declined from 21.62 dB to 14.86 dB, and model-inversion success fell from 38.71% to 12.58%. In a stress test with 30% malicious clients, mAP@0.5 was 94.12%. The method did not include secure aggregation, differential privacy, trust weighting or robust aggregation, and no direct board-level power measurements were reported.</p>
<p>Cross-dataset evaluation followed dataset-specific fine-tuning rather than zero-shot testing. The compressed federated INT8 model achieved 93.58% mAP@0.5 on UK_Dataset and 92.28% on SiTBehavior, below its SCB-Dataset5 result. The study was a computational federated simulation rather than a live multi-school deployment, and most evidence came from SCB-Dataset5, with limited validation on two additional datasets. Real-classroom testing, direct energy measurements, heterogeneous-hardware evaluation and stronger privacy and malicious-client defenses remain necessary before wider use.</p>
<p><strong>Subject of Research:</strong> Evaluation of a simulated federated TinyML framework for detecting student behaviors in smart classrooms</p>
<p><strong>Article Title:</strong> A real-time federated TinyML framework for student behavior detection in smart classrooms</p>
<p><strong>Article References:</strong> Yahyati, C., Lamaakal, I., El Makkaoui, K., &amp; Ouahbi, I. (2026). A real-time federated TinyML framework for student behavior detection in smart classrooms. <em>Discover Artificial Intelligence, 6</em>(1), Article 1282. <a href="https://doi.org/10.1007/s44163-026-02362-1" rel="noopener noreferrer">https://doi.org/10.1007/s44163-026-02362-1</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s44163-026-02362-1" rel="noopener noreferrer">10.1007/s44163-026-02362-1</a></p>
<p><strong>Keywords:</strong> student behavior detection, federated learning, TinyML, microcontroller deployment, INT8 quantization, model pruning, classroom analytics, privacy-preserving AI, object detection, edge inference, real-time, federated</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">322292</post-id>	</item>
		<item>
		<title>Tiny AI Models That Listen: New Search Method Finds the Best Keyword Spotter for Microchips</title>
		<link>https://scienmag.com/tiny-ai-models-that-listen-new-search-method-finds-the-best-keyword-spotter-for-microchips/</link>
		
		<dc:creator><![CDATA[Denise Maddox]]></dc:creator>
		<pubDate>Fri, 09 Oct 2026 17:16:59 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[balancing accuracy and memory in microcontroller AI]]></category>
		<category><![CDATA[Bayesian optimization]]></category>
		<category><![CDATA[Bayesian optimization for resource-constrained voice recognition]]></category>
		<category><![CDATA[designing efficient neural networks for medical and industrial microchips]]></category>
		<category><![CDATA[DS-CNN]]></category>
		<category><![CDATA[embedded systems]]></category>
		<category><![CDATA[evolutionary algorithms for neural network design]]></category>
		<category><![CDATA[hardware-aware neural architecture search]]></category>
		<category><![CDATA[hardware-in-the-loop]]></category>
		<category><![CDATA[keyword spotting]]></category>
		<category><![CDATA[local voice interface development for IoT devices]]></category>
		<category><![CDATA[low-power keyword spotting models]]></category>
		<category><![CDATA[microcontrollers]]></category>
		<category><![CDATA[multi-objective optimization]]></category>
		<category><![CDATA[multi-objective optimization for tiny AI models]]></category>
		<category><![CDATA[neural architecture search]]></category>
		<category><![CDATA[NSGA-II]]></category>
		<category><![CDATA[optimization strategies for always-on voice detectors]]></category>
		<category><![CDATA[Pareto optimality]]></category>
		<category><![CDATA[simulated annealing]]></category>
		<category><![CDATA[simulated annealing in neural architecture optimization]]></category>
		<category><![CDATA[small footprint keyword recognition in embedded systems]]></category>
		<category><![CDATA[tiny neural networks for voice-activated microcontrollers]]></category>
		<category><![CDATA[TinyML]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=255057</guid>

					<description><![CDATA[Researchers at NIT Durgapur compared NSGA-II, MOSA, and Bayesian optimization for designing tiny keyword spotting models, finding MOSA most reliable and hardware-in-the-loop testing essential for real microcontroller deployment.]]></description>
										<content:encoded><![CDATA[<p>Teaching a microcontroller to recognize the word &#8220;hey&#8221; sounds simple enough, but the engineering behind it is a surprisingly brutal balancing act. A keyword spotting model must be accurate enough to avoid false wake-ups, yet small enough to squeeze into the few hundred kilobytes of memory that a low-power microcontroller can spare. A new study published in Neural Computing and Applications by Soumen Garai and Suman Samui of the National Institute of Technology Durgapur tackles this problem head-on, offering one of the most systematic comparisons to date of how different optimization strategies design tiny neural networks for always-on voice interfaces. The work arrives at a moment when voice-activated devices are proliferating across homes, factories, and medical equipment, all demanding local intelligence without cloud connectivity.</p>
<p>The researchers built a single hardware-aware neural architecture search framework and used it as a level playing field for three competing multi-objective optimizers: NSGA-II, a classic evolutionary algorithm; Multi-Objective Simulated Annealing, or MOSA, which borrows its logic from the physics of cooling metals; and Multi-Objective Bayesian Optimization, or MOBO, which builds a statistical model of the search space to guess where the best designs lie. Each optimizer was tasked with tuning three popular neural architectures for keyword spotting: a plain convolutional neural network, a convolutional recurrent hybrid known as CRNN, and a depthwise separable convolutional network called DS-CNN, which is prized for delivering strong accuracy at a fraction of the parameter count.</p>
<p>What makes the search genuinely difficult is that the two objectives pull in opposite directions. Maximizing accuracy generally means adding layers, channels, and parameters, which inflates the serialized model size. Shrinking the model saves memory but usually costs recognition performance. Rather than collapsing these goals into a single weighted score, the team kept the search bi-objective, allowing the optimizers to map out a Pareto front: the set of designs where no model can be made more accurate without becoming larger, and no model can be made smaller without losing accuracy. This Pareto framing gives designers a menu of defensible choices rather than a single answer that silently encodes someone&#8217;s assumptions about what matters most.</p>
<p>To keep the comparison statistically honest, the authors ran every optimization five times and subjected the results to non-parametric significance testing, including the Kruskal-Wallis and Mann-Whitney procedures with Holm correction for multiple comparisons. This is a methodological discipline that many architecture search papers skip, and it matters, because multi-objective optimizers are stochastic: a single lucky run can make a weak algorithm look brilliant. The headline result of the study is that MOSA delivered the most reliable convergence across all three architectures, achieving the lowest mean generational distance, a metric that measures how close the found solutions are to the true optimal front. Differences in hypervolume and spread, two other standard quality indicators, were not statistically significant at this sample size, a finding the authors report with appropriate caution.</p>
<p>The best model produced by the framework reached 97.41 percent accuracy, a figure that would have seemed unattainable for on-device keyword spotting only a few years ago. But accuracy alone does not guarantee a deployable model, and this is where the study&#8217;s second major contribution comes in. After the search completed, the team evaluated the selected candidates on real hardware, measuring peak SRAM usage, Flash storage requirements, and on-device inference latency. These measurements fed into a Hardware-in-the-Loop Deployability Index, a screening score that separates models that merely look good on paper from models that actually fit and run fast on a target microcontroller. Crucially, the HIL evaluation screens candidates after the search rather than steering it, which keeps the expensive physical measurements from slowing down the optimization loop itself.</p>
<p>The hardware results carry practical weight for anyone shipping embedded voice products. On the STM32F401, one of the tightest boards in the study, the DS-CNN selected by MOBO retained the most resource headroom among the DS-CNN candidates, leaving valuable SRAM and Flash margin for the rest of an application&#8217;s firmware. In the embedded world, that headroom is not a luxury; it determines whether a product team can add a second sensor pipeline, a firmware update mechanism, or a more sophisticated wake-word vocabulary later. A model that consumes 95 percent of available memory may benchmark beautifully and still be unshippable, which is precisely the failure mode the Deployability Index is designed to catch.</p>
<p>The final stage of the pipeline addresses a subtler question: given a Pareto front full of trade-off candidates, which one should a designer actually pick? The authors applied a Tchebycheff scalarization step, a technique from multi-objective decision theory that ranks the models according to a stated preference between accuracy and size. Instead of pretending there is one objectively best model, the method makes the designer&#8217;s priorities explicit and then identifies the candidate that best honors them. This separation of concerns, generating the trade-off frontier first and applying preferences second, reflects a maturing view of how automated design tools should serve human engineers rather than replace their judgment.</p>
<p>Underlying the whole effort is a quiet revolution in how neural networks are quantized and compressed. The study notes that moving from 32-bit floating point to 8-bit integer weights reduces model size roughly fourfold, which is what makes microcontroller deployment feasible at all. The search framework operates with these deployment realities in view, evaluating serialized model size rather than raw parameter counts, so the numbers the optimizers chase correspond to what will actually be written into Flash memory. The training data came from publicly available corpora, including Google Speech Commands v2 and the Multilingual Spoken Words Corpus, which supports reproducibility and opens the door for other groups to replicate the comparison.</p>
<p>The broader significance of the work lies in its insistence on fair comparison and real-hardware validation, two things the neural architecture search literature has often lacked. Many published NAS pipelines are evaluated on proxy tasks or simulated latency models, and the resulting architectures sometimes disappoint when they meet silicon. By grounding the evaluation in measured SRAM, Flash, and latency figures on actual boards, and by repeating every experiment with proper statistical controls, Garai and Samui have produced something rarer than a new record: a reproducible methodology for asking which optimizer serves TinyML designers best. Their answer, that MOSA converges most reliably while MOBO&#8217;s selections leave the most hardware headroom, is nuanced rather than triumphant, and that nuance is exactly what practitioners need.</p>
<p>As always-on voice interfaces spread into battery-powered sensors, hearing aids, industrial monitors, and smart home devices, the demand for tiny models that are simultaneously accurate, small, and fast will only intensify. This study offers a template for meeting that demand systematically: define the objectives honestly, compare optimizers under identical conditions with statistical rigor, verify the winners on real hardware, and only then apply human preferences to choose among the finalists. For the growing TinyML community, the message is that the path from a research prototype to a product that ships inside a two-dollar microcontroller is no longer a matter of trial and error. It can be searched, measured, and ranked, one carefully optimized neural network at a time.</p>
<p><strong>Subject of Research:</strong> Multi-objective neural architecture search for hardware-efficient TinyML keyword spotting on microcontrollers</p>
<p><strong>Article Title:</strong> Multi-objective neural architecture search for TinyML keyword spotting: a comparative study of metaheuristic and bayesian optimization with hardware-in-the-loop evaluation</p>
<p><strong>Article References:</strong> Garai, S., &amp; Samui, S. (2026). Multi-objective neural architecture search for TinyML keyword spotting: a comparative study of metaheuristic and bayesian optimization with hardware-in-the-loop evaluation. <em>Neural Computing and Applications, 38</em>(19), Article 784. <a href="https://doi.org/10.1007/s00521-026-12484-3" rel="noopener noreferrer">https://doi.org/10.1007/s00521-026-12484-3</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s00521-026-12484-3" rel="noopener noreferrer">10.1007/s00521-026-12484-3</a></p>
<p><strong>Keywords:</strong> TinyML, keyword spotting, neural architecture search, multi-objective optimization, Bayesian optimization, NSGA-II, simulated annealing, microcontrollers, hardware-in-the-loop, Pareto optimality, DS-CNN, embedded systems</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">255057</post-id>	</item>
		<item>
		<title>Teaching Tiny Networks: New Quantization Method Pushes 1-Bit AI Toward Full-Precision Accuracy</title>
		<link>https://scienmag.com/teaching-tiny-networks-new-quantization-method-pushes-1-bit-ai-toward-full-precision-accuracy/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Mon, 05 Oct 2026 12:20:06 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[1-bit deep learning models]]></category>
		<category><![CDATA[AI for Internet of Things devices]]></category>
		<category><![CDATA[assistive teacher and self-knowledge distillation]]></category>
		<category><![CDATA[binary neural networks]]></category>
		<category><![CDATA[binary neural networks for AI]]></category>
		<category><![CDATA[binary quantization-aware training]]></category>
		<category><![CDATA[CIFAR-10]]></category>
		<category><![CDATA[deep learning]]></category>
		<category><![CDATA[deep neural network compression techniques]]></category>
		<category><![CDATA[edge AI]]></category>
		<category><![CDATA[energy-efficient AI hardware]]></category>
		<category><![CDATA[fast bitwise operations in AI]]></category>
		<category><![CDATA[full-precision accuracy in quantized networks]]></category>
		<category><![CDATA[knowledge distillation]]></category>
		<category><![CDATA[low-bit inference]]></category>
		<category><![CDATA[model compression]]></category>
		<category><![CDATA[neural network efficiency]]></category>
		<category><![CDATA[quantization-aware training]]></category>
		<category><![CDATA[reducing memory footprint of neural networks]]></category>
		<category><![CDATA[self-knowledge distillation]]></category>
		<category><![CDATA[state-of-the-art model accuracy with compressed networks]]></category>
		<category><![CDATA[structured pruning]]></category>
		<category><![CDATA[tiny neural network quantization]]></category>
		<category><![CDATA[TinyML]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=237952</guid>

					<description><![CDATA[Researchers in South Korea have developed a progressive distillation framework called ASBQ that trains one-bit binary neural networks to match full-precision accuracy, reaching 93.1 percent on CIFAR-10.]]></description>
										<content:encoded><![CDATA[<p>Deep neural networks have become astonishingly capable at recognizing images, understanding speech, and generating text, but that capability comes at a steep price. State-of-the-art models carry millions or billions of floating-point parameters, and running them demands powerful, energy-hungry hardware. For smartphones, drones, medical implants, and the sprawling family of Internet of Things devices, that cost is often prohibitive. A research team in South Korea now reports a training method that narrows the gap between these heavyweight models and their radically compressed counterparts, achieving accuracy on a standard benchmark that rivals full-precision networks while storing weights as single bits.</p>
<p>The study, published in Multimedia Tools and Applications by Jie Xu and Hyunsouk Cho of Ajou University together with Wonjun Hwang of Korea University, introduces a framework called ASBQ, short for assistive teacher and self-knowledge distillation for binary quantization-aware training. Binary neural networks, the technology at the heart of the work, replace the 32-bit floating-point weights of conventional networks with values of just one bit, essentially a choice between plus one and minus one. In principle, that substitution slashes memory requirements by a factor of thirty-two and converts the expensive multiply-accumulate operations of deep learning into cheap bitwise XNOR and popcount instructions that commodity processors and custom chips execute with remarkable efficiency.</p>
<p>The catch has always been accuracy. When a network&#8217;s weights are forced into two states, the vast majority of the fine-grained information encoded during training is destroyed. Gradients become noisy, the optimization landscape turns unstable, and the expressive capacity of each layer shrinks dramatically. Early binary networks lost double-digit percentages of accuracy compared with their full-precision teachers, and although a decade of research has steadily closed the gap, the deficit has remained stubborn on challenging datasets. The problem is compounded by the so-called gradient mismatch: the forward pass uses discrete binary weights while the backward pass relies on a straight-through estimator that approximates gradients through the non-differentiable sign function, a compromise that injects error into every training step.</p>
<p>ASBQ attacks the problem with a progressive, multi-stage strategy rooted in knowledge distillation, the technique pioneered by Geoffrey Hinton and colleagues in which a compact student network learns to mimic the output behavior of a larger teacher. Rather than asking a one-bit student to leap directly from random initialization to binary weights, the framework deploys a series of assistive teacher models at multiple bit widths. The student first learns from a full-precision teacher, then gradually transitions through intermediate quantization levels, with each stage providing a gentler target than the last. The result is a smooth logit-based distillation trajectory in which the distance between teacher and student shrinks step by step, minimizing the accuracy shock that typically accompanies the final collapse to one bit.</p>
<p>A second pillar of the method is self-knowledge distillation, in which the network effectively becomes its own instructor. Instead of relying solely on an external teacher, deeper or later-stage representations guide shallower or earlier ones, transferring knowledge within the same architecture. This internal feedback loop stabilizes training by giving the quantized student a richer, more consistent learning signal than the raw labels alone could provide. The approach draws on a growing body of evidence that self-distillation improves generalization even in full-precision networks, and the authors adapt it specifically to counteract the information loss that plagues binary quantization-aware training.</p>
<p>To make the framework robust across different network architectures, the researchers integrate matching structured pruning with an asymmetric scaling factor for binary weight networks. Structured pruning removes entire filters or channels rather than individual weights, which matters for hardware deployment because pruned structures translate directly into skipped computations, whereas unstructured sparsity often requires specialized support to yield real speedups. By matching the pruned architecture between teacher and student, the method ensures that the knowledge being distilled fits the capacity of the compressed network. The asymmetric binary weight network scaling factor, meanwhile, allows separate scale parameters for different parts of the binarized weights, giving the network a corrective degree of freedom that reduces quantization error without sacrificing the hardware-friendly binary core.</p>
<p>The experimental results are striking. On CIFAR-10, a widely used image classification benchmark of sixty thousand small color images across ten categories, ASBQ reaches a state-of-the-art accuracy of 93.1 percent, a level the authors describe as comparable to the performance of full-precision teacher models. That figure is notable because it suggests the binary student is no longer merely approximating its teacher; on this benchmark it essentially matches it. The framework also demonstrated consistent behavior across multiple neural network architectures, addressing a common weakness of quantization methods that are tuned to a single backbone and fail to generalize. The researchers have released their code publicly on GitHub, allowing other teams to reproduce and build on the results.</p>
<p>The broader context makes the contribution timely. The field of efficient deep learning has been converging on the insight that pruning and quantization are complementary rather than competing tools, and recent work has explored everything from second-order optimizers designed for binarized weights to binary networks running directly on unmodified commodity DRAM. Meanwhile the explosion of large language models has renewed interest in extreme quantization, including progressive mixed-precision schemes applied to key-value caches. Techniques that make the path from full precision to one bit smooth and stable, as ASBQ does, are directly relevant to any deployment scenario where memory bandwidth and energy are the binding constraints, from edge vision systems to on-device inference for generative models.</p>
<p>There remain caveats and open questions. The headline result is on CIFAR-10, a dataset that is modest by modern standards, and scaling the approach to ImageNet-scale classification or to transformer architectures will be the test that determines its practical reach. The framework also inherits the general complexity of multi-stage distillation pipelines, which involve more training machinery than a straightforward quantization-aware recipe. The authors report using only public databases for their experiments, and the work passed peer review at a journal focused on multimedia tools and applications, but independent replication across diverse domains will be essential before the method becomes a default choice for practitioners.</p>
<p>Even so, the study marks a meaningful step toward a long-standing goal: neural networks that deliver full-precision accuracy at a fraction of the cost. If the techniques of adaptive multi-bit progressive quantization continue to close the gap at larger scales, the implications extend well beyond academic benchmarks. Battery-powered sensors that currently run stripped-down models could host far more capable networks; data centers could cut the energy footprint of inference at scale; and the growing ecosystem of TinyML applications, from agricultural monitoring to wearable health devices, could gain access to intelligence previously confined to the cloud. In the ongoing effort to shrink artificial intelligence down to size, teaching small networks gently, one bit at a time, may prove to be one of the most effective lessons yet.</p>
<p><strong>Subject of Research:</strong> Stable training of binary neural networks through adaptive multi-bit progressive quantization and knowledge distillation</p>
<p><strong>Article Title:</strong> Adaptive multi-bit progressive quantization for stable training of binary neural networks</p>
<p><strong>Article References:</strong> Xu, J., Hwang, W., &amp; Cho, H. (2026). Adaptive multi-bit progressive quantization for stable training of binary neural networks. <em>Multimedia Tools and Applications, 85</em>(9), Article 737. <a href="https://doi.org/10.1007/s11042-026-21900-8" rel="noopener noreferrer">https://doi.org/10.1007/s11042-026-21900-8</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s11042-026-21900-8" rel="noopener noreferrer">10.1007/s11042-026-21900-8</a></p>
<p><strong>Keywords:</strong> binary neural networks, quantization-aware training, knowledge distillation, self-knowledge distillation, structured pruning, model compression, edge AI, CIFAR-10, neural network efficiency, TinyML, deep learning, low-bit inference</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">237952</post-id>	</item>
		<item>
		<title>Tiny AI brain lets a $10 microcontroller remember hidden objects and grab them</title>
		<link>https://scienmag.com/tiny-ai-brain-lets-a-10-microcontroller-remember-hidden-objects-and-grab-them/</link>
		
		<dc:creator><![CDATA[Cassandra Pierce]]></dc:creator>
		<pubDate>Mon, 05 Oct 2026 11:45:48 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[compact AI models for physical tasks]]></category>
		<category><![CDATA[embedded robotics]]></category>
		<category><![CDATA[ESP32]]></category>
		<category><![CDATA[ESP32 microcontroller applications]]></category>
		<category><![CDATA[imitation learning]]></category>
		<category><![CDATA[INT8 quantization]]></category>
		<category><![CDATA[inverse kinematics]]></category>
		<category><![CDATA[inverse kinematics in small robots]]></category>
		<category><![CDATA[low-power AI for robots]]></category>
		<category><![CDATA[LSTM]]></category>
		<category><![CDATA[microcontroller]]></category>
		<category><![CDATA[microcontroller-based AI]]></category>
		<category><![CDATA[neural memory for robotic manipulation]]></category>
		<category><![CDATA[object permanence]]></category>
		<category><![CDATA[object permanence in robotics]]></category>
		<category><![CDATA[object tracking during occlusion]]></category>
		<category><![CDATA[occlusion]]></category>
		<category><![CDATA[recurrent neural networks]]></category>
		<category><![CDATA[robotic manipulation]]></category>
		<category><![CDATA[small-scale AI for autonomous object handling]]></category>
		<category><![CDATA[Tiny-STM neural network]]></category>
		<category><![CDATA[TinyML]]></category>
		<category><![CDATA[vision-based object recognition in constrained hardware]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=237852</guid>

					<description><![CDATA[Researchers have built Tiny-STM, a 68.4-kilobyte LSTM controller with a simple coordinate memory that lets an ESP32 microcontroller track objects through visual occlusion and complete physical pick-and-place tasks with an observed 85 percent success rate.]]></description>
										<content:encoded><![CDATA[<p>Robots that can reason about objects they cannot currently see have long been the preserve of data-center-scale artificial intelligence, with vision-language-action models built on tens of billions of parameters and racks of GPUs. A new open-access study in Discover Informatics now demonstrates a strikingly different approach: a robotic manipulation controller small enough to run entirely on an ESP32 microcontroller, yet capable of tracking objects through visual occlusion and completing physical pick-and-place tasks with an observed success rate of 85 percent. The system, called Tiny-STM, packs a recurrent neural network, an external coordinate memory, and analytical inverse kinematics into just 68.4 kilobytes of quantized model weights.</p>
<p>The core insight behind Tiny-STM is that object permanence, the cognitive ability to understand that things continue to exist when hidden from view, does not require a learned memory mechanism of the kind used in large transformer-based systems. Instead, the researchers, Swarnajit Bhattacharya of National Yang Ming Chiao Tung University in Taiwan and Ian Chao of the University of Washington, paired a standard four-gate Long Short-Term Memory network with a deterministic four-slot coordinate bank. Each slot stores the most recently observed three-dimensional position of one task object. When a cube disappears behind a stack of other blocks, its stored coordinate simply holds steady until the camera sees it again, a scheme the authors describe as a zero-order-hold update rule.</p>
<p>The architecture itself is deliberately conventional. The LSTM takes a seven-dimensional input vector combining the vector from the gripper tip to the target object&#8217;s stored position, the current tip position, and a one-dimensional infrared range reading from a Sharp GP2Y0A41SK0F sensor mounted on the gripper. A hidden state of 128 dimensions feeds a linear output layer that predicts an incremental three-dimensional displacement of the end effector. With 70,019 parameters in total, the network is tiny by modern standards, and after INT8 quantization through the TensorFlow Lite Micro pipeline it occupies just 68.4 KB, a small fraction of the ESP32&#8217;s 520 KB of static RAM.</p>
<p>Training relied on remarkably little data. The authors manually guided a Waveshare 5-DOF RoArm-M3 robotic arm through exactly 30 pick-and-place demonstrations, recording joint angles, cube centroids from a side-mounted camera, and infrared range measurements at each control step. Backpropagation through time with mean-squared-error loss and the Adam optimizer at a learning rate of 0.001 produced the deployed checkpoint. This data efficiency stands in sharp contrast to imitation-learning platforms such as ALOHA, which achieve 80 to 90 percent success on fine-grained bimanual tasks but require roughly ten minutes of teleoperated demonstrations and substantially more powerful compute.</p>
<p>The division of labor between hardware components is a key part of the design. A host PC or single-board computer captures camera frames and performs deterministic color-thresholding segmentation, converting detected pixel centroids into three-dimensional workspace coordinates through a calibrated pinhole camera model. The camera was calibrated with 25 checkerboard images using Zhang&#8217;s method, yielding a mean reprojection error of 0.3 pixels, while camera-to-base extrinsic calibration over 12 known points achieved a root-mean-square alignment error of 1.18 millimeters. The ESP32 then handles everything on the control side: the recurrent forward pass, analytical inverse kinematics, and PWM servo command generation, all in a measured 2.80 milliseconds.</p>
<p>The inverse kinematics routine reduces the five-degree-of-freedom arm problem to a planar three-degree-of-freedom calculation, exploiting the fact that the task uses a top-down grasp with a vertically oriented gripper. Base rotation comes from an arctangent of the target coordinates, while the shoulder and elbow angles follow from two-link geometry via the law of cosines. The authors handle three degenerate cases explicitly: base singularity when the target lies on the rotation axis, arm singularity near full extension where the Jacobian becomes ill-conditioned, and unreachable targets outside the geometric annulus defined by the link lengths, which are simply rejected so the arm retains its previous pose.</p>
<p>Physical evaluation consisted of 20 trials in which the arm sorted four labeled cubes from randomized positions into an ordered arrangement, including a vertical stacking sequence in which the fourth block becomes completely hidden behind the first three before its final grasp. The single deployed INT8 checkpoint completed 17 of 20 trials, an observed success rate of 85.0 percent with a two-sided 95 percent exact binomial confidence interval of 62.1 to 96.8 percent. The authors are careful to note that this interval describes uncertainty in the 20 observed outcomes of one checkpoint, not variability across independently trained models, since the original training seed and stopping rule were not retained.</p>
<p>The three failures are instructive. Mechanical backlash in the servo gearboxes introduced joint-level positional uncertainty of roughly 1.5 to 2.5 millimeters, which can accumulate across joints. Fixed color thresholds proved vulnerable to strong lighting changes and shadows that shifted pixel values out of range, degrading the segmentation masks. And when an occluded object was physically moved while hidden, the stored coordinate became stale, causing the controller to reach toward a position where the object no longer was; the gripper tolerance is approximately 18 millimeters. The authors formalize this limitation in a corollary showing that if an occluded object is displaced, the memory error grows at least in proportion to the displacement.</p>
<p>On latency, the measured ESP32 computation of 2.80 milliseconds combines with the nominal 33.3-millisecond camera period at 30 frames per second, profiled segmentation and Wi-Fi communication times, and a datasheet-based actuator response allowance to yield an aggregated end-to-end latency estimate of 92.6 milliseconds, equivalent to roughly 10.8 hertz. The authors emphasize that this figure is an estimate assembled from components rather than a single timed end-to-end measurement. Peak SRAM usage on the microcontroller was 94.8 KB, or 18.23 percent of capacity, leaving substantial headroom. Offline comparisons suggest the FP32 model would occupy 273.5 KB with an estimated 11.20 milliseconds of inference, underscoring the value of INT8 quantization for embedded deployment.</p>
<p>The study is notable as much for its honesty about boundaries as for its results. The authors explicitly state that no ablation was performed to separate the contribution of the coordinate memory from that of the recurrent state, that no numerical comparison with RT-2, OpenVLA, TinyVLA, or Diffusion Policy is possible given different tasks and hardware, and that the color-thresholding front end was never validated against ground-truth masks. Future work, they write, should include matched ablation studies with multiple training seeds, documented reproducibility protocols, perception validation, tests of behavior when occluded objects are displaced, and scaling experiments beyond four tracked objects. Even so, Tiny-STM offers a compelling demonstration that a form of object permanence can live in 68 kilobytes, bringing occlusion-aware manipulation within reach of the cheapest embedded hardware.</p>
<p><strong>Subject of Research:</strong> Lightweight recurrent neural network controllers with external coordinate memory for occlusion-aware robotic manipulation on microcontrollers</p>
<p><strong>Article Title:</strong> Lightweight LSTM-based memory architecture for occlusion-aware robotic manipulation on microcontrollers</p>
<p><strong>Article References:</strong> Bhattacharya, S., &amp; Chao, I. (2026). Lightweight LSTM-based memory architecture for occlusion-aware robotic manipulation on microcontrollers. <em>Discover Informatics, 1</em>(1), Article 23. <a href="https://doi.org/10.1007/s44564-026-00023-0" rel="noopener noreferrer">https://doi.org/10.1007/s44564-026-00023-0</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s44564-026-00023-0" rel="noopener noreferrer">10.1007/s44564-026-00023-0</a></p>
<p><strong>Keywords:</strong> TinyML, LSTM, robotic manipulation, object permanence, occlusion, ESP32, microcontroller, imitation learning, inverse kinematics, INT8 quantization, embedded robotics, recurrent neural networks</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">237852</post-id>	</item>
		<item>
		<title>Wireless &#8216;WILD&#8217; Device Records and Steers Brain Activity in Freely Roaming Mice</title>
		<link>https://scienmag.com/wireless-wild-device-records-and-steers-brain-activity-in-freely-roaming-mice/</link>
		
		<dc:creator><![CDATA[Cassandra Pierce]]></dc:creator>
		<pubDate>Sat, 12 Sep 2026 12:56:01 +0000</pubDate>
				<category><![CDATA[Biology]]></category>
		<category><![CDATA[advancements in free-roaming animal research]]></category>
		<category><![CDATA[brain activity in freely moving mice]]></category>
		<category><![CDATA[Brain-Computer Interface]]></category>
		<category><![CDATA[challenges in wireless neurotechnology design]]></category>
		<category><![CDATA[closed-loop stimulation]]></category>
		<category><![CDATA[emerging wireless brain interface technology]]></category>
		<category><![CDATA[freely behaving mice]]></category>
		<category><![CDATA[hippocampal sharp-wave ripples]]></category>
		<category><![CDATA[integrated neural data logging and behavior monitoring]]></category>
		<category><![CDATA[lightweight head-mounted neural devices]]></category>
		<category><![CDATA[multi-modal neural recording systems]]></category>
		<category><![CDATA[naturalistic behavior studies in mice]]></category>
		<category><![CDATA[Nature Methods]]></category>
		<category><![CDATA[neuroethology]]></category>
		<category><![CDATA[optogenetic stimulation in rodents]]></category>
		<category><![CDATA[optogenetics]]></category>
		<category><![CDATA[place cells]]></category>
		<category><![CDATA[social behavior]]></category>
		<category><![CDATA[TinyML]]></category>
		<category><![CDATA[ultrasonic audio capture for animal behavior]]></category>
		<category><![CDATA[ultrasonic vocalizations]]></category>
		<category><![CDATA[wireless motion tracking in neuroscience]]></category>
		<category><![CDATA[wireless neural recording]]></category>
		<category><![CDATA[wireless neurorecording]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=194543</guid>

					<description><![CDATA[Cornell researchers have developed WILD, a lightweight wireless platform that records brain activity, movement, vocalizations and eye movements in freely behaving mice while delivering closed-loop optogenetic stimulation in real time.]]></description>
										<content:encoded><![CDATA[<p>For decades, neuroscientists have faced an uncomfortable trade-off: the equipment that lets them eavesdrop on the brain has too often prevented animals from behaving like themselves. Tethered recording systems, for all their fidelity, anchor a mouse to a cable, restricting the very movements, social encounters and exploratory drives that researchers hope to understand. A team at Cornell University has now unveiled a device designed to dissolve that compromise. Called WILD, for Wireless, Interactive, Lightweight Datalogger, the platform combines neural recording, optogenetic stimulation, motion tracking, ultrasonic audio capture and a head-mounted camera in a single package small enough for a mouse to wear while chasing, sniffing and fighting with its cage mates, both in the laboratory and outdoors.</p>
<p>The engineering challenge behind WILD is formidable. A mouse weighs roughly 25 grams, and any head-mounted payload above a few grams measurably alters its natural behavior. Earlier wireless loggers managed to record neural activity but sacrificed bandwidth, battery life or the ability to stimulate the brain in response to what the animal was doing. WILD addresses these constraints through a modular architecture built around a high-efficiency power system that accepts a wide input range of 1.6 to 5.5 volts and generates isolated supplies for its analog and digital subsystems. At its core sits a Cortex-M4 microcontroller paired with a Bluetooth Low Energy radio, a microSD card for onboard storage, and acquisition circuits that include a neural amplifier, a nine-axis inertial measurement unit, a camera and an ultrasonic microphone.</p>
<p>The device&#8217;s wireless performance is a key part of its appeal. Using the onboard antenna, WILD maintains stable communication with a host laptop at distances of up to 70 meters, a range that opens the door to experiments in large arenas and outdoor enclosures rather than cramped laboratory mazes. Clock synchronization between the device and the host computer is handled through a careful calibration procedure: the crystal oscillator is first tuned, then time-of-flight estimation aligns the device clock with the PC, and continuous refinement keeps the estimated clock error near zero, at 0.0 plus or minus 4.3 milliseconds. Once calibrated, the device no longer needs a persistent wireless link, which means researchers can record from more animals simultaneously than the typical seven-device Bluetooth connection limit would otherwise allow.</p>
<p>On the recording side, WILD supports flexible polymer neural probes as well as standard 64-channel silicon probes, achieving noise levels comparable to benchtop tethered systems. In head-to-head comparisons with the widely used Intan RHD2000 platform, the root-mean-square noise of WILD channels was statistically indistinguishable, and local field potential spectra recorded during sleep matched those of tethered hardware. Single units recorded through flexible probes remained stable over nine days, with spike waveforms and firing rates consistent across the transition from tethered to wireless operation. The platform also scales up: the authors demonstrated 128-channel recordings at 20,000 samples per second in rats exploring an outdoor enclosure, along with a roughly 12-hour low-rate recording session, illustrating the device&#8217;s flexibility across species and experimental timescales.</p>
<p>Perhaps the most consequential feature of WILD is its onboard signal processing. The device embeds a neural signal processor that detects band-limited signatures of brain activity, from delta and theta oscillations to gamma rhythms and hippocampal sharp-wave ripples, with a processing delay of just 5.56 microseconds. A Hilbert-transform-based detection mode reduces latency further, and receiver operating characteristic analysis shows the onboard ripple detector performs nearly as well as a curated offline detector, with area under the curve values above 0.97. This speed and accuracy make genuine closed-loop experiments possible: the device can detect a specific neural event or behavioral motif in real time and trigger optogenetic stimulation within the tight temporal window that causal neuroscience demands.</p>
<p>Closed-loop capability extends beyond neural events to behavior itself. WILD runs compact TinyML machine learning models that classify social behaviors, such as sniffing, chasing, fighting and tail rattling, directly on the device, allowing stimulation to be contingent on what the animal is actually doing rather than on an experimenter&#8217;s judgment from a video feed. The inertial measurement unit feeds a gravity-constrained model that predicts locomotion speed, acceleration and head angular velocity with high fidelity against ground-truth tracking, meaning the logger can reconstruct movement even when overhead cameras are unavailable. In validation tests, stimulation could be targeted to precise theta phases, with the distribution of real-time stimulation phases clustering within the requested 30 to 45 degree window across more than 15,000 events.</p>
<p>To demonstrate what the platform makes possible, the Cornell team deployed WILD on groups of socially interacting mice. In male-male and male-female encounters, the devices simultaneously captured hippocampal activity, pupil dynamics from the integrated eye camera, ultrasonic vocalizations and movement trajectories. The data revealed physiological signatures tied to specific social behaviors: pupil diameter contracted when a mouse looked at a partner and dilated during approach, while ultrasonic call rates soared during male-female interactions compared with male-male ones, with over 3,000 calls detected in a single set of sessions. The entropy of a male&#8217;s vocal repertoire increased with distance from his partner, suggesting that mice deploy more varied calls when farther apart, a finding that would have been difficult to obtain without head-mounted microphones tracking each individual&#8217;s output.</p>
<p>The team also took WILD outside. In an outdoor enclosure tracked by ultra-wideband positioning, multiple mice wearing the devices were recorded simultaneously across night-long sessions, yielding more than 1,600 identified place cells whose firing fields could be mapped in a naturalistic environment. Place cells, the hippocampal neurons that encode location, have historically been studied in sterile laboratory arenas; recording them as animals navigate real terrain under open sky brings neuroscience closer to the conditions in which these circuits evolved. The wireless condition also changed the animals&#8217; behavior in measurable ways: tethered mice showed reduced spatial coverage and altered speed distributions during social interactions, while wirelessly recorded animals behaved much like unimplanted controls, confirming that the cable itself, not the implant, was distorting natural behavior.</p>
<p>The implications reach well beyond social neuroscience. Because WILD is open source, with design files, source code, compiled binaries and a full manual released under a GPL-3.0 license on GitHub, and datasets deposited on Zenodo, laboratories anywhere can adopt, modify and extend the platform without proprietary barriers. The authors suggest applications ranging from studies of memory consolidation during sleep, where sharp-wave ripples play a central role, to investigations of navigation, vocal communication and psychiatric-relevant behaviors in semi-natural environments. By fusing multimodal sensing, onboard artificial intelligence and bidirectional brain interfacing in a package light enough for a mouse to forget, WILD signals a shift in systems neuroscience: from observing the brain under constrained conditions to interrogating it, and even steering it, in the wild.</p>
<p><strong>Subject of Research:</strong> A wireless modular neuro-behavioral recording and closed-loop optogenetic platform for small animals</p>
<p><strong>Article Title:</strong> A wireless modular platform for neuro-behavioral recording and closed-loop manipulation in small animals</p>
<p><strong>Article References:</strong> Zhao, Z., Chang, H., Paudel, P., Park, J., Liu, C., Aurelio, M. Q., Oliva, A., &amp; Fernandez-Ruiz, A. (2026). A wireless modular platform for neuro-behavioral recording and closed-loop manipulation in small animals. <em>Nature Methods</em>. <a href="https://doi.org/10.1038/s41592-026-03220-9" rel="noopener noreferrer">https://doi.org/10.1038/s41592-026-03220-9</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1038/s41592-026-03220-9" rel="noopener noreferrer">10.1038/s41592-026-03220-9</a></p>
<p><strong>Keywords:</strong> wireless neurorecording, optogenetics, closed-loop stimulation, freely behaving mice, hippocampal sharp-wave ripples, social behavior, TinyML, neuroethology, place cells, ultrasonic vocalizations, brain-computer interface, Nature Methods</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">194543</post-id>	</item>
	</channel>
</rss>
