<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>channel attention &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/channel-attention/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Sun, 20 Sep 2026 23:33:47 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.1</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>channel attention &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>New Kolmogorov–Arnold AI Reads Brainwaves in Milliseconds on a Raspberry Pi</title>
		<link>https://scienmag.com/new-kolmogorov-arnold-ai-reads-brainwaves-in-milliseconds-on-a-raspberry-pi/</link>
		
		<dc:creator><![CDATA[Cassandra Pierce]]></dc:creator>
		<pubDate>Sun, 20 Sep 2026 23:33:47 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[biomedical engineering]]></category>
		<category><![CDATA[biomedical engineering innovation]]></category>
		<category><![CDATA[brain-computer interface technology]]></category>
		<category><![CDATA[brainwave decoding]]></category>
		<category><![CDATA[channel attention]]></category>
		<category><![CDATA[deep learning]]></category>
		<category><![CDATA[deep learning for EEG]]></category>
		<category><![CDATA[driver fatigue detection]]></category>
		<category><![CDATA[edge AI]]></category>
		<category><![CDATA[EEG classification variability]]></category>
		<category><![CDATA[EEG signal classification]]></category>
		<category><![CDATA[EEG signal processing]]></category>
		<category><![CDATA[EEG signal variability challenges]]></category>
		<category><![CDATA[electroencephalography hardware]]></category>
		<category><![CDATA[Internet of Medical Things]]></category>
		<category><![CDATA[Kolmogorov–Arnold networks]]></category>
		<category><![CDATA[lightweight neural networks on Raspberry Pi]]></category>
		<category><![CDATA[machine learning in neuroscience]]></category>
		<category><![CDATA[portable brainwave monitoring]]></category>
		<category><![CDATA[Raspberry Pi]]></category>
		<category><![CDATA[real-time brainwave analysis]]></category>
		<category><![CDATA[real-time inference]]></category>
		<category><![CDATA[SEED-VIG]]></category>
		<category><![CDATA[Sobel filtering]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=203932</guid>

					<description><![CDATA[A new deep learning framework called EEG-SDL-Net combines Kolmogorov–Arnold networks, Sobel-based temporal enhancement, and channel attention to classify EEG signals with state-of-the-art accuracy in just 15 milliseconds on a Raspberry Pi 4.]]></description>
										<content:encoded><![CDATA[<p>Electroencephalography has long promised a direct window into the human brain, but turning the noisy, drifting electrical signals picked up by scalp electrodes into reliable, real-time decisions has remained one of the stubborn challenges of biomedical engineering. Now a researcher at Kairouan University in Tunisia has unveiled a deep learning architecture that may bring that promise considerably closer to everyday clinical and consumer use. The new framework, called EEG-SDL-Net, was described in a study published in Biomedical Engineering Letters and combines several cutting-edge ideas from modern machine learning into a single pipeline designed from the ground up to run on small, inexpensive hardware.</p>
<p>The central problem the study tackles is variability. EEG signals differ dramatically between individuals, between recording sessions, and even from one moment to the next within a single session, because factors such as electrode placement, skin impedance, drowsiness, and mental state all leave their fingerprints on the waveform. Traditional classification pipelines, which rely on hand-crafted features such as band power or spectral ratios fed into classical classifiers like support vector machines, often struggle to generalize across this variability. Deep convolutional networks have improved matters, but they can be computationally heavy, which makes them awkward to deploy on the portable, low-power devices that real-world brain monitoring increasingly demands.</p>
<p>EEG-SDL-Net addresses these issues with a hierarchical architecture built around one-dimensional convolutional neural networks, which process the EEG time series directly rather than treating it as an image. The first distinctive component is a one-dimensional Sobel projection module. The Sobel operator, borrowed from image processing where it is used to detect edges, is applied along the temporal axis of each EEG channel to sharpen local gradients in the signal. In effect, the module highlights rapid transitions in brain electrical activity that might otherwise be diluted by averaging operations in early convolutional layers, giving the network a richer representation of the fine-grained temporal dynamics that distinguish, for example, an alert brain from a fatigued one.</p>
<p>The second component is a channel-wise attention mechanism inspired by squeeze-and-excitation networks. EEG systems record from many electrodes simultaneously, but not all electrodes carry equally useful information for a given task. The attention block learns to weight each channel adaptively, effectively letting the network decide which electrodes deserve emphasis for the classification at hand. This adaptive electrode selection improves robustness, because the model can down-weight noisy or uninformative channels rather than treating every input as equally trustworthy. It also offers a degree of interpretability, since the learned channel weights can reveal which scalp regions contribute most to a decision.</p>
<p>The most conceptually novel ingredient, however, is the use of Kolmogorov–Arnold Networks, or KAN, a relatively new neural architecture that has generated considerable excitement since its introduction. Unlike conventional multilayer perceptrons, which place fixed activation functions on nodes and learn weights on edges, KANs place learnable activation functions on the edges of the network itself. This design is rooted in the Kolmogorov–Arnold representation theorem, which states that any multivariate continuous function can be expressed as a composition of univariate functions. In practice, KANs can capture complex nonlinear relationships with comparatively compact structures, which suits EEG data well: the mapping from raw voltage fluctuations to cognitive states is highly nonlinear, and a network that can learn flexible univariate transformations along each connection may model it more efficiently than a stack of standard layers.</p>
<p>Training deep networks on noisy biomedical data is notoriously unstable, and the fourth pillar of the framework tackles that directly. EEG-SDL-Net employs multi-level deep supervision, a strategy in which auxiliary classification outputs are attached at intermediate layers of the network rather than only at the end. Each of these auxiliary heads contributes to the loss during training, so gradient signals reach the early layers through shorter paths. This combats vanishing gradients, encourages intermediate features to be discriminative in their own right, and generally stabilizes optimization. The idea traces back to deeply-supervised networks research, and the study demonstrates that applying it across the hierarchical convolutional backbone yields more reliable convergence on EEG data.</p>
<p>To evaluate the framework, the author used SEED-VIG, a widely used public dataset for vigilance estimation containing EEG recordings collected as participants watched movies over long sessions, with continuous labels of alertness. According to the study, EEG-SDL-Net achieved superior classification accuracy compared with state-of-the-art methods on this benchmark, outperforming approaches that range from hand-crafted spectral features to graph convolutional networks and attention-based capsule architectures. The comparison matters because vigilance estimation is one of the most demanding EEG tasks: the target variable drifts slowly, the signal-to-noise ratio is low, and models must generalize across subjects whose brain rhythms differ substantially.</p>
<p>Perhaps the most striking result, and the one most likely to shape practical adoption, concerns deployment. The study benchmarked the trained model on a Raspberry Pi 4, a credit-card-sized single-board computer costing a few tens of dollars, and measured a real-time inference latency of just 15 milliseconds per classification. That is fast enough to support continuous monitoring applications in the Internet of Medical Things, or IoMT, where wearable or bedside devices must interpret brain signals as they arrive rather than streaming them to a distant server. Driver fatigue detection is a leading use case: road safety statistics from the World Health Organization underscore the toll of drowsy driving, and an EEG-based system that can flag declining vigilance within milliseconds, entirely on-device, could one day sit inside a cap or headband without requiring cloud connectivity.</p>
<p>The efficiency of the design reflects deliberate engineering choices at every level. The Sobel projection sharpens features without adding much computation, the attention mechanism prunes irrelevant information early, and the KAN layers provide expressive nonlinear modeling without the parameter count of a large transformer or recurrent network. Together these choices produce a model that is simultaneously accurate and lightweight, a combination that has often eluded EEG classifiers, which tend to trade one for the other. The author also emphasizes reproducibility: the complete source code, hardware deployment scripts, pipeline documentation, and reproducibility protocols have been released openly on GitHub and permanently archived on Zenodo, allowing other groups to verify the results and adapt the pipeline to their own datasets.</p>
<p>The broader significance of the work lies in what it suggests about the direction of biomedical signal processing. The rise of Kolmogorov–Arnold networks signals a willingness to revisit the mathematical foundations of neural architecture design rather than simply scaling up existing templates, and their pairing with classic techniques such as Sobel filtering and deep supervision shows how new and old ideas can be layered productively. If the accuracy and latency figures reported on SEED-VIG carry over to other EEG tasks, such as emotion recognition, sleep staging, or brain-computer interface control, the result could be a new generation of portable neurotechnology that is both smarter and cheaper than what came before. For now, the study stands as a compelling demonstration that state-of-the-art brain signal classification no longer requires a data center; it can fit in the palm of a hand, running quietly on hardware small enough to tuck into a pocket, and respond to the rhythms of the brain faster than a single blink.</p>
<p><strong>Subject of Research:</strong> A supervised deep learning framework using Kolmogorov–Arnold networks for real-time biomedical EEG signal classification on edge devices</p>
<p><strong>Article Title:</strong> EEG-SDL-Net: biomedical EEG signal classification via multi-level supervised Kolmogorov–Arnold networks</p>
<p><strong>Article References:</strong> EEG-SDL-Net: biomedical EEG signal classification via multi-level supervised Kolmogorov–Arnold networks. (n.d.). <a href="https://doi.org/10.1007/s13534-026-00618-4" rel="noopener noreferrer">https://doi.org/10.1007/s13534-026-00618-4</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s13534-026-00618-4" rel="noopener noreferrer">10.1007/s13534-026-00618-4</a></p>
<p><strong>Keywords:</strong> EEG signal classification, Kolmogorov–Arnold networks, deep learning, Edge AI, Internet of Medical Things, channel attention, Sobel filtering, SEED-VIG, driver fatigue detection, real-time inference, biomedical engineering, Raspberry Pi</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">203932</post-id>	</item>
		<item>
		<title>Lightweight AI Network Reads Brain Scans to Spot Alzheimer&#8217;s and Tumors With Striking Accuracy</title>
		<link>https://scienmag.com/lightweight-ai-network-reads-brain-scans-to-spot-alzheimers-and-tumors-with-striking-accuracy/</link>
		
		<dc:creator><![CDATA[Cassandra Pierce]]></dc:creator>
		<pubDate>Sat, 12 Sep 2026 19:20:31 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[AI for early detection of Alzheimer’s and brain tumors]]></category>
		<category><![CDATA[AI-powered brain scan analysis]]></category>
		<category><![CDATA[Alzheimer's disease]]></category>
		<category><![CDATA[attention mechanism]]></category>
		<category><![CDATA[Bayesian optimization]]></category>
		<category><![CDATA[brain tumor]]></category>
		<category><![CDATA[channel attention]]></category>
		<category><![CDATA[clinical implementation of AI in radiology]]></category>
		<category><![CDATA[compact neural networks in healthcare]]></category>
		<category><![CDATA[computer-aided diagnosis]]></category>
		<category><![CDATA[deep learning]]></category>
		<category><![CDATA[deep learning model size comparison in medical AI]]></category>
		<category><![CDATA[efficient tumor classification using MRI]]></category>
		<category><![CDATA[Grad-CAM]]></category>
		<category><![CDATA[high-accuracy neurological disease diagnosis]]></category>
		<category><![CDATA[lightweight deep learning models for medical imaging]]></category>
		<category><![CDATA[medical image classification with minimal parameters]]></category>
		<category><![CDATA[Medical Imaging]]></category>
		<category><![CDATA[MRI classification]]></category>
		<category><![CDATA[neural network architecture for neurological disorder diagnosis]]></category>
		<category><![CDATA[residual attention networks for Alzheimer’s detection]]></category>
		<category><![CDATA[residual network]]></category>
		<category><![CDATA[scalable AI solutions for healthcare settings]]></category>
		<category><![CDATA[spatial attention]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=197796</guid>

					<description><![CDATA[Researchers have developed a compact four-block residual attention network that classifies Alzheimer's disease and brain tumors from MRI scans with up to 98.5 percent accuracy while using a fraction of the parameters of larger models.]]></description>
										<content:encoded><![CDATA[<p>A team of researchers has unveiled a compact deep learning architecture that can classify two of the world&#8217;s most burdensome neurological conditions—Alzheimer&#8217;s disease and brain tumors—directly from magnetic resonance imaging scans, achieving accuracy of 96.8 percent on an Alzheimer&#8217;s dataset and 98.5 percent on a benchmark brain tumor collection. The study, published in the journal Cognitive Computation, describes a four-block residual attention network that is dramatically smaller than the heavyweight models that dominate medical image analysis, yet outperforms many of them. With only 115 layers and 6.3 million parameters packed into 22.17 megabytes, the model is a fraction of the size of giants such as DenseNet201, ResNet101, and NasNetLarge, which carry tens or even hundreds of millions of parameters and footprints measured in hundreds of megabytes. That efficiency matters, because the future of artificial intelligence in medicine depends less on raw accuracy alone and more on whether accurate models can actually run inside clinics, on ordinary hardware, and alongside time-pressed radiologists.</p>
<p>The clinical backdrop is sobering. Alzheimer&#8217;s disease accounts for roughly 60 to 70 percent of all dementia cases, and the World Health Organization estimates there were around 57 million people living with dementia globally in 2021, with nearly 10 million new cases diagnosed each year and projections suggesting 82 million cases by 2030. Brain tumors, meanwhile, remain a formidable oncological challenge: approximately 29,000 new cases are detected in the United States annually, with about 13,000 deaths, and brain and central nervous system cancers ranked as the nineteenth most common malignancy worldwide in the latest GLOBOCAN 2022 estimates. Despite these numbers, the diagnostic toolkit is limited. Confirming Alzheimer&#8217;s pathology typically requires either an expensive PET scan or an invasive lumbar puncture, while interpretation of MRI scans remains a manual, laborious, and error-prone process that stalls when radiologists are unavailable.</p>
<p>The new architecture, developed by Wardah Ibrar, Muhammad Attique Khan, Syeda Aimal Naqvi, Zain Hussain, Latifah Almuqren, Amina Hussain, Mohammad Alhefdi, and senior author Yunyoung Nam, is built on the idea that a network should not treat every pixel and every feature channel of an MRI equally. Instead, the model embeds two complementary attention mechanisms into each of its four residual blocks: a channel attention module, abbreviated CAMB, and a spatial attention module, abbreviated SAMB. Channel attention asks which feature channels—the abstract patterns the network has learned to detect—matter most for a given scan, while spatial attention asks where in the image the informative regions lie. Together they let the network dynamically amplify relevant signals and suppress noise, a critical capability when the distinguishing signatures of gliomas, meningiomas, pituitary tumors, and Alzheimer&#8217;s-related atrophy are subtle and frequently overlapping.</p>
<p>Technically, the channel attention module begins with global average pooling and global max pooling applied in parallel to the convolutional feature maps, feeding both into a shared multilayer perceptron with fully connected layers of 64 and then 32 filters, followed by a sigmoid activation that produces per-channel weights. The spatial module concatenates the average-pooled and max-pooled maps, passes them through a 7-by-7 convolution and a sigmoid, and returns a spatial importance map that is multiplied back onto the features. Each block follows a residual design—pairs of convolutional layers with ReLU activation and batch normalization, with depths stepping up from 32 to 64, then 128, 256, and finally 512—so that the attention-refined features are added back to the original inputs, easing gradient flow and improving generalization. A final 1024-depth convolution, a GELU activation, global average pooling, and a softmax classifier complete the pipeline, which is trained with categorical cross-entropy loss.</p>
<p>Notably, the team refused to guess its own hyperparameters. Learning rate, momentum, optimizer, epochs, and batch size were all selected through Bayesian optimization, a technique that treats training as a black-box function to be maximized using a Gaussian process surrogate and an expected improvement acquisition function. The search settled on an initial learning rate of 0.000206, a momentum of 0.710, thirty epochs, a batch size of 128, and the ADAM optimizer. Training and testing were performed in MATLAB 2025b on a workstation equipped with a 32-gigabyte graphics card and 128 gigabytes of RAM, using a 70:30 train-test split and ten-fold cross-validation on both datasets.</p>
<p>The evaluation relied on two widely used public collections. The Figshare brain tumor dataset contains 3,064 T1-contrast-enhanced MR images from 233 patients, covering three tumor types—1,426 glioma, 708 meningioma, and 930 pituitary images—acquired in coronal, axial, and sagittal planes at Nanfang Hospital in Guangzhou and Tianjin Medical University Hospital in China. The Alzheimer&#8217;s MRI dataset, drawn from Kaggle, comprises 6,400 images across four classes: non-demented, very mildly demented, mildly demented, and moderately demented. Because medical datasets of this kind are chronically imbalanced, the researchers applied augmentation only to training samples, rotating, flipping, zooming, cropping, and translating images to synthesize new views and rebalance the classes, before resizing everything to 227 by 227 pixels.</p>
<p>The results were decisive. On the Figshare dataset, the softmax classifier achieved 98.5 percent accuracy with 98.5 percent sensitivity, 98.36 percent precision, an area under the curve of 0.9954, and an F1 score of 98.43 percent; wide, narrow, bi-layered, and tri-layered neural network classifiers applied to extracted deep features followed closely, scoring between 97.2 and 98.4 percent. On the Alzheimer&#8217;s data, softmax again led with 96.8 percent accuracy, 96.77 percent precision, and an AUC of 0.9973. Ablation studies confirmed that four blocks were the optimal depth—models with two, three, or five blocks trained less efficiently—and that the attention modules are genuinely complementary: the baseline network without attention scored 94.21 percent on Figshare, rising to 95.95 percent with channel attention alone, 96.15 percent with spatial attention alone, and 98.53 percent with both, a gain of more than four percentage points over the baseline.</p>
<p>Head-to-head comparisons reinforced the point. GoogleNet managed only 83.0 and 88.9 percent on the Alzheimer&#8217;s and Figshare datasets respectively, ResNet101 scored 86.0 and 89.0 percent, DenseNet201 reached 89.9 and 91.6 percent, and NasNetLarge topped out at 92.0 and 93.0 percent—while carrying parameters and file sizes far exceeding the proposed network. Recent specialized competitors, including an attention-enhanced vision transformer at 94.2 percent, a hybrid network at 96.01 percent, and an inverted self-attention model at 96.1 percent, were also surpassed. Crucially for clinical trust, the team used Grad-CAM and Grad-CAM++ visualizations to show exactly which regions of each scan drove the model&#8217;s predictions, with the richer Grad-CAM++ maps offering clearer insight into disease-relevant anatomy.</p>
<p>The authors envision the system as a second-opinion tool embedded in real clinical workflows: a suspected patient&#8217;s MRI would be resized, normalized, and fed to the model, which would return a predicted class—glioma, meningioma, or pituitary tumor; or one of four dementia stages—together with a confidence score and attention-based visualizations. Agreement with the radiologist would strengthen diagnostic confidence, while disagreement would flag the case for expert review. Thanks to its small parameter count and 22.17 megabyte footprint, the network is lightweight enough for prototype integration into clinical decision-support systems on modest hardware. The team notes that future work will replace the attention blocks with state-space modules and validate the architecture on additional MRI datasets, but the current results already sketch a compelling vision: hospital-grade diagnostic AI that fits in a few dozen megabytes yet sees the brain with expert-level precision.</p>
<p><strong>Subject of Research:</strong> Deep learning classification of Alzheimer&#x27;s disease and brain tumors from MRI scans using a channel-spatial residual attention network</p>
<p><strong>Article Title:</strong> A Novel Channel-Spatial Deep Residual Attention Network for the Classification of Neurodegenerative Diseases from MRI Scans</p>
<p><strong>Article References:</strong> A Novel Channel-Spatial Deep Residual Attention Network for the Classification of Neurodegenerative Diseases from MRI Scans. (n.d.). <a href="https://doi.org/10.1007/s12559-026-10652-0" rel="noopener noreferrer">https://doi.org/10.1007/s12559-026-10652-0</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s12559-026-10652-0" rel="noopener noreferrer">10.1007/s12559-026-10652-0</a></p>
<p><strong>Keywords:</strong> deep learning, Alzheimer&#x27;s disease, brain tumor, MRI classification, attention mechanism, residual network, channel attention, spatial attention, Bayesian optimization, computer-aided diagnosis, Grad-CAM, medical imaging</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">197796</post-id>	</item>
	</channel>
</rss>
