<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>SSIM &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/ssim/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Sun, 18 Oct 2026 11:28:46 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>SSIM &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>New Transparent Metric EDOKS Judges Image Similarity the Way Human Eyes Do</title>
		<link>https://scienmag.com/new-transparent-metric-edoks-judges-image-similarity-the-way-human-eyes-do/</link>
		
		<dc:creator><![CDATA[Denise Maddox]]></dc:creator>
		<pubDate>Sun, 18 Oct 2026 11:28:46 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[AI image evaluation]]></category>
		<category><![CDATA[BAPPS dataset]]></category>
		<category><![CDATA[Earth Mover's Distance]]></category>
		<category><![CDATA[EDOKS]]></category>
		<category><![CDATA[EDOKS image similarity measure]]></category>
		<category><![CDATA[explainable AI]]></category>
		<category><![CDATA[Gabor filters]]></category>
		<category><![CDATA[human perception of image similarity]]></category>
		<category><![CDATA[human vs machine image judgment]]></category>
		<category><![CDATA[image compression evaluation]]></category>
		<category><![CDATA[image processing]]></category>
		<category><![CDATA[image quality assessment]]></category>
		<category><![CDATA[Image similarity metrics]]></category>
		<category><![CDATA[LPIPS]]></category>
		<category><![CDATA[machine learning for image quality]]></category>
		<category><![CDATA[Oklab color space]]></category>
		<category><![CDATA[perceptual image quality assessment]]></category>
		<category><![CDATA[perceptual patch similarity dataset]]></category>
		<category><![CDATA[perceptual similarity]]></category>
		<category><![CDATA[PSNR]]></category>
		<category><![CDATA[PSNR and SSIM limitations]]></category>
		<category><![CDATA[SSIM]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=305554</guid>

					<description><![CDATA[Researchers in Naples have developed EDOKS, a transparent image similarity metric that combines Earth Mover's Distance texture analysis with Oklab color comparison to match human perception while providing explainable heatmaps.]]></description>
										<content:encoded><![CDATA[<p>For decades, two workhorse numbers have quietly governed how the digital world judges pictures: the peak signal-to-noise ratio, known as PSNR, and the structural similarity index measure, or SSIM. Every time an engineer evaluates a lossy compression algorithm, a super-resolution network, or an image-generating artificial intelligence, one of these scores usually decides whether the output counts as faithful. Yet a growing body of evidence shows that neither metric actually agrees with what human eyes consider similar. In one striking example from the Berkeley-Adobe Perceptual Patch Similarity dataset, PSNR and SSIM both declared that a reference photograph was more similar to a distorted image on the right, while a panel of five human judges unanimously chose the distorted image on the left. The machines, in other words, were confidently wrong.</p>
<p>A team of Italian researchers led by Antonio Di Marino and Vincenzo Bevilacqua of the Institute for High-Performance Computing and Networking at Italy&#8217;s National Research Council, working with colleagues at the University of Naples Federico II and the University of Naples Parthenope, has now proposed a way out of this impasse. In a study published in Discover Artificial Intelligence, they introduce EDOKS, short for Earth mover&#8217;s Distance and Oklab Similarity, a full-reference image quality metric that is both perceptually grounded and fully transparent. Unlike the deep neural network metrics that currently dominate perceptual benchmarks, EDOKS contains no learned parameters at all. Every step of its computation can be inspected, and it hands users pixel-level maps showing exactly where two images differ in texture and in color.</p>
<p>The problem with the incumbents runs deeper than a single bad example. PSNR is built on the mean squared error between pixel values, a measure that Wang and colleagues famously dismantled by showing that images with identical MSE values can look wildly different to a human observer. Because PSNR is derived directly from MSE, it inherits every one of those failures. SSIM was designed as a perceptual alternative, comparing luminance, contrast and structure, but subsequent analyses have exposed its own quirks. Horé and Ziou demonstrated a direct mathematical relationship between PSNR and SSIM, showing that one can be derived from the other, while Nilsson and Akenine-Möller showed that SSIM can produce undefined and non-intuitive results, concluding that the metric is being used for far more than it was ever created for. Despite this, both remain de facto standards across the field.</p>
<p>At the other end of the spectrum sit the deep perceptual metrics, chief among them LPIPS, which measures distance between images in the feature space of a network pretrained on visual recognition tasks. These metrics correlate strongly with human judgment, but they are black boxes. When LPIPS assigns a score, no one can point to the specific regions or visual features that drove the number. That opacity has become more than an academic nuisance. Emerging artificial intelligence regulation, including transparency requirements in the European Union&#8217;s AI framework, increasingly demands that automated assessments be explainable. A similarity score that cannot be justified is a liability in any regulated pipeline, whether it certifies compressed medical imagery or audits the output of a generative model.</p>
<p>EDOKS attacks the problem by decomposing perceptual dissimilarity into two interpretable terms, one for texture and one for color. The texture term begins by converting the image to grayscale and dividing it into patches of 128 by 128 pixels. Each patch is passed through a dictionary of 24 Gabor filters, Gaussian-modulated sinusoids at four scales and six orientations spanning 0 to 150 degrees. Gabor filters are a natural choice because they closely model the receptive fields of simple cells in the visual cortex, offering optimal joint localization in space and frequency. The energy of each filter response is computed, producing a four-by-six matrix per patch that captures how strongly the patch responds at every scale and orientation combination.</p>
<p>Those per-patch energy matrices are then compressed into a compact signature using a Meng-Hee Heng clustering algorithm, a greedy max-min procedure that automatically determines the number of centroids rather than requiring the user to guess. Each centroid represents a texture pattern that appears frequently in the image, and each weight records how often it occurs. Comparing two images then reduces to computing the Earth Mover&#8217;s Distance between their signatures, a measure rooted in the Monge-Kantorovich optimal transport problem. Conceptually, one distribution is a pile of earth and the other a set of holes, and the distance is the minimum work needed to move the earth and fill the holes. Because the signatures are variable in size and the distance is cross-bin, matching similar texture prototypes across images while tolerating small shifts, the researchers argue it is ideally suited to texture comparison, and they note that EMD has not previously been used this way as a texture term in full-reference quality assessment.</p>
<p>The color term addresses a blind spot that trips up many luminance-only metrics. EDOKS converts both images into the Oklab perceptual color space, designed to be perceptually uniform and linear in hue, and then computes the average Euclidean distance between corresponding pixels. The choice of color space matters enormously. CIE XYZ is perceptually non-uniform, CIE Lab misrepresents hues in the blue region, and alternatives such as IPT or CAM16-USC sacrifice uniformity or numerical stability. Oklab, by contrast, offers closed-form analytic transforms requiring no lookup tables, perceptually orthogonal coordinates, and the best available approximation to the Munsell color system. Because the space is perceptually uniform, a fixed Euclidean step corresponds to an approximately constant perceived color difference, making the distance itself a perceptual feature rather than a mere numerical artifact.</p>
<p>The two terms are fused into a single index through a weighted combination controlled by an explicit parameter alpha, with the default set at 0.5 so that texture and color contribute equally. The result is converted to a similarity score by taking the reciprocal of the combined dissimilarity. Crucially, the two terms remain separately available as pixel-level heatmaps. The texture map highlights where the two images differ in shape and structure, while the color map highlights chromatic discrepancies. In validation experiments on the BAPPS dataset, which includes traditional distortions, artifacts generated by convolutional neural networks, and geometric warps, EDOKS outperformed all tested low-level full-reference competitors on both the JND and 2AFC subsets, achieving a ratio of 1.37 between its scores on pairs judged same versus not same by human juries, a separation comparable to that of deep metrics. On the JND subset it attained the best Spearman, Kendall and Pearson correlations among handcrafted metrics, well above PSNR and SSIM, and closest to PieAPP among the deep competitors.</p>
<p>The interpretability of the metric is not an abstract virtue; it catches failures that would otherwise be invisible. In one test case, a red-bordered no-entry sign for bicycles was compared with a blue mandatory sign for cycle paths, two images whose opposite meanings would create a genuine road safety hazard. Metrics including SSIM, PSNR-HVSM, VIF and DSS assigned the pair a maximum similarity score, effectively declaring the signs identical. The reason is that these metrics convert color to grayscale using the ITU-R BT.601 standard, under which that particular shade of red and that shade of blue collapse to the same luminance. EDOKS, by contrast, detected no shape distortion but clearly flagged the color difference in its Oklab heatmap, producing a similarity score of 13.511 and visible evidence for why the images differ.</p>
<p>The computational cost of this transparency is modest. The Oklab conversion and per-pixel distances scale linearly with pixel count, the 24 Gabor convolutions are parallelized across cores, and the dominant cost is the clustering step, which grows cubically with the number of patches. At 1080p resolution, EDOKS runs faster than MS-SSIM and PieAPP and comparably to VIF and DISTS, while remaining slower than the cheapest luminance metrics such as PSNR and GMSD. The authors regard that overhead as the price of explainability: no GPU, no learned weights, no training, and two localized evidence maps that no fast luminance metric can provide. As generative AI systems proliferate and regulators demand verifiable evidence behind automated judgments, a metric that can show its work, rather than merely assert a number, may prove to be exactly what the field has been missing.</p>
<p><strong>Subject of Research:</strong> A transparent full-reference image quality assessment metric combining Earth Mover&#x27;s Distance texture signatures and Oklab color distances</p>
<p><strong>Article Title:</strong> A new image similarity metric for a perceptual and transparent geometric and chromatic assessment</p>
<p><strong>Article References:</strong> Marino, A. D., Bevilacqua, V., Nardo, E. D., Ciaramella, A., Falco, I. D., &amp; Sannino, G. (2026). A new image similarity metric for a perceptual and transparent geometric and chromatic assessment. <em>Discover Artificial Intelligence, 6</em>(1), Article 1536. <a href="https://doi.org/10.1007/s44163-026-02424-4" rel="noopener noreferrer">https://doi.org/10.1007/s44163-026-02424-4</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s44163-026-02424-4" rel="noopener noreferrer">10.1007/s44163-026-02424-4</a></p>
<p><strong>Keywords:</strong> image quality assessment, EDOKS, Earth Mover&#x27;s Distance, Oklab color space, Gabor filters, perceptual similarity, PSNR, SSIM, LPIPS, explainable AI, BAPPS dataset, image processing</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">305554</post-id>	</item>
		<item>
		<title>Vision Transformers Team Up With CNNs to Sharpen Blurry Ultrasound Images</title>
		<link>https://scienmag.com/vision-transformers-team-up-with-cnns-to-sharpen-blurry-ultrasound-images/</link>
		
		<dc:creator><![CDATA[Denise Maddox]]></dc:creator>
		<pubDate>Wed, 14 Oct 2026 10:50:44 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[AI-assisted medical image processing]]></category>
		<category><![CDATA[attention mechanism]]></category>
		<category><![CDATA[biomedical engineering ultrasound research]]></category>
		<category><![CDATA[CNN]]></category>
		<category><![CDATA[deep learning]]></category>
		<category><![CDATA[deep learning for medical image clarity]]></category>
		<category><![CDATA[generative model]]></category>
		<category><![CDATA[hybrid AI framework for medical imaging]]></category>
		<category><![CDATA[image enhancement]]></category>
		<category><![CDATA[improving diagnostic accuracy with AI]]></category>
		<category><![CDATA[Medical Imaging]]></category>
		<category><![CDATA[neural network architectures for ultrasound]]></category>
		<category><![CDATA[noise suppression in portable ultrasound devices]]></category>
		<category><![CDATA[paired dataset]]></category>
		<category><![CDATA[preserving anatomical details in ultrasound]]></category>
		<category><![CDATA[PSNR]]></category>
		<category><![CDATA[speckle noise]]></category>
		<category><![CDATA[speckle noise reduction in ultrasound]]></category>
		<category><![CDATA[SSIM]]></category>
		<category><![CDATA[ultrasound image denoising]]></category>
		<category><![CDATA[ultrasound image sharpening techniques]]></category>
		<category><![CDATA[ultrasound imaging]]></category>
		<category><![CDATA[vision transformer]]></category>
		<category><![CDATA[Vision Transformer and CNN in ultrasound enhancement]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=270659</guid>

					<description><![CDATA[Korean researchers have built a hybrid Vision Transformer and CNN generative model that enhances ultrasound image quality with state-of-the-art fidelity while preserving fine anatomical structures through paired supervised training.]]></description>
										<content:encoded><![CDATA[<p>Ultrasound is one of the most widely used medical imaging tools in the world, prized for being safe, portable, and inexpensive. Yet anyone who has looked at an ultrasound scan knows its Achilles heel: the images are noisy, grainy, and often obscure the very anatomical details clinicians need to see. A research team in South Korea now reports a hybrid artificial intelligence framework that combines two rival architectures of modern computer vision — the Vision Transformer and the convolutional neural network — to clean up ultrasound images while protecting the delicate structures around pathological regions. The work, published in Biomedical Engineering Letters, was led by Yongheon Choi and Minha Yoo, with Jinwan Park and Chi Young Ahn, drawing on expertise from Kongju National University and the National Institute for Mathematical Sciences.</p>
<p>The central challenge the researchers tackled is speckle, the granular noise that plagues every ultrasound acquisition. Speckle arises from interference between scattered sound waves as they bounce off tissue structures smaller than the wavelength of the ultrasound beam. Traditional denoising filters, such as speckle-reducing anisotropic diffusion, have long been applied to suppress this noise, but they often smooth away fine boundaries — exactly the edges and textures that distinguish healthy tissue from a lesion. Deep learning approaches have improved matters considerably, but a new problem emerged: generative models trained without proper ground truth can hallucinate anatomical features that were never present in the patient, a dangerous failure mode in a clinical setting.</p>
<p>The Korean team&#8217;s answer rests on a careful architectural marriage. Their generative framework uses a Vision Transformer (ViT) as the encoder and a convolutional neural network (CNN) as the decoder. The ViT, first popularized by the landmark 2021 paper &#8216;An image is worth 16&#215;16 words,&#8217; breaks an image into patches and lets self-attention mechanisms model relationships between every pair of patches, no matter how far apart they sit. This gives the encoder a view of global context — how one region of the scan relates to another across the entire frame. CNNs, by contrast, excel at local feature extraction, using stacked filters to reconstruct fine edges and textures. By splitting the labor, the hybrid model captures both the big picture and the fine print.</p>
<p>What makes the design particularly elegant is how the attention information is reused. Rather than treating self-attention purely as an internal mechanism, the framework converts the attention patterns computed inside the ViT encoder into spatial weighting signals that reweight the decoder&#8217;s convolutional features. In practical terms, the attention map tells the decoder where to be careful — especially around boundaries and anatomically sensitive regions — reducing the boundary artifacts that tend to appear during local reconstruction. Notably, the authors emphasize that this weighting signal is derived without any anatomical annotation, meaning the system does not require hand-drawn labels of organs or lesions to know where to focus. The attention itself, learned during training, becomes a free byproduct that guides restoration.</p>
<p>Training such a model demands data of a kind that is surprisingly hard to obtain. In most image enhancement tasks, you need pairs of low-quality and high-quality images of the exact same scene. In medical imaging, this is nearly impossible to collect retrospectively, because a patient cannot be scanned twice under identical conditions. The researchers sidestepped this by building a paired dataset in which both the low-quality and high-quality versions come from the same acquisition, ensuring that any reference image genuinely corresponds to the degraded input. Their dataset comprises 803 paired images of 512 by 512 pixels, of which 751 pairs were used for training and 52 held out for testing. This paired supervision is critical: it allows the model&#8217;s output to be compared against a reference formed from the very same acquisition, avoiding the distribution-matching pitfalls that can cause hallucinated features in medical image translation.</p>
<p>The results were evaluated with three standard image quality metrics, each capturing a different aspect of fidelity. Peak signal-to-noise ratio (PSNR) measures pixel-level accuracy against the reference. Structural similarity index measure (SSIM) assesses whether perceptually important structures — edges, contrast, luminance relationships — are preserved. Learned Perceptual Image Patch Similarity (LPIPS) goes further, using deep neural network features to approximate how the human visual system judges similarity. On the test set, the proposed ViT–CNN hybrid achieved a PSNR of 23.7204, an SSIM of 0.8837, and an LPIPS of 0.1634 — the best values among all compared methods in the study. Lower LPIPS is better, so the model&#8217;s outputs were perceptually the closest to the high-quality references.</p>
<p>These numbers place the work within a rapidly evolving field of transformer-based image restoration. Systems like SwinIR, Restormer, and Uformer have shown that attention architectures can outperform pure CNN pipelines on general image restoration tasks. However, the Korean team&#8217;s contribution lies in the specific combination of ideas: attention-guided feature reweighting flowing from a ViT encoder into a CNN decoder, paired with a rigorously curated paired ultrasound dataset. Previous work by members of the same group had explored divide-and-conquer U-Net architectures and comparative studies of GAN-based models for ultrasound quality enhancement, and this new framework extends that research line into the transformer era while keeping the hallucination risks of adversarial training at arm&#8217;s length.</p>
<p>The practical implications could be significant. Better ultrasound images mean better diagnostic confidence, particularly in settings where the technology is the only imaging option available — rural clinics, emergency rooms, bedside examinations in intensive care, and much of the developing world. If an AI enhancement layer can reliably sharpen scans without inventing structures that are not there, it could help clinicians detect subtle lesions earlier and reduce repeat examinations. The fact that the attention-guided weighting requires no anatomical annotation is especially attractive for deployment, because building labeled medical datasets is one of the costliest bottlenecks in medical AI.</p>
<p>There are, of course, caveats worth noting. The dataset was modest in scale and acquired with an E-CUBE 12R research platform at the National Institute for Mathematical Sciences, with the scanned volunteers being the study authors themselves. The study did not undergo institutional review, which the authors note was because the institute operates no review board and no person outside the author list was scanned. Scaling to larger, more diverse patient populations, different ultrasound machines, and genuinely pathological cases will be the necessary next step before such systems enter clinical workflows. Regulatory bodies will also want to see rigorous evidence that enhancement does not alter diagnostic interpretation.</p>
<p>Still, the study offers a compelling demonstration that the great architectural debate of modern computer vision — transformers versus convolutions — is best settled with cooperation rather than competition. By letting a Vision Transformer supply global context and attention-guided spatial weights while a convolutional decoder handles local detail reconstruction, the researchers achieved state-of-the-art ultrasound enhancement without annotations, hallucination-prone losses, or unpaired training tricks. As medical imaging leans further into artificial intelligence, hybrid designs of this kind may become the template for restoring clarity to the noisiest corners of the clinic, one ultrasound frame at a time.</p>
<p><strong>Subject of Research:</strong> A hybrid Vision Transformer–CNN generative framework for enhancing ultrasound image quality under paired supervision</p>
<p><strong>Article Title:</strong> A ViT–CNN hybrid generative framework for ultrasound image enhancement with paired supervision</p>
<p><strong>Article References:</strong> Choi, Y., Yoo, M., Park, J., &amp; Ahn, C. Y. (2026). A ViT–CNN hybrid generative framework for ultrasound image enhancement with paired supervision. <em>Biomedical Engineering Letters</em>. <a href="https://doi.org/10.1007/s13534-026-00621-9" rel="noopener noreferrer">https://doi.org/10.1007/s13534-026-00621-9</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s13534-026-00621-9" rel="noopener noreferrer">10.1007/s13534-026-00621-9</a></p>
<p><strong>Keywords:</strong> ultrasound imaging, Vision Transformer, CNN, image enhancement, deep learning, generative model, attention mechanism, paired dataset, speckle noise, PSNR, SSIM, medical imaging</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">270659</post-id>	</item>
		<item>
		<title>Hidden in Plain Sight: Random Pixel Selection Sharpens Image Steganography</title>
		<link>https://scienmag.com/hidden-in-plain-sight-random-pixel-selection-sharpens-image-steganography/</link>
		
		<dc:creator><![CDATA[Denise Maddox]]></dc:creator>
		<pubDate>Mon, 12 Oct 2026 18:52:53 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[chi-square test]]></category>
		<category><![CDATA[covert communication in digital images]]></category>
		<category><![CDATA[data security]]></category>
		<category><![CDATA[digital image security]]></category>
		<category><![CDATA[high-capacity image concealment]]></category>
		<category><![CDATA[image steganography]]></category>
		<category><![CDATA[imperceptible data hiding techniques]]></category>
		<category><![CDATA[information hiding]]></category>
		<category><![CDATA[information hiding in photographs]]></category>
		<category><![CDATA[invisible message embedding]]></category>
		<category><![CDATA[LSB embedding]]></category>
		<category><![CDATA[pixel-based data hiding]]></category>
		<category><![CDATA[pseudorandom number generator]]></category>
		<category><![CDATA[pseudorandom number generator in steganography]]></category>
		<category><![CDATA[PSNR]]></category>
		<category><![CDATA[robust steganographic methods]]></category>
		<category><![CDATA[spatial domain]]></category>
		<category><![CDATA[SSIM]]></category>
		<category><![CDATA[steganalysis]]></category>
		<category><![CDATA[steganography]]></category>
		<category><![CDATA[steganography vs encryption]]></category>
		<category><![CDATA[XORShift64]]></category>
		<category><![CDATA[XS-RPVI framework]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=265703</guid>

					<description><![CDATA[Researchers have developed an image steganography method that uses XORShift64 random pixel selection and three-bit-per-pixel embedding to hide secret messages in color images while evading detection.]]></description>
										<content:encoded><![CDATA[<p>Every day, billions of photographs flow across the internet, and most of them carry exactly what they appear to carry: birthdays, landscapes, screenshots and selfies. But a growing body of research is devoted to making images carry something more, a second, invisible message woven so subtly into the pixel values that even a determined analyst cannot prove it exists. The technique, known as image steganography, has just received a new contribution from researchers at North-Eastern Hill University in Shillong, India, who describe in the journal Multimedia Tools and Applications a framework they call XS-RPVI, which combines a fast pseudorandom number generator with a high-capacity embedding strategy designed to keep hidden communication both imperceptible and hard to detect.</p>
<p>The work, authored by Rupa Jamatia and Bubu Bhuyan of the Department of Information Technology, addresses one of the oldest tensions in the field. Steganography differs from encryption in a crucial way: cryptography scrambles a message so that intercepted text is unreadable, but the interception itself is obvious. Steganography instead hides the existence of the message. A secret payload is embedded inside an innocuous cover object, in this case a color image, so that anyone observing the traffic sees only an ordinary photograph. The price of that concealment is fragility. If the embedding process disturbs the cover image too much, statistical artifacts appear, and modern steganalysis tools can flag the image as suspicious. The art lies in embedding as much data as possible while leaving the smallest possible fingerprint.</p>
<p>The most straightforward way to hide bits in an image is least significant bit, or LSB, replacement. In a typical 24-bit color image, each pixel stores one byte each for its red, green and blue intensities. Flipping the lowest-order bit of a byte changes the intensity by at most one unit out of 255, a difference far below what the human eye can perceive. Sequential LSB embedding, however, has a well-known weakness: if the sender fills pixel after pixel in raster order, the hidden data occupies a predictable, contiguous region of the image. Steganalysis tools exploit exactly this regularity, scanning for zones where the statistical behavior of the least significant bits deviates from natural image noise. Randomizing where the bits land is therefore a central defense, and it is the pivot of the new study.</p>
<p>Jamatia and Bhuyan&#8217;s framework uses the XORShift64 generator, a pseudorandom number generator introduced by George Marsaglia in 2003, to decide which pixels receive secret bits. XORShift64 belongs to a family of generators prized for their extreme simplicity: the state is updated by a handful of bitwise exclusive-OR and shift operations, which modern processors execute in a few nanoseconds. The authors emphasize that the generator itself is a commonly used primitive; their contribution lies in how it is integrated into the embedding strategy. By seeding the generator and using its output to select pixel positions unpredictably, the scheme ensures that an adversary who does not know the seed cannot reconstruct the sequence of modified pixels, and the scattered, irregular pattern of changes minimizes the detectability of the resulting stego image. The computational overhead, they note, is minimal, which matters for practical deployment on constrained devices.</p>
<p>Capacity is the second pillar of the method. Rather than embedding a single bit per pixel, the XS-RPVI approach writes message bits into the least significant bits of all three color channels, red, green and blue, achieving three bits per pixel. That tripling of payload means a cover image can carry substantially more secret data before the sender must reach for a larger photograph, and larger covers themselves can attract attention. The trade-off, of course, is that modifying three bits per pixel distorts the cover more than modifying one, so the scheme must demonstrate that the resulting images still look and measure as natural. The authors report that the approach balances imperceptibility, visual fidelity and embedding capacity, preserving the perceptual quality of the original images even at the full three-bit payload.</p>
<p>Measuring that preservation requires standardized image quality metrics, and the study leans on the established toolkit of the field. Peak signal-to-noise ratio, or PSNR, quantifies the numerical difference between the cover and stego images, with higher values indicating smaller distortion; values above roughly 40 decibels are conventionally considered evidence that modifications are visually negligible. The structural similarity index, SSIM, goes further by modeling how human vision judges changes in luminance, contrast and structure, while the feature similarity index, FSIM, compares low-level visual features. The literature the authors cite, including comparative studies of these metrics and analyses of their use specifically in steganography evaluation, reflects a consensus that imperceptibility must be assessed both numerically and perceptually, since a stego image that passes one metric can still fail another.</p>
<p>Imperceptibility alone is not enough, because a hidden message that survives human scrutiny may still betray itself to statistical analysis. The authors evaluated their scheme against three classic detection tests. Visual inspection confirmed that stego images show no discernible artifacts. Histogram analysis examined the distribution of pixel intensities: natural images have characteristic, often smooth histograms, and naive embedding tends to produce telltale pairing effects in which adjacent intensity values converge in frequency. Chi-square distance tests, rooted in the statistical method Karl Pearson developed in the nineteenth century, compare the observed distribution of least significant bit values against the expectations of a natural image, flagging images whose bit planes look artificially uniform. The experimental evaluations showed that the proposed method withstands detection through all three tests, and comparative analyses with existing techniques further validated its robustness and reliability in concealing information while preserving visual fidelity.</p>
<p>The design choices sit within a rich research lineage that the paper&#8217;s bibliography traces in detail. Early combinations of cryptography and pseudorandom numbers for steganography date back more than a decade, and subsequent work refined random pixel selection, explored interpolation-based embedding, pursued lowest-distortion LSB schemes, and brought in error-correcting codes such as Hamming codes to raise capacity adaptively. More recent contributions have applied genetic algorithms to cover image selection, combined random pixel and bit selection for high payloads, and embedded encrypted text within color images using randomized pixel ordering. Parallel work in the same journal has explored chaotic maps for image ciphering and new high-capacity, high-security steganographic schemes. Against this backdrop, the Shillong study&#8217;s use of a lightweight, well-understood generator like XORShift64 is a pragmatic argument: security through unpredictability does not require exotic mathematics, only a well-integrated source of pseudorandomness and careful attention to where the bits go.</p>
<p>The practical implications extend to any scenario in which the confidentiality of transmitted images is paramount. The authors point to sensitive image exchange and information protection as the applications where the technique&#8217;s strong concealment capability and computational efficiency show the most promise. In an era when the paper&#8217;s own framing describes escalating cybersecurity threats driven by increasingly sophisticated attack techniques and a growing reliance on the internet for extensive data sharing, covert channels embedded in ordinary media offer a complementary layer of defense: even if an encrypted file is intercepted, an observer cannot be sure that a routine photograph does not also carry a hidden payload. The method&#8217;s low computational cost makes it suitable for embedding and extraction on everyday hardware, and its three-bit-per-pixel capacity reduces the number of cover images needed for a given volume of secret data.</p>
<p>Like all spatial-domain LSB methods, the approach inherits the field&#8217;s standing caveats. The study reports resistance to visual, histogram and chi-square analyses, but the steganalysis arms race continues, with machine-learning detectors constantly improving at recognizing even faint embedding traces, and robustness against image transformations such as compression or resizing remains a separate question from undetectability. The authors&#8217; contribution is nonetheless a clear demonstration of a principle that has governed information hiding since Claude Shannon laid the mathematical foundations of communication theory in 1948: uncertainty in the mind of the adversary is a resource, and it can be manufactured cheaply. By spending a few bitwise operations per pixel to decide where each secret bit lands, the XS-RPVI framework turns one of the oldest tricks in digital steganography into a harder target for the tools that hunt it, and it does so while leaving the photograph, to every eye and every standard test, exactly what it seems.</p>
<p><strong>Subject of Research:</strong> Image steganography using XORShift64-based random pixel selection for secure data hiding in color images</p>
<p><strong>Article Title:</strong> Image steganography: emphasizing bit encoding positions for secure communication</p>
<p><strong>Article References:</strong> Jamatia, R., &amp; Bhuyan, B. (2026). Image steganography: emphasizing bit encoding positions for secure communication. <em>Multimedia Tools and Applications, 85</em>(10), Article 806. <a href="https://doi.org/10.1007/s11042-026-21962-8" rel="noopener noreferrer">https://doi.org/10.1007/s11042-026-21962-8</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s11042-026-21962-8" rel="noopener noreferrer">10.1007/s11042-026-21962-8</a></p>
<p><strong>Keywords:</strong> steganography, image steganography, LSB embedding, XORShift64, pseudorandom number generator, information hiding, steganalysis, chi-square test, PSNR, SSIM, data security, spatial domain</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">265703</post-id>	</item>
		<item>
		<title>AI Model Sharpens Low-Dose CT Scans While Cutting Radiation Exposure</title>
		<link>https://scienmag.com/ai-model-sharpens-low-dose-ct-scans-while-cutting-radiation-exposure/</link>
		
		<dc:creator><![CDATA[Denise Maddox]]></dc:creator>
		<pubDate>Mon, 12 Oct 2026 15:48:46 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[AI-based image reconstruction]]></category>
		<category><![CDATA[AI-driven solutions for radiation safety]]></category>
		<category><![CDATA[attention mechanism]]></category>
		<category><![CDATA[biomedical engineering for medical diagnostics]]></category>
		<category><![CDATA[computed tomography]]></category>
		<category><![CDATA[CycleGAN]]></category>
		<category><![CDATA[deep learning]]></category>
		<category><![CDATA[deep learning in medical imaging]]></category>
		<category><![CDATA[generative adversarial networks]]></category>
		<category><![CDATA[generative adversarial networks for CT denoising]]></category>
		<category><![CDATA[image denoising]]></category>
		<category><![CDATA[improving image quality in low-radiation CT]]></category>
		<category><![CDATA[low-dose CT]]></category>
		<category><![CDATA[low-dose CT scan enhancement]]></category>
		<category><![CDATA[medical image denoising]]></category>
		<category><![CDATA[Medical Imaging]]></category>
		<category><![CDATA[noise reduction in computed tomography]]></category>
		<category><![CDATA[PSNR]]></category>
		<category><![CDATA[radiation dose reduction]]></category>
		<category><![CDATA[radiation dose reduction in medical imaging]]></category>
		<category><![CDATA[RDBCycleGAN-CBAM model]]></category>
		<category><![CDATA[residual dense blocks]]></category>
		<category><![CDATA[SSIM]]></category>
		<category><![CDATA[structured image fidelity in low-dose scans]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=265171</guid>

					<description><![CDATA[Researchers at Boğaziçi University have developed a CycleGAN-based deep learning model with residual dense blocks and attention modules that significantly improves the quality of quarter-dose CT images using unpaired training data.]]></description>
										<content:encoded><![CDATA[<p>Computed tomography has become one of modern medicine&#8217;s most indispensable diagnostic tools, but it comes with a hidden cost that clinicians have wrestled with for decades: radiation. CT scanning accounts for a substantial share of the medical radiation exposure that patients receive, and epidemiological evidence links cumulative ionizing dose to DNA damage and an elevated lifetime risk of cancer. The obvious solution—simply turning down the X-ray tube current and voltage—creates a new problem, because low-dose CT images are marred by heavy quantum noise and streak artifacts that can obscure the subtle anatomical details radiologists depend on. Now, a pair of biomedical engineers at Boğaziçi University in Istanbul report a deep learning approach that may help resolve this tension, describing a generative adversarial network that transforms noisy quarter-dose CT images into clean, structurally faithful scans without ever needing paired examples of noisy and clean images from the same patient.</p>
<p>The new model, called RDBCycleGAN-CBAM, was developed by Osman Assaf and Albert Güveniş of the Institute of Biomedical Engineering and described in the journal Medical &amp; Biological Engineering &amp; Computing. Its architecture weaves together three established ideas from the computer vision literature into a single denoising pipeline. The backbone is a CycleGAN, a generative adversarial framework originally designed for unpaired image-to-image translation, which means it can learn the mapping between quarter-dose and full-dose CT images even when the two image sets come from different patients and different scans. This unpaired training regime is a major practical advantage in medical imaging, where acquiring matched low-dose and standard-dose scans of the same subject doubles radiation exposure and raises ethical obstacles.</p>
<p>What distinguishes the new model from earlier CycleGAN denoisers is the internal design of its generators. The researchers replaced conventional convolutional layers with residual dense blocks, or RDBs, a building block borrowed from image super-resolution research. In an RDB, each convolutional layer receives feature maps from all preceding layers through dense skip connections, while residual connections stabilize training and preserve low-level information. The effect is a network that can exploit hierarchical features across multiple depths simultaneously, which is particularly valuable for CT denoising because noise and anatomy coexist at different spatial scales. Fine textures such as vessel boundaries and subtle tissue contrasts must survive the denoising process intact, and dense feature reuse helps the network distinguish genuine structure from random fluctuation.</p>
<p>The second key ingredient is the convolutional block attention module, or CBAM, a lightweight attention mechanism that refines features along two complementary axes. Channel attention asks which feature channels are most informative for the task at hand, while spatial attention asks which regions of the image deserve the most scrutiny. By sequentially applying both forms of attention, the network learns to concentrate its capacity on diagnostically relevant structures and to suppress the feature responses associated with noise. In the context of low-dose CT, this means the model can, in effect, decide where to look—prioritizing edges, organ boundaries, and lesion-suspect regions while flattening the grainy background that plagues under-dosed acquisitions.</p>
<p>Training the model required balancing several competing objectives. The researchers used a least squares generative adversarial loss, or LSGAN, which provides smoother gradients and more stable adversarial training than the original minimax formulation. On top of that, a cycle-consistency loss ensures that an image translated from quarter-dose to full-dose and then back again closely matches its starting point, preventing the network from inventing anatomy that was never present. An identity loss further encourages the generators to behave as near-identity functions when fed images from their own target domain, preserving color and intensity distributions. Together, these losses push the model toward mappings that are realistic, reversible, and faithful—three properties that matter enormously when the output of the network may one day inform a clinical decision.</p>
<p>The experiments drew on the NIH-AAPM-Mayo Clinic Low-Dose CT Grand Challenge dataset, a widely used public resource containing abdominal CT scans acquired at both full and reduced radiation dose. The model was trained on unpaired quarter-dose and full-dose images and then evaluated on held-out test slices using two standard image-quality metrics: peak signal-to-noise ratio, or PSNR, which quantifies pixel-level fidelity, and the structural similarity index, or SSIM, which better reflects how humans perceive differences in luminance, contrast, and structure. Relative to the raw quarter-dose inputs, the denoised outputs improved on average by 3.973 decibels in PSNR and 0.053 in SSIM, figures the authors describe as competitive with values reported in previous studies of low-dose CT denoising.</p>
<p>What sets the statistical analysis apart is its rigor. Rather than simply reporting average improvements, the researchers first applied Shapiro–Wilk tests to check whether the PSNR and SSIM differences were normally distributed. They were not, which motivated a nonparametric Wilcoxon signed-rank test to compare the denoised images against the original low-dose inputs. The improvements proved highly significant for both metrics. Even more striking were the rank-biserial correlation values, which reached 1.0—an effect size indicating that essentially every test image in the dataset experienced a substantial quality gain, not merely a favorable average driven by a subset of scans. Narrow bootstrap confidence intervals around the mean differences reinforced the picture of a consistent, dataset-wide benefit rather than a fragile, sample-dependent result.</p>
<p>The study arrives amid a rapidly expanding literature on unsupervised CT denoising. Earlier work demonstrated that generative adversarial networks could reduce noise in low-dose scans using Wasserstein distance and perceptual losses, while subsequent models introduced wavelet-assisted noise disentanglement for cardiac CT, cycle-consistent architectures with attention, invertible generators that eliminate the cycle entirely, and dual-domain U-Net discriminators operating in both image and projection space. Recent efforts have explored channel attention with multi-scale features, hybrid attention networks, and attention-residual U-Net hybrids aimed at smart healthcare applications. By combining residual dense feature extraction with dual-axis attention inside a cycle-consistent adversarial framework, the Boğaziçi team&#8217;s model synthesizes several of these threads into one integrated design, and the reported gains suggest the combination is more than the sum of its parts.</p>
<p>A particularly appealing aspect of the approach is that it is vendor-neutral and operates purely in the image domain. Many commercial denoising solutions are tied to specific scanner manufacturers and reconstruction algorithms, but a model that works on finished CT images could in principle be deployed across heterogeneous fleets of scanners from different vendors, in hospitals that lack access to raw projection data. The authors emphasize that their findings support further investigation of RDBCycleGAN-CBAM as exactly such a general-purpose, image-domain denoising tool—one that could help facilities adopt lower-dose protocols without sacrificing the diagnostic quality of the resulting images.</p>
<p>Cautious optimism is nonetheless warranted. The evaluation relied on quantitative image-quality metrics rather than the judgment of radiologists, and the authors themselves note that external validation on independent datasets and formal reader studies are required before the method&#8217;s clinical utility and its potential for genuine dose reduction can be established. Questions about whether denoised images alter diagnostic confidence, lesion detectability, or downstream decisions can only be answered in prospective clinical settings. Still, the study offers a compelling demonstration that attention-augmented, cycle-consistent adversarial networks can squeeze remarkable image quality out of quarter-dose acquisitions, and it adds momentum to a broader vision of AI-assisted imaging in which patients receive the scans they need at a fraction of the radiation burden that today&#8217;s practice imposes.</p>
<p><strong>Subject of Research:</strong> Deep learning-based denoising of low-dose computed tomography images using a CycleGAN model with residual dense blocks and attention modules</p>
<p><strong>Article Title:</strong> RDB CycleGAN-CBAM: an integrated deep learning model for low-dose ct image denoising</p>
<p><strong>Article References:</strong> Assaf, O., &amp; Güveniş, A. (2026). RDB CycleGAN-CBAM: an integrated deep learning model for low-dose ct image denoising. <em>Medical &amp;amp; Biological Engineering &amp;amp; Computing</em>. <a href="https://doi.org/10.1007/s11517-026-03689-8" rel="noopener noreferrer">https://doi.org/10.1007/s11517-026-03689-8</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s11517-026-03689-8" rel="noopener noreferrer">10.1007/s11517-026-03689-8</a></p>
<p><strong>Keywords:</strong> computed tomography, low-dose CT, deep learning, generative adversarial networks, CycleGAN, image denoising, attention mechanism, residual dense blocks, radiation dose reduction, medical imaging, PSNR, SSIM</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">265171</post-id>	</item>
		<item>
		<title>Quantum Circuits Meet Deep Learning to Sharpen Blurry Images</title>
		<link>https://scienmag.com/quantum-circuits-meet-deep-learning-to-sharpen-blurry-images/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Fri, 09 Oct 2026 06:46:51 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[benchmarks for image magnification]]></category>
		<category><![CDATA[deep convolutional networks for image sharpening]]></category>
		<category><![CDATA[deep learning]]></category>
		<category><![CDATA[diffusion-based image enhancement]]></category>
		<category><![CDATA[EDSR]]></category>
		<category><![CDATA[generative adversarial models for super-resolution]]></category>
		<category><![CDATA[high-resolution image generation techniques]]></category>
		<category><![CDATA[hybrid models]]></category>
		<category><![CDATA[hybrid quantum-classical neural networks]]></category>
		<category><![CDATA[IGMRF prior]]></category>
		<category><![CDATA[image reconstruction]]></category>
		<category><![CDATA[LPIPS]]></category>
		<category><![CDATA[PSNR]]></category>
		<category><![CDATA[Quantum Computing]]></category>
		<category><![CDATA[quantum deep learning for image super-resolution]]></category>
		<category><![CDATA[quantum information processing in computer vision]]></category>
		<category><![CDATA[Quantum machine learning]]></category>
		<category><![CDATA[quantum machine learning in image processing]]></category>
		<category><![CDATA[quantum-enhanced image reconstruction]]></category>
		<category><![CDATA[residual neural network architectures]]></category>
		<category><![CDATA[SSIM]]></category>
		<category><![CDATA[super-resolution]]></category>
		<category><![CDATA[variational quantum circuits]]></category>
		<category><![CDATA[variational quantum circuits in computer vision]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=252393</guid>

					<description><![CDATA[Researchers have built a hybrid quantum-classical deep learning model that uses variational quantum circuits and a statistical image prior to reconstruct high-resolution images from single low-resolution inputs.]]></description>
										<content:encoded><![CDATA[<p>Every photographer knows the frustration of a shot that is technically captured but hopelessly soft, and every computer vision researcher knows the long-running quest to fix it. Single-image super-resolution, the task of reconstructing a sharp, high-resolution picture from a single low-resolution input, has been transformed over the past decade by deep convolutional networks, generative adversarial models, and, most recently, diffusion-based approaches. Now a team of researchers in India has added an unusual new ingredient to that lineage: variational quantum circuits. In a study published in the journal Quantum Information Processing, Prashant Gohel of HCL Technologies and Manjunath Joshi of Dhirubhai Ambani Institute of Information and Communication Technology describe a hybrid quantum-classical deep learning framework that weaves trainable quantum circuits into one of the most respected classical super-resolution architectures, reporting measurable gains across standard benchmarks for magnification factors of four and eight times.</p>
<p>The classical backbone of the new method is the Enhanced Deep Super-Resolution network, or EDSR, a residual architecture introduced in 2017 that removed the batch-normalization layers of earlier designs in order to squeeze more capacity out of very deep stacks of convolutional filters. EDSR and its adversarial cousin ESRGAN set benchmarks that later attention-based and transformer-based models such as SwinIR have chased ever since. In the hybrid scheme, the authors retain this proven classical machinery but insert Variational Quantum Circuits, small parameterized quantum circuits whose rotation gates are tuned by a classical optimizer, into the learning pipeline. These circuits act as learnable nonlinear feature processors: classical image features are encoded into quantum states, transformed by entangling gates and parameterized rotations, and measured back into classical values that feed the reconstruction pathway. The approach follows a broader pattern in quantum machine learning, where hybrid models pair classical networks for heavy feature extraction with quantum subroutines that explore expressive function classes in exponentially large Hilbert spaces.</p>
<p>Training proceeds on paired datasets of low-resolution and high-resolution images, with the model learning to reconstruct sharp outputs from degraded inputs. Crucially, the training objective constrains both the low-resolution and high-resolution reconstructions, a consistency requirement that forces the network to maintain a coherent mapping between scales rather than merely hallucinating plausible detail at the output end. The authors trained on the DIV2K dataset, a standard corpus of two-thousand high-quality images widely used in super-resolution research, and evaluated on the Set14 benchmark, one of the canonical test sets in the field. This paired, supervised regime keeps the work firmly within the mainstream of super-resolution methodology even as the quantum component pushes into less familiar territory.</p>
<p>One of the more elegant aspects of the design is its treatment of perceptual quality. Many modern super-resolution systems measure perceptual fidelity using a loss computed by a large network pre-trained on an unrelated task, typically a VGG-style classifier trained on ImageNet. That strategy works, but it imports an external dependency and a computational burden. Gohel and Joshi sidestep it entirely by adopting an Inhomogeneous Gaussian Markov Random Field prior as a spatial regularizer. IGMRF models, which have a history in image restoration going back to learning-based super-resolution work by Gajjar and Joshi in 2010, capture the statistical structure of local image neighborhoods and penalize reconstructions that violate the smooth-yet-textured character of natural images. By embedding this statistical prior directly in the loss, the framework encourages visually convincing reconstructions without needing any externally pre-trained network, a simplification that matters both for training efficiency and for keeping the pipeline self-contained.</p>
<p>The evaluation protocol covers the three metrics that dominate the super-resolution literature. Peak Signal-to-Noise Ratio quantifies pixel-level fidelity, the Structural Similarity Index captures perceptual agreement in luminance, contrast, and structure, and Learned Perceptual Image Patch Similarity, or LPIPS, measures distance in the feature space of a deep network and correlates well with human judgments of visual quality. The authors report results for four-times and eight-times magnification, and they demonstrate a particularly practical trick: a model trained only for two-times enhancement can be applied recursively, feeding its own output back as input, to reach higher magnification factors without any architectural modification. Quantitative and qualitative examples in the paper illustrate this recursive enhancement up to eight times, suggesting that a single lightweight model could serve a range of zoom requirements rather than requiring a separately trained network for each scale factor.</p>
<p>Because the quantum components run on classical simulators rather than actual quantum hardware, the authors are careful about what they claim. All quantum circuits were simulated on conventional hardware, and the results are presented explicitly as evidence for the viability of the hybrid representation in a simulation-based setting, with hardware-level quantum acceleration left as a direction for future investigation. That honesty is notable in a field where quantum machine learning claims sometimes outrun the evidence. The team did, however, probe robustness in two ways that anticipate real devices. They simulated depolarizing noise, the dominant error channel on today&#8217;s noisy intermediate-scale quantum processors, and they performed circuit-connectivity ablations, testing how performance changes when qubits cannot all interact directly and gates must be routed through limited coupling graphs. Both ablations showed gradual performance changes under the tested settings rather than catastrophic collapse, an encouraging sign that the representation degrades gracefully as hardware imperfections accumulate.</p>
<p>The work sits within a rapidly growing literature at the intersection of quantum computing and image processing. Quantum machine learning in feature Hilbert spaces, demonstrated experimentally by Havlíček and colleagues at IBM in a landmark Nature paper, provides the theoretical footing for encoding classical data into quantum states where linear separability can be enhanced. Variational quantum circuits have been applied to deep reinforcement learning, transfer learning, and quantum generative adversarial frameworks proposed by Lloyd and Weedbrook. In imaging specifically, a parallel line of research by Dutta and collaborators has explored quantum many-body concepts for denoising, quantum-inspired convolutional networks for medical image restoration, and most recently a quantum image enhancement transformer for single-image super-resolution. The new study distinguishes itself by embedding quantum circuits inside a fully supervised, residual super-resolution pipeline with a principled statistical prior, rather than treating quantum enhancement as a bolt-on denoising stage.</p>
<p>The practical stakes are considerable. Super-resolution underpins satellite imagery analysis, medical imaging, video streaming, forensic enhancement, and the upscaling pipelines inside consumer displays. A hybrid architecture that achieves competitive fidelity while remaining trainable with modest external dependencies could eventually matter wherever image quality is limited by sensor resolution or bandwidth. The recursive magnification result is especially appealing for deployment scenarios where storage and compute are constrained, since one compact model could serve multiple zoom levels. Of course, the caveats are equally clear: with everything simulated classically, the framework currently offers no quantum speedup, and the overhead of simulating quantum circuits on classical hardware makes the hybrid model a research vehicle rather than a production tool. The authors frame their contribution as evidence of a promising representation, not a replacement for state-of-the-art classical systems.</p>
<p>That framing reflects a mature understanding of where quantum machine learning stands today. Real quantum processors remain small, noisy, and limited in connectivity, and theoretical obstacles such as barren plateaus, the vanishing-gradient problem identified by McClean and colleagues in quantum neural network training landscapes, continue to challenge the scalability of variational approaches. Studies like this one, which test robustness to depolarizing noise and restricted connectivity before hardware ever enters the picture, help map which designs are likely to survive the transition to real devices. The gradual performance degradation observed under the tested settings suggests the architecture has some tolerance for the imperfections that define the current era of quantum computing.</p>
<p>For now, the study stands as a careful, well-benchmarked demonstration that quantum circuits can be woven into a demanding computer vision task without sacrificing the discipline that makes super-resolution research credible: paired training data, standard metrics, public datasets, and honest accounting of what is simulated and what is not. Whether variational quantum circuits ultimately deliver advantages on actual quantum hardware remains an open question, but this work provides a concrete, reproducible template for how the marriage of quantum computing and image restoration might be tested as hardware matures. The authors received their manuscript on 22 March 2026, had it accepted on 24 September 2026, and published it on 9 October 2026 in volume 25 of Quantum Information Processing, adding a measured but intriguing data point to one of the most closely watched experiments in modern computing: teaching quantum machines to see.</p>
<p><strong>Subject of Research:</strong> Hybrid quantum-classical deep learning for single-image super-resolution</p>
<p><strong>Article Title:</strong> Quantum single-image super resolution</p>
<p><strong>Article References:</strong> Gohel, P., &amp; Joshi, M. (2026). Quantum single-image super resolution. <em>Quantum Information Processing, 25</em>(10), Article 337. <a href="https://doi.org/10.1007/s11128-026-05357-0" rel="noopener noreferrer">https://doi.org/10.1007/s11128-026-05357-0</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s11128-026-05357-0" rel="noopener noreferrer">10.1007/s11128-026-05357-0</a></p>
<p><strong>Keywords:</strong> quantum machine learning, super-resolution, variational quantum circuits, EDSR, IGMRF prior, image reconstruction, deep learning, quantum computing, PSNR, SSIM, LPIPS, hybrid models</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">252393</post-id>	</item>
		<item>
		<title>AI Diffusion Models Erase Truncation Artifacts from Cone-Beam CT Scans</title>
		<link>https://scienmag.com/ai-diffusion-models-erase-truncation-artifacts-from-cone-beam-ct-scans/</link>
		
		<dc:creator><![CDATA[Ophelia Keating]]></dc:creator>
		<pubDate>Sun, 04 Oct 2026 10:06:56 +0000</pubDate>
				<category><![CDATA[Medicine]]></category>
		<category><![CDATA[AI diffusion models]]></category>
		<category><![CDATA[AI solutions for limited field of view in CBCT]]></category>
		<category><![CDATA[AI-based reconstruction correction in computed tomography]]></category>
		<category><![CDATA[artifacts mitigation in 3D medical imaging]]></category>
		<category><![CDATA[artificial intelligence in radiology diagnostics]]></category>
		<category><![CDATA[BMC Medical Imaging]]></category>
		<category><![CDATA[cone-beam computed tomography]]></category>
		<category><![CDATA[cone-beam CT scan artifact removal]]></category>
		<category><![CDATA[Deep Learning in Radiology]]></category>
		<category><![CDATA[diffusion models]]></category>
		<category><![CDATA[diffusion models for medical image denoising]]></category>
		<category><![CDATA[filtered backprojection]]></category>
		<category><![CDATA[GANs]]></category>
		<category><![CDATA[generative AI]]></category>
		<category><![CDATA[generative diffusion models for X-ray image enhancement]]></category>
		<category><![CDATA[image reconstruction]]></category>
		<category><![CDATA[low-dose CBCT imaging quality improvement]]></category>
		<category><![CDATA[Medical Imaging]]></category>
		<category><![CDATA[medical imaging technology advancements]]></category>
		<category><![CDATA[PSNR]]></category>
		<category><![CDATA[radiation dose]]></category>
		<category><![CDATA[raw projection data enhancement techniques]]></category>
		<category><![CDATA[SSIM]]></category>
		<category><![CDATA[truncation artifact correction in medical imaging]]></category>
		<category><![CDATA[truncation artifacts]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=234590</guid>

					<description><![CDATA[Researchers have used conditional generative diffusion models to complete truncated X-ray projection data, substantially reducing artifacts in cone-beam CT reconstructions.]]></description>
										<content:encoded><![CDATA[<p>Cone-beam computed tomography, or CBCT, has become one of the most widely deployed imaging technologies in modern medicine, prized for its high spatial resolution and comparatively low radiation dose. From dental clinics and operating rooms to radiotherapy planning suites, the compact rotating gantries of CBCT systems deliver three-dimensional images at a fraction of the exposure associated with conventional multi-detector CT. Yet the technology carries a persistent weakness that has frustrated physicists and radiologists for years: the detectors simply cannot capture the entire X-ray field passing through a patient. When the imaged object extends beyond the detector&#8217;s field of view, the projection data are said to be truncated, and the resulting reconstructions are marred by severe truncation artifacts—bright cupping at the edges, distorted intensities, and streaks that can obscure clinically important anatomy.</p>
<p>A research team from the Beijing Institute of Technology and Beijing WeMed Medical Technology has now proposed an unusually elegant solution, published in BMC Medical Imaging. Rather than trying to patch up corrupted images after reconstruction, the researchers attack the problem at its source, in the raw projection data itself. Their tool of choice is a conditional generative diffusion model, or CGDM, a class of artificial intelligence that has already transformed image synthesis in other domains. By training the model to complete the missing portions of truncated X-ray projections, the team shows that the downstream reconstructions become dramatically cleaner, with measurable gains in both fidelity and diagnostic visibility.</p>
<p>To understand why truncation is so damaging, it helps to consider the mathematics of image reconstruction. Most CBCT systems rely on filtered backprojection, or FBP, an algorithm that assumes every X-ray line through the object has been measured. When a patient&#8217;s shoulders, for example, extend past the edges of a flat panel detector, the projections of those regions are simply absent. FBP does not tolerate such gaps gracefully. The missing data violate the assumptions of the reconstruction, producing intensity gradients that pile up near the boundary of the field of view and propagate inward as shading and streaking. Structures near the periphery can be shifted in density, and subtle low-contrast lesions may become impossible to distinguish from the artifact background.</p>
<p>Traditional remedies have been largely mechanical. The most common approach, implemented in the widely used Reconstruction Toolkit, is padding: the truncated projection is extended with carefully chosen synthetic values, often mirrored or smoothly decayed, so that the reconstruction algorithm receives a nominally complete dataset. Padding reduces the worst of the cupping, but it is fundamentally a guess. The padded values carry no real information about the patient&#8217;s anatomy outside the field of view, so residual artifacts remain, particularly in cases where the truncated anatomy is dense or structurally complex.</p>
<p>The new study replaces that guess with a learned one. Conditional generative diffusion models work by learning to reverse a gradual noising process: during training, the model sees data at progressively higher noise levels and learns to denoise each step. At generation time, starting from pure noise, the model can synthesize samples that follow the intricate statistical distribution of the training data. Crucially, the conditioning mechanism allows the researchers to constrain the generation—the model does not invent arbitrary projections, but completes the specific truncated projection in hand, filling in the missing detector regions with realistic, anatomically plausible values that are consistent with the measured data.</p>
<p>The quantitative results are striking. Compared against the established RTK padding method at the projection level, the diffusion-based completion achieved an improvement of 12 decibels in peak signal-to-noise ratio, or PSNR, and a gain of 0.15 in structural similarity index, or SSIM. For context, a 12 dB PSNR improvement represents a very large reduction in error energy, and SSIM gains of that magnitude indicate substantially better preservation of structural information. These are not marginal refinements but a step change in how faithfully the completed projections match the original, untruncated data.</p>
<p>The benefits carry through to the final three-dimensional images. In the reconstructed volumes, the proposed method delivered an average increase of 9 dB in PSNR and 0.10 in SSIM relative to the reference approach. Just as important for clinical practice, the researchers report visibly enhanced image uniformity and improved visibility of low-contrast structures—the soft-tissue distinctions that often determine whether a lesion is detected or missed. The team also evaluated region-of-interest reconstruction, a scenario of particular practical relevance, and found that the diffusion approach achieved statistically significant advantages over generative adversarial network, or GAN, based methods in both PSNR and SSIM, while fully preserving critical, diagnostically relevant features.</p>
<p>The comparison with GANs is worth pausing on, because it speaks to a broader shift in medical AI. GANs were long the dominant architecture for image synthesis and completion, but they are notorious for hallucinating fine details and for unstable training. Diffusion models, by contrast, tend to produce more faithful distributions and are easier to train stably. In a diagnostic context, where a fabricated structure could mislead a clinician, the ability of a diffusion model to stay anchored to the conditioned, measured data is a meaningful safety advantage. The study&#8217;s finding that diagnostically relevant features were fully preserved suggests the method errs on the side of fidelity rather than invention.</p>
<p>The implications extend across the many settings where CBCT is used. In dentistry, where the shoulders and skull routinely exceed the detector&#8217;s field of view, truncation artifacts complicate the assessment of structures near the image periphery. In image-guided radiotherapy and interventional procedures, where CBCT is acquired on treatment machines to verify patient positioning, artifacts can degrade the accuracy of dose calculations and anatomical registration. A software-only correction that runs on existing hardware—no detector upgrades, no longer scans, no additional radiation dose—could improve image quality across installed systems at minimal cost. Because the method operates on projection data before reconstruction, it is compatible with standard FBP pipelines, easing integration into commercial workflows.</p>
<p>As with any deep learning approach in medicine, questions of generalization and validation remain. The study was conducted retrospectively, with ethics approval from the Ethics Committee of Xuanwu Hospital, Capital Medical University, and the published version is an early-release, peer-reviewed accepted manuscript subject to final edits. Broader clinical adoption will depend on testing across diverse patient populations, scanner geometries, and anatomical sites, and on ensuring that the model&#8217;s generated projections remain reliable for anatomy far outside its training distribution. Still, the work marks a compelling demonstration that generative diffusion models can solve a genuine physics problem in medical imaging—not by generating pretty pictures, but by restoring missing measurements with enough fidelity that the underlying reconstruction mathematics works the way it was always supposed to. If the results hold up at scale, the bright, cupped edges of yesterday&#8217;s CBCT scans may soon become a thing of the past.</p>
<p><strong>Subject of Research:</strong> Reduction of truncation artifacts in cone-beam computed tomography using conditional generative diffusion models</p>
<p><strong>Article Title:</strong> Truncation artifact reduction in cone-beam computed tomography scans using conditional generative diffusion models</p>
<p><strong>Article References:</strong> Xie, J., Li, S., Xing, E., Wang, L., Jia, X., Liu, C., &amp; Chen, D. (2026). Truncation artifact reduction in cone-beam computed tomography scans using conditional generative diffusion models. <em>BMC Medical Imaging</em>. <a href="https://doi.org/10.1186/s12880-026-02818-x" rel="noopener noreferrer">https://doi.org/10.1186/s12880-026-02818-x</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1186/s12880-026-02818-x" rel="noopener noreferrer">10.1186/s12880-026-02818-x</a></p>
<p><strong>Keywords:</strong> cone-beam computed tomography, truncation artifacts, diffusion models, medical imaging, image reconstruction, generative AI, PSNR, SSIM, filtered backprojection, GANs, radiation dose, BMC Medical Imaging</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">234590</post-id>	</item>
		<item>
		<title>AI Model Sharpens Short-Term Rainfall Forecasts from Radar Images</title>
		<link>https://scienmag.com/ai-model-sharpens-short-term-rainfall-forecasts-from-radar-images/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Wed, 30 Sep 2026 21:49:14 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[AI-enhanced short-term weather forecasts]]></category>
		<category><![CDATA[CBAM attention]]></category>
		<category><![CDATA[climate change impact on rainfall extremes]]></category>
		<category><![CDATA[ConvLSTM]]></category>
		<category><![CDATA[deep learning]]></category>
		<category><![CDATA[DWD dataset]]></category>
		<category><![CDATA[early warning systems]]></category>
		<category><![CDATA[generative adversarial network]]></category>
		<category><![CDATA[generative adversarial networks for weather forecasting]]></category>
		<category><![CDATA[Germany radar dataset analysis]]></category>
		<category><![CDATA[Machine Learning in Meteorology]]></category>
		<category><![CDATA[multi-step radar image forecasting]]></category>
		<category><![CDATA[precipitation forecasting]]></category>
		<category><![CDATA[radar image nowcasting]]></category>
		<category><![CDATA[radar nowcasting]]></category>
		<category><![CDATA[remote sensing rainfall forecasting]]></category>
		<category><![CDATA[short-term rainfall prediction]]></category>
		<category><![CDATA[spatiotemporal prediction]]></category>
		<category><![CDATA[SR2-GAN]]></category>
		<category><![CDATA[SR2-GAN rainfall prediction model]]></category>
		<category><![CDATA[SSIM]]></category>
		<category><![CDATA[terrain-specific weather prediction challenges]]></category>
		<category><![CDATA[Vietnam]]></category>
		<category><![CDATA[Vietnam weather prediction]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=219182</guid>

					<description><![CDATA[A new generative adversarial network called SR2-GAN significantly improves multi-step radar rainfall nowcasting, cutting prediction error by up to 44.4 percent on Vietnamese and German datasets.]]></description>
										<content:encoded><![CDATA[<p>Weather radar screens tell a story that unfolds minute by minute: swirling bands of reflectivity that reveal where rain is falling right now, and, if you know how to read them, hints of where it will fall next. Turning those hints into reliable short-term forecasts—a task meteorologists call nowcasting—has long been one of the most stubborn problems in operational weather prediction. A new study published in Mobile Networks and Applications introduces SR2-GAN, a generative adversarial network designed specifically to predict multi-step sequences of radar images, and reports substantial accuracy gains over established baselines on datasets from Vietnam and Germany.</p>
<p>The research team, led by Ha Gia Son of the Vietnam Academy of Science and Technology, the Vietnam-Hungary Industrial University, and the Artificial Intelligence Research Center at VNU Information Technology Institute, together with Tran Manh Tuan of Thuyloi University and Le Hoang Son of VNU, focused on a challenge that matters most in regions where climate change is intensifying rainfall extremes. Northwest Vietnam, with its steep terrain and vulnerable mountain communities, served as one of the study&#8217;s testing grounds. In such settings, a forecast that is accurate in average pixel value but blurry in structure can still fail to warn residents about the localized downpour that actually triggers a flash flood.</p>
<p>At the heart of SR2-GAN is a generator built on a Convolutional Long Short-Term Memory network, or ConvLSTM, a recurrent architecture that treats radar frames as spatiotemporal tensors and learns how rainfall patterns evolve across both space and time. ConvLSTM networks have become a workhorse of radar echo extrapolation because they can, in principle, capture the motion, growth, and decay of precipitation cells. What the Vietnamese team added is a set of refined Convolutional Block Attention Modules, known as CBAM, which were originally introduced in computer vision research in 2018. These attention modules allow the network to weight which spatial regions and which feature channels matter most at each step of the prediction, helping the model concentrate on the dynamic features of rainfall rather than on static background clutter.</p>
<p>The second half of the adversarial pair is a discriminator that evaluates the generated radar frames at the patch level rather than judging each image as a whole. This approach, popularized by image-to-image translation frameworks such as pix2pix, asks whether small local windows of the forecast look realistic. In the context of precipitation nowcasting, patch-level discrimination pushes the generator to produce sharper edges around storm cells and more coherent internal structure, instead of the smeared, averaged-looking outputs that plague models trained purely on pixel-wise error minimization.</p>
<p>Perhaps the most consequential design decision in SR2-GAN is its composite multi-objective loss function. The training objective jointly combines three terms: the adversarial loss that rewards realism, the mean squared error (MSE) that penalizes pixel-level deviations from the true radar observations, and the structural similarity index measure (SSIM) that rewards preservation of morphological characteristics such as the shape, contrast, and texture of rain bands. Each term pulls the network in a slightly different direction. MSE alone tends to produce blurry forecasts because averaging over possible futures smears out uncertainty; adversarial loss alone can hallucinate plausible-looking but physically wrong structures. By balancing all three, the framework seeks forecasts that are simultaneously faithful in intensity and faithful in form.</p>
<p>The empirical results are striking. On radar data from the Pha Din station in Dien Bien, Vietnam, SR2-GAN reduced MSE by 44.4 percent compared with a CNN-GRU baseline, a hybrid of convolutional and gated recurrent layers that the same research community has previously applied to rainfall forecasting. On the DWD dataset from the German Weather Service, the reduction was 25 percent. Structural fidelity improved as well: SSIM rose by 12.8 percent on the Vietnamese data and 4.5 percent on the German data. The fact that the gains hold across two geographically and climatologically distinct datasets—one tropical and mountainous, one mid-latitude European—suggests the architecture is not simply overfitting to the quirks of a single radar site.</p>
<p>The comparisons did not stop at the CNN-GRU baseline. The authors report that SR2-GAN outperforms advanced generative competitors, including S2R-GAN, the team&#8217;s own earlier spatiotemporal GAN for radar image nowcasting presented at the ICTA 2025 conference, and Rad-cGAN, a conditional GAN for radar-based precipitation nowcasting developed for multiple dam domains and published in Geoscientific Model Development in 2022. The decisive advantages appear in maintaining spatiotemporal consistency across forecast steps and in delivering more stable long-range predictions—precisely the qualities that determine whether a nowcasting system can be trusted several steps into the future rather than just one or two frames ahead.</p>
<p>The significance of this work becomes clearer when placed against the broader arc of the field. Traditional numerical weather prediction models, such as prototypes of the Weather Research and Forecasting model and the physical parameterization schemes developed at ECMWF, excel at longer horizons but are computationally expensive and can struggle with the fine-grained, rapidly evolving convective systems that dominate short-term rainfall. Statistical approaches like SARIMA and support vector machines capture temporal patterns but largely ignore spatial structure. Deep learning has reshaped the landscape: PredRNN introduced spatiotemporal LSTM units for predictive learning, and in 2023 the NowcastNet system published in Nature demonstrated skillful nowcasting of extreme precipitation. SR2-GAN joins this lineage while tailoring the recipe to the practical constraints of radar-image sequence prediction, including in data-sparse developing regions.</p>
<p>For the researchers involved, the motivation is not abstract. The team has a history of building forecasting tools for the Pha Din radar station, including a 2024 model integrating CNN, gated recurrent units, and a genetic algorithm for rainfall forecasting from radar images. The progression from those hybrid statistical-machine-learning systems to a full generative adversarial framework reflects a deliberate bet that realism-aware training is the key to usable early warnings. In mountainous northern Vietnam, where the impacts of climate change are increasingly severe, an extra few minutes of accurate, spatially coherent warning can translate directly into evacuations completed before flash floods arrive.</p>
<p>The study also lowers barriers for other research groups. The German DWD dataset is publicly available through a Zenodo repository, the Pha Din radar data is published through a Mendeley Data repository, and the authors have released their code on GitHub. The research received no dedicated funding, and the authors declare no competing interests. As generative models continue their migration from image synthesis into the geosciences, SR2-GAN offers a concrete demonstration that attention-enhanced recurrent generators, disciplined by a carefully balanced composite loss, can turn raw radar reflectivity into sharper, more trustworthy glimpses of the very near future—and that such glimpses may soon be within reach of the communities that need them most.</p>
<p><strong>Subject of Research:</strong> Deep learning-based generative adversarial networks for multi-step radar image precipitation nowcasting</p>
<p><strong>Article Title:</strong> SR2-GAN: A Novel Generative Adversarial Network for Radar Image Sequence Nowcasting</p>
<p><strong>Article References:</strong> Son, H. G., Tuan, T. M., &amp; Son, L. H. (2026). SR2-GAN: A Novel Generative Adversarial Network for Radar Image Sequence Nowcasting. <em>Mobile Networks and Applications</em>. <a href="https://doi.org/10.1007/s11036-026-02532-6" rel="noopener noreferrer">https://doi.org/10.1007/s11036-026-02532-6</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s11036-026-02532-6" rel="noopener noreferrer">10.1007/s11036-026-02532-6</a></p>
<p><strong>Keywords:</strong> SR2-GAN, generative adversarial network, radar nowcasting, precipitation forecasting, ConvLSTM, CBAM attention, SSIM, deep learning, spatiotemporal prediction, Vietnam, DWD dataset, early warning systems</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">219182</post-id>	</item>
		<item>
		<title>Ensemble of Five Neural Networks Creates Richer Deep Dream Art</title>
		<link>https://scienmag.com/ensemble-of-five-neural-networks-creates-richer-deep-dream-art/</link>
		
		<dc:creator><![CDATA[Cassandra Pierce]]></dc:creator>
		<pubDate>Sat, 12 Sep 2026 05:11:44 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[AI art]]></category>
		<category><![CDATA[AI-generated dreamlike imagery]]></category>
		<category><![CDATA[bagging]]></category>
		<category><![CDATA[convolutional neural networks]]></category>
		<category><![CDATA[convolutional neural networks for art]]></category>
		<category><![CDATA[Deep Dream]]></category>
		<category><![CDATA[Deep Dream ensemble]]></category>
		<category><![CDATA[deep learning for artistic visualization]]></category>
		<category><![CDATA[ensemble learning]]></category>
		<category><![CDATA[ensemble learning in deep dreaming]]></category>
		<category><![CDATA[ensemble methods in AI art creation]]></category>
		<category><![CDATA[hierarchical feature detection in deep dreaming]]></category>
		<category><![CDATA[image feature aggregation in neural networks]]></category>
		<category><![CDATA[Inception v3]]></category>
		<category><![CDATA[Inception-ResNet-V2]]></category>
		<category><![CDATA[multi-model deep dream generation]]></category>
		<category><![CDATA[neural network hallucination techniques]]></category>
		<category><![CDATA[neural network image synthesis]]></category>
		<category><![CDATA[normalized cross-correlation]]></category>
		<category><![CDATA[SSIM]]></category>
		<category><![CDATA[VGG 16]]></category>
		<category><![CDATA[VGG 19]]></category>
		<category><![CDATA[VGG and Inception architectures]]></category>
		<category><![CDATA[Xception]]></category>
		<guid isPermaLink="false">https://scienmag.com/?p=193818</guid>

					<description><![CDATA[Researchers combined five pretrained CNN architectures in a bagging ensemble to generate richer, more faithful Deep Dream images, achieving a loss of 8.5589 with SSIM of 0.2404 and NCC of 0.7622.]]></description>
										<content:encoded><![CDATA[<p>More than a decade after Google engineers first revealed the hypnotic, dreamlike images produced by a technique known as Deep Dream, a team of researchers from institutions across Iraq and the United Arab Emirates has found a way to make the algorithm&#8217;s hallucinations richer, more coherent and more faithful to the original picture. Their secret is not a brand-new network but a lesson machine learning has taught for years: sometimes a committee beats a single expert.</p>
<p>The study, published in Neural Computing and Applications, presents a bagging ensemble framework that combines the outputs of five pretrained convolutional neural network architectures: VGG 16, VGG 19, Xception, Inception v3 and Inception-ResNet-V2. Rather than asking one network to imagine the hidden patterns inside an image, the researchers let all five dream simultaneously and then aggregate their visions through iterative processes that enhance the features of the final image. The result, the team reports, is a Deep Dream output that maintains a high degree of similarity to the input while producing complex and aesthetically striking imagery.</p>
<p>Deep Dream works by exploiting the way convolutional neural networks perceive the world. These networks learn hierarchical features, with early layers detecting simple edges and textures and deeper layers responding to abstract concepts such as faces, eyes or animal shapes. When the technique amplifies the activations of chosen layers and feeds the result back through the network, the image spirals into the surreal patterns that made the method an internet sensation. The problem, however, is that a single architecture captures only one interpretation of the image&#8217;s features, and that narrow viewpoint can limit the quality and diversity of the generated dream.</p>
<p>The research team addressed this limitation by treating each pretrained network as a distinct dreamer. In each of the five CNN architectures, the model selects specific layers to activate, including some frozen layers, a choice that enhances the process of feature extraction. Because each network was trained on large image datasets and developed its own internal vocabulary of visual features, the ensemble effectively harvests a wider spectrum of patterns than any single model could reveal. The outputs are aggregated so that shared structures reinforce one another while idiosyncratic artifacts tend to fade, and a final scaling step refines the output image.</p>
<p>Bagging, short for bootstrap aggregating, is a classical ensemble strategy usually applied to prediction tasks, where multiple models trained on slightly different samples of data vote on an outcome. Applying it to image generation is less common, and it is here that the study makes its mark. Instead of sampling the data, the method samples the models themselves, drawing on architectures with different depths, block structures and activation behaviors. VGG 16 and VGG 19, with their stacks of small convolutional filters, emphasize texture-like patterns; the Inception family, with its multi-scale modules, blends information across several receptive field sizes; Xception&#8217;s depthwise separable convolutions decompose spatial and channel-wise filtering in yet another way. Each contributes a different stylistic signature to the composite dream.</p>
<p>To evaluate the approach objectively, the researchers tested their generated images using three metrics: loss, the Structural Similarity Index Measure (SSIM), and Normalized Cross-Correlation (NCC). SSIM quantifies how closely the structure of the generated image matches the original, capturing perceived changes in luminance, contrast and structure, while NCC measures the linear correlation between the two images. The generated images exhibited a loss value of 8.5589, with SSIM and NCC values of 0.2404 and 0.7622 respectively. The authors interpret these values as evidence that the ensemble method keeps the generated dreams anchored to the source image even as it introduces elaborate new patterns.</p>
<p>The numbers also hint at the fundamental tension at the heart of Deep Dream. An SSIM of 0.2404 indicates that the generated image departs substantially from its source in structural terms, which is precisely the point of the technique: the goal is transformation, not replication. The comparatively high NCC of 0.7622 shows that the two images remain strongly correlated in their overall signal, suggesting the algorithm amplifies what is already latent in the picture rather than inventing unrelated content. Striking that balance, the researchers argue, is where the bagging ensemble proves its robustness.</p>
<p>The work builds on the authors&#8217; earlier explorations of hybrid artistic models that combined Deep Dream with multiple CNN architectures, extending the idea into the ensemble learning framework that has proven so effective elsewhere in machine learning. It also joins a growing body of research that treats generative visual systems not merely as technical curiosities but as instruments of creative practice, from simulated visual hallucination studies in virtual reality to biometric and diagnostic applications that borrow Deep Dream&#8217;s feature-amplification machinery.</p>
<p>For artists and designers, the findings suggest a practical path forward: rather than settling for the idiosyncrasies of one pretrained model, creators can blend the perceptual biases of several networks to steer the mood and texture of their generated work. Because all five architectures are publicly available and pretrained, the approach does not require expensive training runs, making ensemble dreaming accessible to studios and hobbyists alike. The integration of CNN variants in a bagging ensemble framework, the authors conclude, paves the way for further innovations at the intersection of artificial intelligence and artistic expression, confirming the role of ensemble learning in supporting and enhancing visual art.</p>
<p>Beyond the gallery, the technique&#8217;s underlying principle, aggregating diverse feature extractors to stabilize and enrich a generative process, could inform other domains where neural networks are asked to reinterpret images, including data augmentation, style transfer and synthetic data generation for training vision systems. As generative AI continues to reshape how images are made and consumed, studies like this one remind us that some of the most compelling machine creativity comes not from bigger models but from teaching machines, like human artists, to compare notes.</p>
<p>The choice of architectures in the study is not arbitrary. All five networks were originally designed for large-scale image classification challenges, and each has since become a standard backbone in computer vision research. VGG-style networks, introduced in the mid-2010s, remain popular despite their age because their uniform structure of small convolutional filters produces feature maps that are easy to interpret and manipulate. The Inception lineage introduced the idea of running convolutions at several filter sizes in parallel within a single module, while Inception-ResNet-V2 added residual connections that ease the training of very deep stacks. Xception pushed this logic further by replacing standard filters with depthwise separable convolutions, a design that later influenced efficient mobile architectures. Drawing dream content from networks with such different inductive biases means the ensemble samples a genuinely diverse space of learned visual features.</p>
<p>A further practical advantage lies in the use of frozen layers. Because the networks are kept in their pretrained state, no gradient-based retraining is required, and the computational burden is limited to the forward and backward passes needed to amplify activations. This makes the method reproducible on modest hardware, an important consideration for creative practitioners who may not have access to large computing clusters. It also means the stylistic character of each network reflects the statistics of the dataset it originally learned from, so the ensemble implicitly blends the visual priors of multiple training runs without any additional data collection.</p>
<p>The evaluation strategy also reflects broader debates in generative image assessment. Metrics such as the Inception Score and the Fréchet Inception Distance are widely used for generative adversarial networks, but they measure distribution-level quality and diversity rather than fidelity to a specific source image. For a technique like Deep Dream, where the output is meant to be a transformation of a particular input, pairwise measures such as SSIM and NCC are more informative. SSIM, originally developed as a perceptual similarity measure grounded in the human visual system, has itself been the subject of ongoing refinement, with data-driven variants proposed to correct its known biases. Reporting both a structural similarity score and a correlation coefficient alongside a loss value therefore gives a more rounded picture of how the ensemble balances novelty against coherence than any single number could.</p>
<p>The work also sits within a lineage of research that repurposes feature-amplification machinery for tasks far removed from art. Deep Dream-style inversion has been used for data-free knowledge transfer between networks, and related mechanisms have appeared in cancellable biometric schemes, authentication systems, and diagnostic imaging pipelines, where amplifying latent features can highlight patterns that are otherwise subtle. In agriculture, image-to-image translation built on deep dreaming has been explored for crop disease datasets, suggesting that the same core operation can serve both aesthetic and analytical ends. The present study&#8217;s contribution to this lineage is architectural: it demonstrates that the aggregation principle, so successful in classification and prediction, transfers cleanly to a generative setting where there is no single correct output to converge upon.</p>
<p>There remain open questions that future work could address. The study relies on a fixed selection of layers within each network, and earlier investigations by overlapping author groups have shown that changing the targeted layers in a single model substantially alters the character of the resulting dream. A systematic exploration of how layer choice interacts with ensemble aggregation, or of how the number of contributing architectures affects the trade-off between richness and fidelity, would deepen the understanding of why the committee approach works. Extending the evaluation beyond pairwise similarity metrics to include human aesthetic judgments or distributional measures could also clarify how the perceived artistic quality of the composite images relates to their measured statistical properties, a question that ultimately lies at the boundary between machine learning and the psychology of visual perception.</p>
<p><strong>Subject of Research:</strong> Generating Deep Dream images using bagging ensemble learning across multiple pretrained convolutional neural network architectures</p>
<p><strong>Article Title:</strong> Generating deep dream images via bagging ensemble learning across multiple pretrained architectures</p>
<p><strong>Article References:</strong> Ali, L. R., Alkhazraji, W., Kadhim, Z. S., Jebur, S. A., Abbas, A. R., Jamil, A. S., Hussein, Z. K., Jaber, T. A., Hussein, H. A., Shaker, B. N., &amp; Hussain, A. J. (2026). Generating deep dream images via bagging ensemble learning across multiple pretrained architectures. <em>Neural Computing and Applications, 38</em>(17), Article 730. <a href="https://doi.org/10.1007/s00521-026-12432-1" rel="noopener noreferrer">https://doi.org/10.1007/s00521-026-12432-1</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s00521-026-12432-1" rel="noopener noreferrer">10.1007/s00521-026-12432-1</a></p>
<p><strong>Keywords:</strong> Deep Dream, ensemble learning, bagging, convolutional neural networks, VGG 16, VGG 19, Xception, Inception v3, Inception-ResNet-V2, SSIM, normalized cross-correlation, AI art</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">193818</post-id>	</item>
	</channel>
</rss>
