<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>deep learning in computer vision &#8211; Science</title>
	<atom:link href="https://scienmag.com/tag/deep-learning-in-computer-vision/feed/" rel="self" type="application/rss+xml" />
	<link>https://scienmag.com</link>
	<description></description>
	<lastBuildDate>Tue, 08 Sep 2026 11:29:01 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1</generator>

<image>
	<url>https://scienmag.com/wp-content/uploads/2024/07/cropped-scienmag_ico-32x32.jpg</url>
	<title>deep learning in computer vision &#8211; Science</title>
	<link>https://scienmag.com</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">73899611</site>	<item>
		<title>Dual-view multi-scale feature enhancement improves fine-grained visual classification</title>
		<link>https://scienmag.com/dual-view-multi-scale-feature-enhancement-improves-fine-grained-visual-classification/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Tue, 08 Sep 2026 11:28:56 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[aircraft variant discrimination]]></category>
		<category><![CDATA[aircraft variant recognition]]></category>
		<category><![CDATA[bird species identification]]></category>
		<category><![CDATA[car model classification]]></category>
		<category><![CDATA[computational efficiency in visual tasks]]></category>
		<category><![CDATA[computationally efficient image classification]]></category>
		<category><![CDATA[computer vision advancements]]></category>
		<category><![CDATA[deep learning for fine-grained recognition]]></category>
		<category><![CDATA[deep learning in computer vision]]></category>
		<category><![CDATA[dual-view neural network]]></category>
		<category><![CDATA[fast inference in fine-grained tasks]]></category>
		<category><![CDATA[Fine-grained visual classification]]></category>
		<category><![CDATA[multi-scale feature enhancement]]></category>
		<category><![CDATA[multi-scale feature fusion]]></category>
		<category><![CDATA[multi-view feature fusion]]></category>
		<category><![CDATA[object category differentiation]]></category>
		<category><![CDATA[object category discrimination]]></category>
		<category><![CDATA[subtle visual cues]]></category>
		<category><![CDATA[subtle visual cues recognition]]></category>
		<category><![CDATA[vehicle model classification]]></category>
		<guid isPermaLink="false">https://scienmag.com/dual-view-multi-scale-feature-enhancement-improves-fine-grained-visual-classification/</guid>

					<description><![CDATA[Fine-grained visual classification has long been one of the most stubborn problems in computer vision, and a new study published in Applied Intelligence suggests a way to crack it without paying the usual price in computational cost. A team of researchers from Qufu Normal University and Jining Polytechnic in China has developed a dual-view multi-scale [&#8230;]]]></description>
										<content:encoded><![CDATA[<p>Fine-grained visual classification has long been one of the most stubborn problems in computer vision, and a new study published in Applied Intelligence suggests a way to crack it without paying the usual price in computational cost. A team of researchers from Qufu Normal University and Jining Polytechnic in China has developed a dual-view multi-scale feature enhancement and fusion network that teaches machines to tell apart nearly identical object categories—different bird species, car models, aircraft variants—while keeping inference as fast as a standard single-branch model.</p>
<p>The problem the researchers tackle is deceptively simple to state and notoriously hard to solve. Where ordinary image classification asks whether a picture shows a bird or a bicycle, fine-grained visual classification, or FGVC, asks whether a bird is a Bachman&#8217;s sparrow or a Botteri&#8217;s sparrow. The distinguishing evidence often resides in a handful of subtle cues: the precise pattern of wing feathers, the shape of a car&#8217;s grille, the configuration of an aircraft&#8217;s tail fin. Meanwhile, the same species can look dramatically different depending on pose, illumination, scale, occlusion, and the messiness of the surrounding background. The authors note that these factors weaken the discriminative responses a neural network relies on and, worse, can induce what the field calls shortcut learning—when a model memorizes contextual clues such as sky or branches rather than the object itself, and then fails to generalize.</p>
<p>At the heart of the new architecture is a lightweight multi-scale feature enhancement module. Deep networks naturally build a hierarchy of feature maps, from coarse, high-level semantic representations to fine, low-level detail. Most pipelines either use only the final layer or fuse layers in a fixed way. The proposed module instead applies multi-branch modeling, processing features at several receptive-field scales in parallel, and then applies channel attention to decide which feature channels carry the most discriminative information for the task at hand. The design deliberately avoids the heavy computational footprint of many attention-based approaches, and the authors emphasize its lightness as a core requirement, since the ultimate goal is a system deployable in real applications such as biodiversity monitoring, intelligent transportation, and industrial inspection.</p>
<p>On top of the enhancement module sits a dynamic feature fusion module. Fusion is where multi-scale pipelines often stumble: simply adding or concatenating feature maps from different levels forces heterogeneous information into a single representation without accounting for spatial misalignment or channel redundancy. The team&#8217;s module aligns enhanced multi-level features and then integrates them adaptively in both the spatial and channel dimensions. In practice, the network learns where in the image and through which channels the fused evidence should be emphasized, producing representations that are measurably more informative than those produced by static fusion schemes. This matters because fine-grained cues are spatially small—a few pixels of plumage pattern may carry more class evidence than the entire background—so the fusion step must not drown them out.</p>
<p>The second pillar of the work is a dual-branch self-distillation framework. The architecture branches into two parallel pathways that share the same underlying network structure: one branch receives raw images, and the other receives an enhanced view of the same image. The enhanced view is constructed using open-vocabulary text-guided foreground cropping, a technique that leverages modern open-set detection models to locate the object of interest based on a text description of the class, and an augmented-view transfer module that aligns the two branches. Because the enhanced branch concentrates on the foreground object, its soft predictions—the probability distributions it produces before hard classification—contain richer, foreground-oriented knowledge. During training, those soft predictions act as a teacher, steering the raw branch toward decision boundaries anchored in the object rather than in background context. This is a form of self-distillation, building on the insight first articulated by Hinton and colleagues that a network&#8217;s softened outputs encode a &#8220;dark knowledge&#8221; about inter-class similarity that hard labels discard.</p>
<p>The payoff arrives at inference time, and it is the study&#8217;s most practically significant claim: only the raw-image branch is retained when the model is deployed. All the additional machinery—the enhancement module&#8217;s extra views, the distillation pathway, the text-guided cropping—exists purely during training. The result is a model that gains accuracy from its dual-view training regime but runs at the speed and memory footprint of a single standard network. For applications like wildlife camera traps or industrial quality control, where thousands of images must be classified on constrained hardware, this &#8220;train heavy, deploy light&#8221; pattern sidesteps the tradeoff that has traditionally forced practitioners to choose between accuracy and efficiency.</p>
<p>The experiments were conducted on the four canonical public benchmarks of the field: CUB-200-2011, the Caltech-UCSD bird dataset containing 200 species; Stanford Cars; Stanford Dogs; and FGVC-Aircraft. These datasets differ in important ways—birds vary mostly in subtle coloration and morphology, cars in rigid geometric details, aircraft in structural features—so consistent gains across all four constitute strong evidence of generality rather than overfitting to a single visual domain. The authors report that extensive experiments demonstrate the effectiveness, robustness, and generality of the proposed method relative to existing approaches, and they supplement accuracy numbers with visualization analyses that show the model&#8217;s attention concentrating on object parts rather than backgrounds.</p>
<p>What distinguishes this work from earlier self-distillation and attention schemes is the combination of three ideas into a single coherent pipeline. Prior FGVC methods have attacked the problem from many angles: recurrent attention models that zoom into discriminative regions, part-based networks that mine local patches, transformer architectures that attend across the whole image, covariance pooling methods that capture second-order statistics, and various distillation frameworks that use a trained model to supervise a second one. Many of these deliver accuracy but at substantial inference cost, or they require bounding-box or part annotations that are expensive to produce. The new approach requires only image-level class labels—learning is weakly supervised in the standard FGVC sense—while borrowing the open-vocabulary capabilities of recent models like Grounding DINO and the Segment Anything Model family to generate its own foreground crops without human annotation of regions.</p>
<p>The work also reflects a broader shift in how vision systems are being assembled. Rather than training a single monolithic classifier, contemporary pipelines increasingly compose foundation models—open-vocabulary detectors, segmenters, pretrained transformers—with task-specific modules. Here, the text-guided cropping component exploits the ability of open-vocabulary models to find &#8220;the bird&#8221; or &#8220;the aircraft&#8221; in a scene without having seen that exact class during detector training. The authors then fold that capability into a distillation objective, effectively using a modern perception tool as a data augmentation and supervision mechanism rather than as part of the deployed model.</p>
<p>Funding for the research came from the Shandong Provincial Natural Science Foundation and the Jining City Key Research and Development Program, the latter tied to a project on intelligent identification of benthic diatoms in the Yellow River Basin—a reminder that the motivation is not abstract. Ecological monitoring depends on distinguishing species that non-experts cannot reliably separate, and automated systems that run cheaply enough for field deployment could transform how biodiversity surveys are conducted. The same logic applies to intelligent transportation, where vehicle subtypes must be identified in real time, and industrial inspection, where surface defects or component variants differ by margins invisible to casual inspection.</p>
<p>The team, led by Ke Zhang with Junkai Zhong, Peng Gao, Qianhao Zhao, Jianlei Liu, and Zhanhua Dong, states that the source code will be made publicly available upon publication, which should allow other groups to verify the gains and adopt the framework. If the results hold up under independent replication, the design pattern—foreground-guided self-distillation combined with efficient multi-scale fusion—could become a template well beyond the FGVC benchmark suite, anywhere vision systems must find the needle of discriminative detail in a haystack of irrelevant visual context.</p>
<div class="scienmag-article-metadata"><strong>Subject of Research:</strong> A dual-view multi-scale feature enhancement and fusion network for fine-grained visual classification, combining lightweight multi-scale feature enhancement, dynamic spatial-channel feature fusion, and dual-branch self-distillation with text-guided foreground cropping to improve accuracy without added inference cost.</p>
<p><strong>Article Title:</strong> Dual-view multi-scale feature enhancement and fusion for fine-grained visual classification</p>
<p><strong>Article References:</strong> Zhang, K., Zhong, J., Gao, P., Zhao, Q., Liu, J., &amp; Dong, Z. (2026). Dual-view multi-scale feature enhancement and fusion for fine-grained visual classification. <em>Applied Intelligence, 56</em>(14), Article 410. <a href="https://doi.org/10.1007/s10489-026-07465-x" target="_blank" rel="noopener noreferrer">https://doi.org/10.1007/s10489-026-07465-x</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s10489-026-07465-x" target="_blank" rel="noopener noreferrer">10.1007/s10489-026-07465-x</a></p>
<p><strong>Keywords:</strong> Fine-grained visual classification, Multi-scale feature enhancement, Dynamic feature fusion, Self-distillation, Text-guided data augmentation, Computer vision, Channel attention, Weakly supervised learning, Image classification, Object recognition</p>
</div>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">190121</post-id>	</item>
		<item>
		<title>CNN-Based Game Theory Approach Improves Similar Image Retrieval</title>
		<link>https://scienmag.com/cnn-based-game-theory-approach-improves-similar-image-retrieval/</link>
		
		<dc:creator><![CDATA[Blake Davidson]]></dc:creator>
		<pubDate>Thu, 03 Sep 2026 17:12:59 +0000</pubDate>
				<category><![CDATA[Technology and Engineering]]></category>
		<category><![CDATA[CNN-based image similarity search]]></category>
		<category><![CDATA[combining color texture shape features]]></category>
		<category><![CDATA[competitive feature modeling]]></category>
		<category><![CDATA[content-based image retrieval (CBIR) systems]]></category>
		<category><![CDATA[content-based image retrieval systems]]></category>
		<category><![CDATA[deep learning and traditional features in multimedia search]]></category>
		<category><![CDATA[deep learning for image search]]></category>
		<category><![CDATA[deep learning in computer vision]]></category>
		<category><![CDATA[fusion of game theory and neural networks]]></category>
		<category><![CDATA[game theory in image search]]></category>
		<category><![CDATA[game theory-based image retrieval]]></category>
		<category><![CDATA[image retrieval]]></category>
		<category><![CDATA[innovative content-based image search methods]]></category>
		<category><![CDATA[iterative image search refinement]]></category>
		<category><![CDATA[machine learning for image retrieval]]></category>
		<category><![CDATA[modern image retrieval techniques]]></category>
		<category><![CDATA[modern image search algorithms]]></category>
		<category><![CDATA[multi-feature image matching]]></category>
		<category><![CDATA[multi-feature image similarity assessment]]></category>
		<category><![CDATA[Nash equilibrium in image matching]]></category>
		<category><![CDATA[Nash equilibrium in image processing]]></category>
		<category><![CDATA[non-cooperative game models in image retrieval]]></category>
		<category><![CDATA[rival visual features in computer vision]]></category>
		<category><![CDATA[strategic negotiation in visual feature analysis]]></category>
		<guid isPermaLink="false">https://scienmag.com/cnn-based-game-theory-approach-improves-similar-image-retrieval/</guid>

					<description><![CDATA[In a development that could reshape how machines search through billions of images, a team of Moroccan researchers has fused two very different intellectual traditions — Cold War-era game theory and modern deep learning — into a single image retrieval system that treats competing visual features as rival players in a strategic negotiation. The study, [&#8230;]]]></description>
										<content:encoded><![CDATA[<p>In a development that could reshape how machines search through billions of images, a team of Moroccan researchers has fused two very different intellectual traditions — Cold War-era game theory and modern deep learning — into a single image retrieval system that treats competing visual features as rival players in a strategic negotiation. The study, published in Multimedia Tools and Applications, describes how color, texture, and shape descriptors can be pitted against one another in a non-cooperative game, with the search refining itself iteratively until no player can improve the outcome. The result is a content-based image retrieval (CBIR) framework that reaches a Nash equilibrium before it returns its final answer, and it outperforms approaches that rely on any single type of visual evidence.</p>
<p>The research, led by Meriem Mansouhi and Samira El Moumen of the Computer Science and Systems Laboratory at Hassan II University of Casablanca, together with Noureddine Moussaid of the university&#8217;s Mathematics, Computer Science and Applications Laboratory in Mohammedia, tackles a stubborn problem in computer vision. Traditional CBIR systems rely on handcrafted features such as color histograms, shape signatures, and texture statistics to find images that look like a query image. Each of these features captures a different slice of visual identity, and none of them is sufficient on its own. A red sports car and a red rose may share a color histogram, while a car photographed at dusk may share nothing with the same car in daylight except its shape. Systems that naively blend features often produce results that satisfy no criterion particularly well — the visual equivalent of a committee compromise.</p>
<p>Mansouhi and her colleagues approached the problem differently. Instead of fusing features with fixed weights, they reformulated retrieval as a multi-criteria optimization problem and solved it with Nash game theory, the mathematical framework famously introduced by John Nash in the 1950s to describe strategic interactions among rational competitors. In the new framework, each feature extraction method is modeled as an independent player in a non-cooperative game. Every player proposes the cluster of images that it judges most visually similar to the query, based on its own representation of the visual world. The game then proceeds through an iterative negotiation: at each step, the intersection of all the proposed similar-image sets becomes the new working dataset, and the process is reapplied to that reduced set. The search narrows like a funnel, round after round, until a Nash equilibrium is reached — a state in which no player can unilaterally improve the retrieval result by changing its proposal.</p>
<p>The technical foundation of the game is a carefully engineered hybrid descriptor set. On the classical side, the system extracts color histograms, a technique whose lineage in image retrieval stretches back to Swain and Ballard&#8217;s seminal 1991 work on color indexing. Color histograms encode the distribution of pixel intensities across color channels in a way that is compact, fast to compute, and robust to small changes in viewpoint and lighting. On the deep learning side, the team adapted a customized variant of the VGG16 convolutional neural network, the sixteen-layer architecture introduced by Simonyan and Zisserman that became a backbone of modern computer vision. The researchers stripped out the network&#8217;s fully connected layers and applied Global Average Pooling to the convolutional outputs, a move that collapses spatial feature maps into compact, fixed-length vectors. This transformation yields descriptors that are simultaneously smaller, more generalizable, and directly comparable across images, while preserving the rich texture and shape information encoded in the convolutional layers.</p>
<p>Once the deep descriptors are extracted, the framework applies unsupervised k-means clustering to organize the image collection into groups within the feature space. Clustering serves a dual purpose: it accelerates retrieval by restricting the search space, and it produces more discriminative image groupings, so that when each game player proposes its candidate cluster, the proposal is meaningful rather than arbitrary. The color histogram player, the deep texture player, and the deep shape player each evaluate the clusters according to their own internal similarity metric, and the intersection mechanism enforces a form of consensus that no single feature could achieve alone. The design echoes the researchers&#8217; earlier work, including a 2021 study by Elmoumen, Moussaid, and Aboulaich that applied Nash equilibrium concepts to image retrieval, but the new system is the first to combine that game-theoretic engine with deep convolutional features and clustering.</p>
<p>To test the framework rigorously, the team evaluated it on two demanding and deliberately contrasting benchmarks. The Oxford5K dataset, originally collected from Flickr images, contains thousands of photographs of Oxford landmarks and is a standard testbed for object and building retrieval, where lighting, viewpoint, and occlusion vary wildly. The HAM10000 dataset, a large collection of multi-source dermatoscopic images of pigmented skin lesions, presents an entirely different challenge: medical images where subtle texture differences can separate benign lesions from malignant ones. The dual evaluation is significant because it demonstrates that the game-theoretic architecture is not tuned to one domain. A system that performs well on both landmark photography and dermatoscopy suggests a general-purpose retrieval mechanism rather than a domain-specific trick.</p>
<p>The implications for medicine are particularly striking. Content-based medical image retrieval has become an active frontier in clinical AI, with recent studies evaluating pre-trained convolutional networks and foundation models as feature extractors for diagnostic support. A retrieval system that can weigh texture cues captured by deep networks against shape and color evidence — and resolve conflicts between them through formal negotiation — could help clinicians find similar past cases for a difficult diagnosis, effectively letting a hospital&#8217;s entire imaging archive serve as a decision-support tool. The HAM10000 results suggest the framework is a credible candidate for that role, though the authors note that both datasets are used strictly for non-commercial research in accordance with their respective terms of use.</p>
<p>What makes the approach conceptually elegant is the way it reframes a familiar engineering problem in the language of economics. Multi-criteria optimization has long been handled with weighted sums, Pareto fronts, or heuristic fusion rules, all of which require a designer to decide in advance how much each criterion matters. The Nash game formulation removes that decision. Each feature player acts rationally in its own interest, and the equilibrium that emerges is a solution that no criterion can dispute. The iterative intersection process also gives the system a natural efficiency benefit: as rounds progress, the candidate set shrinks, so later rounds become faster even as they become more precise. The game, in effect, prunes its own search space.</p>
<p>The work also connects to a broader resurgence of interest in Nash-based methods for image processing. The same research group has previously explored a fractional-order derivative variational framework for blind image deconvolution using a Nash game strategy, and related work has applied game theory to machine learning and similar-image techniques. Meanwhile, the deep learning component sits within a rapidly evolving landscape that includes residual networks, contrastive vision-language models such as CLIP, and newer foundation encoders like SigLIP 2 and DINOv3. The Moroccan team&#8217;s contribution is not to compete with those giant models on raw representational power, but to show that a modest, carefully adapted VGG16 variant, combined with classical color descriptors and disciplined game-theoretic aggregation, can deliver competitive retrieval without massive compute.</p>
<p>The study received no external funding, and the authors declare no competing financial interests. Mansouhi led the literature review, methodology design, implementation, experiments, data analysis, and drafting, while El Moumen and Moussaid jointly conceived the research idea, provided methodological supervision, and critically revised the manuscript. The datasets — Oxford5K from academic benchmark repositories and Kaggle, and HAM10000 from a public Kaggle repository — are freely available to other researchers, which should make replication and extension straightforward for labs working on retrieval, medical imaging, or applied game theory.</p>
<p>As image collections worldwide swell into the billions and AI systems are increasingly asked to find, rank, and compare visual content, the question of how to combine competing notions of similarity grows more urgent. Search engines, medical archives, e-commerce platforms, and digital libraries all face the same fundamental tension: color says one thing, texture another, shape a third, and someone — or something — must arbitrate. By handing the arbitration to Nash&#8217;s equilibrium concept, the Casablanca team has offered a mathematically principled answer, one in which the final retrieval result is not a compromise imposed from above but a stability that emerges from below. If the approach scales as the benchmarks suggest, the next generation of image search may be quietly running a negotiation every time you press enter — and ending it only when every player agrees that no one can do better.</p>
<div class="scienmag-article-metadata"><strong>Subject of Research:</strong> Content-based image retrieval combining convolutional neural network features and game theory via Nash equilibrium optimization</p>
<p><strong>Article Title:</strong> Game theory and CNN for similar images retrieval</p>
<p><strong>Article References:</strong> Mansouhi, M., El Moumen, S., &amp; Moussaid, N. (2026). Game theory and CNN for similar images retrieval. <em>Multimedia Tools and Applications, 85</em>(9), Article 730. <a href="https://doi.org/10.1007/s11042-026-21829-y" target="_blank" rel="noopener noreferrer">https://doi.org/10.1007/s11042-026-21829-y</a></p>
<p><strong>Image Credits:</strong> AI Generated</p>
<p><strong>DOI:</strong> <a href="https://doi.org/10.1007/s11042-026-21829-y" target="_blank" rel="noopener noreferrer">10.1007/s11042-026-21829-y</a></p>
<p><strong>Keywords:</strong> Game theory, Machine learning, Convolutional neural network, Image retrieval, Color descriptors, Shape descriptors, Texture descriptors</p>
</div>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">186481</post-id>	</item>
	</channel>
</rss>
