AI System Mines Instagram Images to Boost Engagement and Reveal Nutrition

Every day, millions of food photographs flood social media feeds, and behind each one stands a team of marketers, restaurateurs, and content creators hoping their image will stop the endless scroll. A new study from researchers at National Taiwan University of Science and Technology offers those creators something they have never had before: a rule-based artificial intelligence system that evaluates a photograph not only for how engaging it looks, but also for what it communicates about nutrition, and then tells the user exactly how to improve it. The research, published in Multimedia Tools and Applications, tackles one of the most persistent blind spots in social media marketing, where the pursuit of visual appeal has largely ignored the growing consumer demand for nutritional transparency.

The study, led by Kung-Jeng Wang of the Department of Industrial Management together with Jia-Yu Liu of the Graduate Institute of Intelligent Manufacturing Technology, set out to build what the authors describe as an intelligent image design model. Its defining feature is a dual-objective mechanism. Rather than optimizing a single outcome, the system simultaneously evaluates two distinct dimensions of a food photograph: its visual attractiveness as perceived by audiences, and its nutritional content expressed in terms of calorie intake. This pairing is unusual in the image recommendation literature, which has traditionally treated engagement as the sole target. Here, the machine must learn to look at a plate of food and judge both whether people will like it and whether it appears healthful.

To train and validate the model, the researchers assembled a substantial empirical dataset: 6,331 Instagram images drawn from the brunch industry, complete with their associated metadata. Brunch is a particularly instructive domain for this kind of work. Its dishes span an enormous visual and nutritional range, from indulgent plates of pancakes and fried fare to lighter options built around fruit, vegetables, and lean proteins. That variety gives the algorithm a rich signal landscape from which to learn what visual features correlate with high engagement and which ones signal high or low caloric content. The dataset was made openly available on figshare, a decision that allows other researchers to scrutinize, reuse, and extend the work.

The technical pipeline begins with feature extraction. From each image, the system initially derives 311 candidate features, a number that reflects the sheer density of information a photograph can carry: color distributions, compositional attributes, object-level detections, and other measurable visual descriptors. Machine learning on raw high-dimensional data of this kind risks overfitting, so the researchers applied feature selection to distill the 311 candidates down to just 20 significant features. This reduction is more than a computational convenience. It produces an interpretable set of visual cues that the subsequent models actually rely on, which matters enormously when the goal is to hand human marketers concrete advice rather than opaque predictions.

With those 20 features in hand, the team constructed decision-tree models. Decision trees occupy a special place in machine learning because they do not merely classify; they explain. Each branch of a tree corresponds to a condition on a feature, and each path from root to leaf can be read as an if-then rule. In this study, that property is the engine of the whole approach. By growing trees that predict image appeal and trees that classify nutritional content, the researchers could extract actionable rules for image creation and modification, phrases such as the kinds of visual configurations that tend to raise engagement or shift perceived calorie content. The work draws on a mature body of decision-tree research, and it echoes a broader trend of tree-assisted intelligent frameworks being applied to food analysis problems in recent engineering literature.

The empirical results reported in the paper confirm that the model performs effectively on both of its objectives. The system successfully predicts how appealing an image will be to viewers and accurately classifies images on nutritional content, using the compact feature set as input. What elevates the contribution beyond prediction is the recommendation layer: because the underlying models are rule-based, the system does not simply score an image and move on. It generates specific, concrete suggestions for how an image could be created or altered to perform better on either or both goals. For a social media manager deciding how to shoot, style, or edit a photograph, that turns an abstract analytics problem into a practical checklist.

The dual-objective framing also reflects a real tension in contemporary food marketing. Public health researchers have long documented how social media food imagery shapes eating behavior, particularly among younger audiences, and studies have shown that color psychology and packaging cues strongly influence perceptions of healthiness and tastiness. At the same time, brands compete fiercely for attention in feeds saturated with hyper-styled, indulgent imagery. A system that optimizes only for engagement could, in principle, push content toward ever more decadent presentations. By building nutritional perception into the optimization target itself, the Taiwanese team has embedded a public-health-aware constraint directly into the content design process, which the authors position as a genuine integration of engagement metrics with nutritional considerations rather than an afterthought.

The practical implications extend well beyond brunch cafés. The authors argue that the model provides practitioners in the tourism, hospitality, and food sectors with a significant competitive advantage in optimizing visual design strategies. Restaurants and hotel brands increasingly live or die by their Instagram presence, and the cost of producing content is substantial. A tool that can pre-screen candidate photographs, flag weak points, and recommend specific modifications before anything is published could materially change the economics of social media content production. The rule-based output also makes the system auditable: marketers can see exactly why a recommendation is made, which builds trust in a way that black-box deep learning models of images generally do not.

Methodologically, the study positions itself within a lineage of computational aesthetics and social media analytics research, including prior work on predicting the appeal of marketing images, machine learning analyses of color and engagement in touristic Instagram pictures, and earlier image recommendation systems for other product industries. The choice of a rule-based, decision-tree approach over purely deep neural solutions is deliberate. It trades some raw representational power for transparency, and in a domain where the output is meant to guide human creative decisions, that trade appears to pay off. The framework also supports automated content generation pipelines, since the extracted rules can serve as design constraints for generative systems that produce or modify images automatically.

Published as volume 85, article number 770 in Multimedia Tools and Applications, the paper arrives at a moment when the boundary between content creation and algorithmic optimization is dissolving rapidly. Food photography was once judged by intuition and taste; increasingly, it is judged by models trained on thousands of examples of what audiences actually respond to. What distinguishes this work is its insistence that what audiences respond to should not be the only question worth asking. By teaching a machine to care simultaneously about whether a photograph draws the eye and whether it honestly represents the nutrition on the plate, the researchers have sketched a template for a more responsible kind of social media intelligence, one in which the algorithm that helps you go viral is also the algorithm that keeps you honest.

Subject of Research: A rule-based dual-objective machine learning model that recommends social media food images by jointly optimizing visual engagement and nutritional content perception.

Article Title: An intelligent image recommendation system for social media engagement and nutritional transparency: a rule-based dual-objective approach

Article References: Wang, K.-J., & Liu, J.-Y. (2026). An intelligent image recommendation system for social media engagement and nutritional transparency: a rule-based dual-objective approach. Multimedia Tools and Applications, 85(10), Article 770. https://doi.org/10.1007/s11042-026-21918-y

Image Credits: AI Generated

DOI: 10.1007/s11042-026-21918-y

Keywords: social media, Instagram, image recommendation, decision trees, machine learning, nutritional transparency, calorie intake, engagement rate, food photography, dual-objective model, brunch industry, visual perception