The research, published in the Journal of New Approaches in Educational Research, tackles a problem that has long frustrated educational data scientists: with so many machine learning models available, each with its own tuning requirements, how does an institution without a dedicated data science team find the one that works best for its data? The authors’ answer was to let an algorithm do the searching. Using the Auto-Weka framework, which automates both model selection and hyper-parameter optimization, the team allowed a search procedure to iterate through a long list of predictive strategies and their associated settings until it converged on the configuration that delivered the highest classification accuracy.

The search landed on an ensemble model, a strategy that combines the outputs of several base classifiers rather than relying on any single one. The ensemble evaluated in the study drew on five constituent techniques: artificial neural networks, K-nearest neighbors, Naive Bayes, support vector machines, and logistic regression. Each of these brings a distinct mathematical personality to the task. Neural networks learn layered, nonlinear representations of the data through weighted connections between artificial neurons. K-nearest neighbors classifies a new student by looking at the most similar labeled cases in the training set, using distance functions such as the Euclidean metric. Naive Bayes applies Bayesian probability under the simplifying assumption that features are conditionally independent, which makes it fast to train. Support vector machines construct an optimal separating hyperplane between classes, using kernel functions to handle data that cannot be split linearly. Logistic regression maps a linear combination of inputs through a sigmoid function to produce a probability between zero and one.

In the neural network component used here, the architecture consisted of an input layer representing the categorized data features, two hidden layers containing twelve and seven neurons respectively, and a single output neuron representing the binary outcome. The sigmoid activation function was chosen because it modulates values smoothly between zero and one, making it well suited to probability-style outputs. For the support vector machine, the researchers employed a polynomial kernel of a specified degree, which implicitly casts the data into a higher-dimensional space where, according to Cover’s theorem, a hyperplane is more likely to separate the two classes cleanly. These technical choices, normally the province of experienced practitioners, were arrived at automatically through the AutoML search rather than by manual trial and error.

The dataset behind the study came from the academic records of students enrolled in a university course at Damietta University between 2016 and 2021. The raw collection contained 480 records, but after preprocessing to remove outliers, missing values, and inconsistencies, 461 usable instances remained. The data was split into a training set of 329 instances, roughly seventy percent, and a test set of 132 instances, roughly thirty percent. Five features described each record: the academic year, the midterm score, the writing exam score, the final degree, and the overall grade. The grades were distributed across five categories from A to F, with D grades, representing a pass, the most common at nearly thirty-eight percent of students, followed by F grades, representing failure, at nearly twenty-nine percent.

The failure statistics buried in those records are striking. In 2016, 70.21 percent of students in the course failed, and in 2017 the rate climbed to a peak of 71.21 percent. The picture improved dramatically in later years, with failure rates of 19.66 percent in 2018, 9.78 percent in 2019, 16.13 percent in 2020, and 17.07 percent in 2021, but the early years illustrate exactly why institutional decision makers want early-warning tools. Only twelve students across the entire five-year span achieved the top A grade, a mere 2.6 percent of the sample, underscoring how demanding the course was and how much room there is for targeted intervention.

When the researchers benchmarked seven classification methods on the test set, the ensemble approaches dominated. Bagging, which trains multiple models on resampled subsets of the data and aggregates their votes, classified all 132 test instances correctly, achieving one hundred percent accuracy along with perfect precision, recall, F-measure, and kappa statistics. Random Forest, a related ensemble built from decision trees, misclassified just one instance, yielding 99.26 percent accuracy and scores of 0.99 across the other metrics. Naive Bayes followed at 95.68 percent accuracy, then the artificial neural network at 91.6 percent, logistic regression at 90.13 percent, K-nearest neighbors at 89.82 percent, and the support vector machine at 79.3 percent. The kappa coefficients, which correct for agreement that could occur by chance, told the same story, ranging from 0.74 for the support vector machine to a perfect 1.0 for Bagging.

The comparison with earlier literature is instructive. Previous studies had reported Random Forest accuracy of 72.4 percent and Naive Bayes accuracy of 88.3 percent on comparable tasks, while K-nearest neighbors had reached 92.6 percent in one survey. The substantially higher figures in the current work suggest that the combination of careful preprocessing, the AutoML-driven selection of hyper-parameters, and the intrinsic strength of ensemble methods can push performance well beyond what individual classifiers typically achieve. The authors attribute the ensemble advantage to the interdependencies among features: because the predictors are correlated, combining multiple base learners that each capture different aspects of those relationships produces a more robust and more accurate overall model than any single technique can manage alone.

The practical implications extend beyond the leaderboard. The researchers frame the predictive model as a decision-support tool for medical sector colleges, one that could inform amendments to admission systems and student selection methods using statistics and grades accumulated over the preceding five years. Identifying weak students early, particularly in the first year when dropout risk peaks, would allow institutions to intervene without lowering educational standards. The study is candid about its limitations, however: the dataset covered a single course at one institution, contained only five features, and relied on records from students who had already begun their studies rather than applicants. The authors note that most published work using methods like Naive Bayes similarly depends on data from enrolled students, which limits how early in the pipeline predictions can be made.

Future work, the team writes, will expand both the number of features and the number of instances in the dataset to enable deeper analysis of educational data, with the goal of better distinguishing struggling students from thriving ones and ultimately reducing failure rates. They also plan to layer optimization techniques such as differential evolution and genetic algorithms onto the predictive framework, potentially squeezing out further gains. For now, the study stands as a compelling demonstration that automated machine learning can compress what used to be a specialist’s weeks of model tuning into an algorithmic search, and that when it comes to forecasting the academic fate of medical students, the wisdom of many models combined decisively outperforms the judgment of any one.

Subject of Research: Automated machine learning for predicting academic performance of medical students

Article Title: Predicting student performance academic using Automated Machine Learning (AutoML): in medical academic institutions

Article References: Abougalala, R. A., Alharbi, N., Amasha, M. A., Areed, M. F., Alkhalaf, S., & Khairy, D. (2025). Predicting student performance academic using Automated Machine Learning (AutoML): in medical academic institutions. Journal of New Approaches in Educational Research, 14(1), Article 19. https://doi.org/10.1007/s44322-025-00038-9

Image Credits: AI Generated

DOI: 10.1007/s44322-025-00038-9

Keywords: AutoML, machine learning, student performance prediction, medical education, ensemble methods, Random Forest, Bagging, educational data mining, Damietta University, classification algorithms, dropout prediction, learning analytics

The study, published in Neural Computing and Applications, presents a bagging ensemble framework that combines the outputs of five pretrained convolutional neural network architectures: VGG 16, VGG 19, Xception, Inception v3 and Inception-ResNet-V2. Rather than asking one network to imagine the hidden patterns inside an image, the researchers let all five dream simultaneously and then aggregate their visions through iterative processes that enhance the features of the final image. The result, the team reports, is a Deep Dream output that maintains a high degree of similarity to the input while producing complex and aesthetically striking imagery.

Deep Dream works by exploiting the way convolutional neural networks perceive the world. These networks learn hierarchical features, with early layers detecting simple edges and textures and deeper layers responding to abstract concepts such as faces, eyes or animal shapes. When the technique amplifies the activations of chosen layers and feeds the result back through the network, the image spirals into the surreal patterns that made the method an internet sensation. The problem, however, is that a single architecture captures only one interpretation of the image’s features, and that narrow viewpoint can limit the quality and diversity of the generated dream.

The research team addressed this limitation by treating each pretrained network as a distinct dreamer. In each of the five CNN architectures, the model selects specific layers to activate, including some frozen layers, a choice that enhances the process of feature extraction. Because each network was trained on large image datasets and developed its own internal vocabulary of visual features, the ensemble effectively harvests a wider spectrum of patterns than any single model could reveal. The outputs are aggregated so that shared structures reinforce one another while idiosyncratic artifacts tend to fade, and a final scaling step refines the output image.

Bagging, short for bootstrap aggregating, is a classical ensemble strategy usually applied to prediction tasks, where multiple models trained on slightly different samples of data vote on an outcome. Applying it to image generation is less common, and it is here that the study makes its mark. Instead of sampling the data, the method samples the models themselves, drawing on architectures with different depths, block structures and activation behaviors. VGG 16 and VGG 19, with their stacks of small convolutional filters, emphasize texture-like patterns; the Inception family, with its multi-scale modules, blends information across several receptive field sizes; Xception’s depthwise separable convolutions decompose spatial and channel-wise filtering in yet another way. Each contributes a different stylistic signature to the composite dream.

To evaluate the approach objectively, the researchers tested their generated images using three metrics: loss, the Structural Similarity Index Measure (SSIM), and Normalized Cross-Correlation (NCC). SSIM quantifies how closely the structure of the generated image matches the original, capturing perceived changes in luminance, contrast and structure, while NCC measures the linear correlation between the two images. The generated images exhibited a loss value of 8.5589, with SSIM and NCC values of 0.2404 and 0.7622 respectively. The authors interpret these values as evidence that the ensemble method keeps the generated dreams anchored to the source image even as it introduces elaborate new patterns.

The numbers also hint at the fundamental tension at the heart of Deep Dream. An SSIM of 0.2404 indicates that the generated image departs substantially from its source in structural terms, which is precisely the point of the technique: the goal is transformation, not replication. The comparatively high NCC of 0.7622 shows that the two images remain strongly correlated in their overall signal, suggesting the algorithm amplifies what is already latent in the picture rather than inventing unrelated content. Striking that balance, the researchers argue, is where the bagging ensemble proves its robustness.

The work builds on the authors’ earlier explorations of hybrid artistic models that combined Deep Dream with multiple CNN architectures, extending the idea into the ensemble learning framework that has proven so effective elsewhere in machine learning. It also joins a growing body of research that treats generative visual systems not merely as technical curiosities but as instruments of creative practice, from simulated visual hallucination studies in virtual reality to biometric and diagnostic applications that borrow Deep Dream’s feature-amplification machinery.

For artists and designers, the findings suggest a practical path forward: rather than settling for the idiosyncrasies of one pretrained model, creators can blend the perceptual biases of several networks to steer the mood and texture of their generated work. Because all five architectures are publicly available and pretrained, the approach does not require expensive training runs, making ensemble dreaming accessible to studios and hobbyists alike. The integration of CNN variants in a bagging ensemble framework, the authors conclude, paves the way for further innovations at the intersection of artificial intelligence and artistic expression, confirming the role of ensemble learning in supporting and enhancing visual art.

Beyond the gallery, the technique’s underlying principle, aggregating diverse feature extractors to stabilize and enrich a generative process, could inform other domains where neural networks are asked to reinterpret images, including data augmentation, style transfer and synthetic data generation for training vision systems. As generative AI continues to reshape how images are made and consumed, studies like this one remind us that some of the most compelling machine creativity comes not from bigger models but from teaching machines, like human artists, to compare notes.

The choice of architectures in the study is not arbitrary. All five networks were originally designed for large-scale image classification challenges, and each has since become a standard backbone in computer vision research. VGG-style networks, introduced in the mid-2010s, remain popular despite their age because their uniform structure of small convolutional filters produces feature maps that are easy to interpret and manipulate. The Inception lineage introduced the idea of running convolutions at several filter sizes in parallel within a single module, while Inception-ResNet-V2 added residual connections that ease the training of very deep stacks. Xception pushed this logic further by replacing standard filters with depthwise separable convolutions, a design that later influenced efficient mobile architectures. Drawing dream content from networks with such different inductive biases means the ensemble samples a genuinely diverse space of learned visual features.

A further practical advantage lies in the use of frozen layers. Because the networks are kept in their pretrained state, no gradient-based retraining is required, and the computational burden is limited to the forward and backward passes needed to amplify activations. This makes the method reproducible on modest hardware, an important consideration for creative practitioners who may not have access to large computing clusters. It also means the stylistic character of each network reflects the statistics of the dataset it originally learned from, so the ensemble implicitly blends the visual priors of multiple training runs without any additional data collection.

The evaluation strategy also reflects broader debates in generative image assessment. Metrics such as the Inception Score and the Fréchet Inception Distance are widely used for generative adversarial networks, but they measure distribution-level quality and diversity rather than fidelity to a specific source image. For a technique like Deep Dream, where the output is meant to be a transformation of a particular input, pairwise measures such as SSIM and NCC are more informative. SSIM, originally developed as a perceptual similarity measure grounded in the human visual system, has itself been the subject of ongoing refinement, with data-driven variants proposed to correct its known biases. Reporting both a structural similarity score and a correlation coefficient alongside a loss value therefore gives a more rounded picture of how the ensemble balances novelty against coherence than any single number could.

The work also sits within a lineage of research that repurposes feature-amplification machinery for tasks far removed from art. Deep Dream-style inversion has been used for data-free knowledge transfer between networks, and related mechanisms have appeared in cancellable biometric schemes, authentication systems, and diagnostic imaging pipelines, where amplifying latent features can highlight patterns that are otherwise subtle. In agriculture, image-to-image translation built on deep dreaming has been explored for crop disease datasets, suggesting that the same core operation can serve both aesthetic and analytical ends. The present study’s contribution to this lineage is architectural: it demonstrates that the aggregation principle, so successful in classification and prediction, transfers cleanly to a generative setting where there is no single correct output to converge upon.

There remain open questions that future work could address. The study relies on a fixed selection of layers within each network, and earlier investigations by overlapping author groups have shown that changing the targeted layers in a single model substantially alters the character of the resulting dream. A systematic exploration of how layer choice interacts with ensemble aggregation, or of how the number of contributing architectures affects the trade-off between richness and fidelity, would deepen the understanding of why the committee approach works. Extending the evaluation beyond pairwise similarity metrics to include human aesthetic judgments or distributional measures could also clarify how the perceived artistic quality of the composite images relates to their measured statistical properties, a question that ultimately lies at the boundary between machine learning and the psychology of visual perception.

Subject of Research: Generating Deep Dream images using bagging ensemble learning across multiple pretrained convolutional neural network architectures

Article Title: Generating deep dream images via bagging ensemble learning across multiple pretrained architectures

Article References: Ali, L. R., Alkhazraji, W., Kadhim, Z. S., Jebur, S. A., Abbas, A. R., Jamil, A. S., Hussein, Z. K., Jaber, T. A., Hussein, H. A., Shaker, B. N., & Hussain, A. J. (2026). Generating deep dream images via bagging ensemble learning across multiple pretrained architectures. Neural Computing and Applications, 38(17), Article 730. https://doi.org/10.1007/s00521-026-12432-1

Image Credits: AI Generated

DOI: 10.1007/s00521-026-12432-1

Keywords: Deep Dream, ensemble learning, bagging, convolutional neural networks, VGG 16, VGG 19, Xception, Inception v3, Inception-ResNet-V2, SSIM, normalized cross-correlation, AI art