Simple Decision Trees Map the Crowded Landscape of STEM Education Research

STEM education has become one of the fastest-growing fields in educational research, producing thousands of papers each year that span everything from classroom robotics to gender equity in engineering programs. But that growth has come at a cost: the literature is now so vast and fragmented that researchers, funders, and policymakers struggle to identify which themes genuinely dominate the conversation. A new study published in SN Social Sciences by Muhammad Aizri Fadillah of Universitas Negeri Padang and colleagues, including George Kaliampos of the University of Patras, tackles this problem with an unusual tool borrowed from cognitive psychology: fast-and-frugal trees, a family of transparent heuristic classifiers designed to mimic how humans actually make decisions under uncertainty.

The study, published on 5 September 2026, set out to examine what the authors call citation-associated thematic salience in STEM education research. Rather than simply counting how often papers are cited and declaring the most-cited topics to be emerging hotspots, the team asked whether simple keyword-based rules could distinguish highly cited articles from poorly cited ones across five major thematic categories: motivation and self-efficacy, gender and equity, innovative learning approaches, technology in STEM, and career development. The answer, as it turned out, was more nuanced and more instructive than a simple yes.

The researchers began with 2,843 Scopus-indexed English-language articles retrieved through a title-only search, a deliberately conservative strategy that ensured every paper’s title explicitly referenced STEM education. From this pool, they retained 2,289 articles falling into two contrasting citation bands: a lower band of papers with four or fewer citations and an upper band of papers with eleven or more. A further 554 records in the middle of the distribution were excluded, a design choice that sharpened the contrast between the two groups the classifier would attempt to separate. The analysis files and data are openly available on the Open Science Framework, allowing other researchers to scrutinize and extend the work.

Fast-and-frugal trees, first developed by Gerd Gigerenzer and Daniel Goldstein as models of bounded rationality and later formalized by Laura Martignon and colleagues, are decision trees built from a small number of sequential yes-or-no questions. Unlike the opaque internal weights of a neural network, an FFT can be drawn on a single sheet of paper and read by anyone: if a paper’s keywords include cue A, classify it one way; if not, check cue B; and so on until a decision is reached. The FFTrees toolbox of Phillips and colleagues, published in Judgment and Decision Making, made constructing and evaluating such trees straightforward, and this accessibility is precisely what attracted the study’s authors.

The team encoded the presence or absence of thematic keywords in each article’s record and trained FFT classifiers to predict whether a paper belonged to the high-citation or low-citation band. The resulting trees were, as promised, frugal and interpretable, offering a readable snapshot of which keyword patterns tended to co-occur with higher citation counts within each thematic category. For readers wary of black-box bibliometrics, this transparency is a genuine virtue: every classification decision can be traced, questioned, and re-evaluated by a human analyst.

But the performance numbers tell a sobering story, and the authors are refreshingly candid about it. Apparent in-sample accuracy across the trees ranged from 50.5 percent to 52.7 percent, only 0.3 to 2.5 percentage points above the naive majority baseline of 50.2 percent, which a classifier could achieve by simply guessing the more common class every time. The Matthews correlation coefficients, a stricter measure of classification quality that corrects for imbalanced classes, ranged from just 0.028 to 0.104, values conventionally interpreted as negligible to very weak association. In plain terms, the trees barely outperformed a coin weighted toward the majority class.

Crucially, the authors refuse to spin this result. They explicitly interpret the FFTs as an exploratory and highly interpretable description of citation-associated keyword patterns, not as a robust predictive model, not as a measure of research quality, and not as evidence that any given theme is an emerging research hotspot. This is a notable departure from a common pathology in bibliometric studies, where citation frequency is casually equated with scientific importance or topical momentum. A paper may be highly cited because it is excellent, because it is controversial, because it is old, or because it sits in a review-heavy subfield; the study’s framing acknowledges all of these possibilities rather than collapsing them into a single headline number.

The study also identifies three specific limitations that future work must address. The first is publication-age bias: older papers have had more time to accumulate citations, so citation bands partly encode an article’s age rather than its influence, and the keyword patterns the trees detect may simply reflect which themes were popular in earlier decades. The second is literal keyword encoding, since reducing a rich abstract or title to the presence or absence of a handful of terms discards nuance, synonymy, and context. The third is the absence of independent validation: the reported accuracies are apparent in-sample figures, meaning the trees were evaluated on the same data used to build them, and performance on unseen papers could be lower still. The authors flag all three as priorities for future robustness analyses.

Why does a study whose classifiers essentially failed to predict anything matter? The answer lies in what it demonstrates about methodological honesty and about the promise of heuristic tools in meta-research. FFTs offer something that more powerful machine learning methods often lack: complete auditability. In fields like science mapping, where conclusions shape funding priorities and research agendas, a model that anyone can inspect, even a weak one, may be more valuable than an accurate but inscrutable one, provided its limits are stated plainly. The study also contributes a carefully curated, openly available dataset of nearly three thousand STEM education papers, a resource that other teams can use to test stronger methods with proper out-of-sample validation.

The broader lesson for the STEM education community is twofold. First, the field’s thematic structure, spanning motivation, equity, pedagogy, technology, and careers, is real and recognizable, but citation counts alone are a noisy and potentially misleading compass for navigating it. Second, as bibliometric mapping becomes an ever more common genre, the standards for interpreting computational results deserve the same scrutiny as the underlying educational research itself. Fadillah and colleagues have produced a study whose most important finding may be its own modesty: a demonstration that transparent heuristics can illuminate the shape of a literature while honestly admitting when they cannot predict it, and an invitation for the next generation of science-mapping studies to build on that candor rather than repeating the habit of mistaking citation tallies for scientific truth.

Subject of Research: Heuristic bibliometric mapping of STEM education research using fast-and-frugal tree classifiers

Article Title: A heuristic bibliometric mapping of STEM education research: identifying salient thematic patterns using fast-and-frugal trees

Article References: Fadillah, M. A., Kaliampos, G., Samala, A. D., Hirahmah, A., & Usmeldi, U. (2026). A heuristic bibliometric mapping of STEM education research: identifying salient thematic patterns using fast-and-frugal trees. SN Social Sciences, 6(9), Article 406. https://doi.org/10.1007/s43545-026-01705-0

Image Credits: AI Generated

DOI: 10.1007/s43545-026-01705-0

Keywords: STEM education, bibliometrics, fast-and-frugal trees, citation analysis, science mapping, heuristic classifiers, gender equity, self-efficacy, educational technology, Scopus, research trends, open science