Quantum-Inspired Optimizers Fail a Rigorous Cross-Domain Machine Learning Benchmark

A sweeping empirical audit of so-called quantum-inspired optimization algorithms has delivered a sobering verdict for a field that has generated considerable excitement in machine learning circles: when the algorithms are implemented faithfully and tested under controlled, statistically rigorous conditions, no advantage attributable to any quantum-inspired mechanism could be detected. The study, published in Quantum Machine Intelligence by Gorkem Yilmaz of the University of Sussex, spanned tabular data, computer vision, and natural language processing, and its central finding is as striking as it is measurable. The hyperparameter configurations under which quantum-inspired methods are typically reported to succeed train on par with classical baselines, while the actual algorithms themselves fall roughly 10 to 24 accuracy points below those same baselines on tabular tasks, and by far larger margins elsewhere.

The problem the study set out to address is subtle but consequential. Quantum-inspired optimizers occupy an ambiguous middle ground between genuine quantum algorithms and ordinary classical methods. Some, like the quantum natural gradient, are quantum-native in origin but must be approximated classically for neural networks. Others, like quantum-behaved particle swarm optimization, are classical metaheuristics that borrow quantum-mechanical metaphors such as tunneling and superposition. Still others, like simultaneous perturbation stochastic approximation, known as SPSA, and COBYLA, are purely classical algorithms that became associated with quantum computing because they happen to work well for tuning small variational quantum circuits. Because the label spans methods with such different origins, comparisons reported in the literature have often blurred the line between implementing an algorithm and simply relabeling a hyperparameter configuration.

To untangle this, the benchmark introduced a structural taxonomy that assigns every tested configuration to one of three classes: direct implementations of published update rules, documented classical analogs, and hyperparameter controls. The direct implementations included a faithful SPSA that estimates gradients from just two loss evaluations per step without any backpropagation, and a direct adaptation of the quantum-behaved particle swarm update rule to stochastic minibatch training. The classical analog of the quantum natural gradient was implemented as a diagonal second-moment preconditioner, an approximation related to natural gradient descent. The hyperparameter controls preserved the configurations from the study’s earlier version that had carried quantum-inspired labels but were, in fact, classical optimizers with modified settings. This separation allowed the study to ask, with explicit controls rather than labels, whether observed performance differences originate in the algorithm or in the accompanying hyperparameter choices.

The results were unambiguous. On CIFAR-10 with a ResNet18 architecture, where the original version of the study had reported an SPSA result that was by construction a learning-rate-scaled Adam, the revised benchmark found that Adam itself scores about 59 accuracy points above genuine SPSA. On the tabular benchmark, the hyperparameter control trains alongside the classical baselines while the direct algorithms sit roughly 10 to 24 points below. The quantum-behaved particle swarm adaptation remained at or near chance level on every completed LSTM and small convolutional experiment, while consuming 18 to 74 times Adam’s measured wall-clock cost on those tasks. SPSA collapsed to non-finite loss or stagnated at chance on several configurations, and its best computer vision result, about 60.9 percent on Fashion-MNIST with ResNet18, fell far short of the gradient-based arms, all of which exceeded 90 percent on that task.

Perhaps the most illuminating result came from a seed-paired factorial experiment on RoBERTa, a large transformer language model. The original study had reported that its quantum natural gradient-inspired configuration outperformed AdamW, a widely used adaptive optimizer, on language classification tasks. But that configuration had changed two things at once: it halved the learning rate and raised the weight decay. The new 2×2 factorial over learning rate and weight decay, run across three language datasets with five seeds per cell, identified the smaller learning rate as the dominant observed component of the previously reported advantage, contributing roughly half an accuracy point at the dataset level, while the weight-decay effect was small and inconsistent in sign. With only three datasets, the uncertainty intervals spanned zero, meaning the design could not establish a precise population-wide effect, but the direction was clear: the quantum label itself contributed nothing detectable beyond the hyperparameters it happened to carry.

The configured natural gradient analog fared no better. Compared against a learning-rate-matched AdamW arm under identical training protocols, it showed no detectable advantage, with a pooled descriptive difference of about 0.3 accuracy points and a statistical significance value of 0.23, while costing 6 to 7 percent more wall-clock time per run. On ResNet18, its trained endpoints actually exhibited larger dominant-curvature estimates than the Adam family’s, contradicting the intuition that natural-gradient-style preconditioning should find flatter minima. Loss-landscape probes and Hessian curvature measurements at trained endpoints revealed geometry that was qualitatively ordinary, with no curvature signature unique to any quantum-inspired arm.

The statistical protocol underlying these conclusions was deliberately conservative. Every headline comparison used five random seeds with seed-paired t-tests, Holm correction for multiple comparisons within stated families, and explicitly stated detection limits quantifying what differences the design could resolve. Where results were aggregated across three datasets, the study employed modified Hartung-Knapp random-effects inference and an exact sign-flip test, treating the dataset rather than the individual seed as the unit of replication. The full analysis ledger contained 84 inferential quantities, of which 45 were significant uncorrected, 39 survived false-discovery-rate control, and 18 survived a single global Holm correction. The revised campaign comprised 413 training runs, all executed in a single unified codebase on identical hardware, with every result table regenerated programmatically from archived per-run artifacts.

The study is careful about scope. Its negative results apply to neural-network training at parameter counts from roughly ten thousand to over one hundred million, under fixed epoch budgets that mirror practitioner constraints. SPSA remains genuinely valuable in its native regime of low-dimensional, gradient-inaccessible problems such as variational quantum circuits with tens of parameters, where its two-evaluation-per-step cost structure is a real advantage. The authors also acknowledge that a more heavily tuned SPSA could perform better than the configuration tested, and that alternative stochastic-objective designs for particle swarm methods remain unexplored. But at the scales where cost binds, an optimizer whose tuning is itself unaffordable cannot serve as a practical alternative, regardless of its theoretical tuned-optimum performance.

The practical implications are direct. For practitioners, the recommendation is to default to well-tuned Adam or AdamW and to tune the learning rate early, since that single hyperparameter dominated the observed differences in the factorial analysis. For the research community, the study offers both a warning and a tool: benchmarks that fail to separate direct algorithms from classical analogs and hyperparameter controls risk attributing ordinary configuration effects to quantum inspiration, and any future claim of quantum-inspired benefit can now be tested against the auditing taxonomy, factorial protocol, and measurement-backed landscape analysis this benchmark provides. Until such a claim passes those controls, the study concludes, classical adaptive methods remain the correct default for training neural networks, and the quantum-inspired label, however evocative, buys nothing detectable at the scales where modern machine learning actually operates.

Subject of Research: Empirical benchmarking of quantum-inspired versus classical optimization algorithms for machine learning

Article Title: A cross-domain empirical benchmark of quantum-inspired and classical optimization algorithms for machine learning

Article References: Yilmaz, G. (2026). A cross-domain empirical benchmark of quantum-inspired and classical optimization algorithms for machine learning. Quantum Machine Intelligence, 8(2), Article 103. https://doi.org/10.1007/s42484-026-00444-y

Image Credits: AI Generated

DOI: 10.1007/s42484-026-00444-y

Keywords: quantum-inspired optimization, machine learning, neural network training, SPSA, quantum-behaved particle swarm optimization, quantum natural gradient, Adam optimizer, benchmarking, hyperparameters, deep learning, statistical testing, loss landscape