When Machines Meet the Unknown: Why AI Fault Diagnosis Breaks Down and How Scientists Map the Fix

Deep learning has transformed the way engineers watch over rotating machinery. Neural networks trained on vibration signals, acoustic emissions, and current waveforms can now spot a bearing defect or an imbalance long before a human inspector would notice anything wrong. Yet a sweeping new survey published in Artificial Intelligence Review argues that the very success of these systems conceals a dangerous fragility: the moment real-world conditions drift away from the data a model saw during training, its confident diagnoses can quietly turn into confident mistakes. The study, led by Fanwei Lin and colleagues at Xi’an Jiaotong University, is one of the most systematic attempts to map exactly where intelligent fault diagnosis fails when it leaves the laboratory.

The core problem is known in machine learning as out-of-distribution, or OOD, data. A diagnostic network is, at heart, a pattern matcher that learns statistical regularities from a fixed training set. If a model is trained on vibration recordings collected at one motor speed, with one sensor placement, on one fleet of machines, it implicitly assumes those regularities will hold forever. In industrial reality they never do. Loads change, speeds change, sensors age and are replaced, entire machine models are swapped in, and genuinely new fault modes appear that no engineer anticipated when the labels were written. Each of these changes shifts the input distribution, and the survey’s central claim is that this shift splits into two distinct technical demands that the field has too often blurred together.

The first demand is generalization: the model must keep classifying known fault categories accurately even when conditions differ from training. The second demand is detection: the model must recognize when an input belongs to no known category at all and refuse to force it into one of its trained labels. These goals pull in opposite directions. A model tuned to be maximally confident on known faults will often assign absurdly high certainty to unfamiliar inputs, because softmax-based classifiers were never designed to say “I don’t know.” Conversely, a detector tuned to be suspicious of everything novel may start rejecting legitimate fault signals that merely look unusual. The survey treats this tension as the defining operational boundary of the field.

To build the review on solid ground, the authors ran a reproducible literature search across IEEE Xplore, the Web of Science Core Collection, and Scopus, covering publications from January 1, 2020, to July 16, 2026. The search returned 280 database records, which the team reduced to 181 after removing duplicates and then distilled to 161 primary studies specifically concerned with out-of-distribution issues in mechanical fault diagnosis. Each included study was coded according to its deployment role and the type of distribution shift it addressed. That systematic coding, the authors argue, is what allows the field’s scattered results to be compared on equal terms rather than celebrated anecdotally.

A key conceptual contribution of the paper is a task-relative operational definition of what “out-of-distribution” actually means in this domain. Rather than treating OOD as a vague property of data, the survey anchors it in three elements: the effective training support, meaning the data the model actually learned from; the training label space, meaning the fault categories the model was taught; and a declared deployment envelope, meaning the range of conditions the system is promised to handle in service. This framing lets the authors cleanly separate condition-related shifts, which they call C-shifts, from fault-semantic shifts, or F-shifts, and from combined C+F settings where both occur at once. A change in rotational speed is a C-shift; the sudden appearance of a compound gear-mesh defect never present in the training labels is an F-shift; a new machine running at a new speed with a new fault is the combined case.

This taxonomy matters because the two shift types demand different machinery. Generalization-oriented methods, such as domain adaptation and domain generalization, aim to learn representations that are invariant to condition changes, so that a fault signature extracted from a slow-running pump still matches the features the classifier learned from fast-running ones. Detection-oriented methods, drawing on open-set recognition and OOD detection research, instead focus on measuring how far an input lies from the training support, using tools like distance metrics in feature space, energy scores, density estimates, or reconstruction errors from generative models. The survey organizes representative techniques by their deployment role and underlying mechanism, comparing their assumptions, data requirements, output types, strengths, and limitations in a single framework.

The comparison exposes uncomfortable gaps between what papers report and what deployment requires. Many studies evaluate generalization on benchmark datasets where the shift is mild and the label space is closed, which flatters accuracy numbers while saying little about behavior when a truly unknown fault arrives. Others demonstrate detection on synthetic anomalies that barely resemble real mechanical novelty. The survey also notes that the literature frequently conflates general anomaly detection, which flags any statistical outlier, with unknown-fault rejection, which must specifically decide whether a signal belongs outside the declared fault taxonomy. A cooling-fan hum that is statistically odd but mechanically harmless should not trigger the same alarm as an incipient bearing spall, yet generic detectors cannot make that distinction without domain-aware design.

Perhaps the survey’s most consequential argument is architectural in the broadest sense: reliable diagnosis is not a single model property but a system property. The authors contend that any trustworthy deployment must evaluate three components separately and then integrate them coherently. First, known-class generalization must be measured under realistic condition shifts within the declared envelope. Second, OOD detection must be calibrated, meaning that when the system reports uncertainty or novelty, those reports should correspond to actual error rates rather than arbitrary scores. Third, there must be an explicit escalation or human-referral pathway, so that detected unknowns are routed to engineers rather than silently absorbed into the nearest familiar class. A pipeline that excels at the first two but lacks the third still fails the operator, because a flagged anomaly with no defined next step is functionally indistinguishable from an unflagged one.

The scope of the review is deliberately bounded, and the authors are transparent about the exclusions. They do not attempt an exhaustive treatment of closed-set domain adaptation, of domain generalization studies lacking unseen mechanical-domain evaluation, of general anomaly detection unrelated to unknown-fault rejection, of non-mechanical industrial process monitoring, or of general-purpose computer-vision OOD methods, except where such work supplies necessary conceptual foundations. This restraint keeps the 161 included studies focused on the mechanical diagnosis setting, where signals are physical, faults evolve over time, and the cost of a missed or fabricated diagnosis is measured in downtime, damage, and sometimes safety.

For an industry racing to embed AI in turbines, gearboxes, and production lines, the message is sobering but constructive. The survey does not claim that deep-learning fault diagnosis is unreliable; it claims that reliability has been measured with the wrong yardstick. Accuracy on a held-out test set drawn from the same distribution says nothing about the day a new sensor type, a new operating regime, or a never-before-seen failure mode arrives. By giving the field a shared vocabulary of C-shifts, F-shifts, training support, and deployment envelopes, and by insisting that generalization, calibrated detection, and human escalation be judged as separate, testable commitments, the Xi’an Jiaotong team has effectively written the acceptance criteria that future diagnostic systems will have to meet before they can honestly be called intelligent. The machines, it turns out, are only as smart as their honesty about what they do not know.

Subject of Research: Out-of-distribution generalization and unknown-fault detection in deep-learning-based intelligent fault diagnosis of mechanical systems

Article Title: Out-of-distribution challenges in intelligent fault diagnosis: a survey of generalization and detection

Article References: Lin, F., Zhang, L., Guo, C., Zhao, Z., Zhang, X., & Chen, X. (2026). Out-of-distribution challenges in intelligent fault diagnosis: a survey of generalization and detection. Artificial Intelligence Review. https://doi.org/10.1007/s10462-026-11722-3

Image Credits: AI Generated

DOI: 10.1007/s10462-026-11722-3

Keywords: out-of-distribution detection, intelligent fault diagnosis, deep learning, distribution shift, domain generalization, open-set recognition, mechanical systems, predictive maintenance, machine learning, model calibration, domain adaptation, survey