AI reasoning models show human-like implicit bias in how hard they think

For more than two decades, psychologists have probed the hidden associations inside the human mind with a deceptively simple tool: the Implicit Association Test, or IAT. By measuring how much slower people are when they must pair concepts that conflict with their automatic mental associations, researchers have uncovered patterns of bias that people themselves often do not consciously endorse. Now, a team of researchers has borrowed that logic and pointed it at a new kind of mind — the reasoning model, a class of large language models that generates explicit, step-by-step chains of thought before answering. The result is a striking demonstration that artificial systems may carry bias-like signatures not in what they say, but in how much effort it takes them to think.

The study, published in Nature Machine Intelligence by Messi H. J. Lee of Washington University in St. Louis and Calvin K. Lai of Rutgers University, introduces what the authors call the reasoning-model implicit association test, or RM-IAT. Rather than measuring reaction times in milliseconds, as the human IAT does, the RM-IAT measures reasoning-token counts — the number of tokens a model produces in its internal reasoning process before arriving at an answer. The central insight is an analogy of computational effort: just as humans take longer to respond when a task conflicts with their implicit associations, a reasoning model may expend more computational effort — more thinking tokens — when a task is incompatible with the associations embedded in its learned representations.

The technical setup mirrors the classic two-block design of the human IAT. In association-compatible blocks, the pairing of a social category with a stereotypical attribute aligns with the associations the model is presumed to have absorbed from its training data. In association-incompatible blocks, those pairings are crossed, requiring the model to reason against the grain of its learned statistics. The researchers then compared the reasoning-token counts across the two conditions. If the model’s internal associations lean in a stereotypical direction, the incompatible condition should demand more elaborate reasoning, and therefore more tokens, to reach an equally acceptable answer.

Across four reasoning models — OpenAI’s o3-mini, DeepSeek-R1, gpt-oss-20b and Qwen3-8B — the researchers found consistent evidence for exactly that pattern. Association-incompatible tasks reliably required greater computational effort than association-compatible tasks, producing effect sizes analogous to the latency differences observed in human IAT studies. In other words, when these models were forced to reason in ways that cut across stereotypical associations, their chain-of-thought processes grew measurably longer, as though the models needed to work harder to override a default tendency. The consistency of the effect across four architecturally different models, trained by different organisations with different pipelines, suggests the phenomenon is not an idiosyncrasy of a single system but a general property of reasoning models trained on human language.

One model, however, broke the pattern in a fascinating way. Claude 3.7 Sonnet exhibited reversed effects: it expended more computational effort on association-compatible tasks rather than incompatible ones. A thematic analysis of its reasoning traces revealed why. Unlike the other models, Claude 3.7 Sonnet’s internal reasoning frequently turned inward, scrutinising the possibility of bias and stereotypes in the task itself before answering. This self-monitoring — an apparent product of its safety training — meant that stereotype-consistent pairings triggered extra deliberation about whether responding in line with a stereotype was appropriate, inflating token counts precisely where the other models were fastest. The finding offers a vivid illustration that the RM-IAT does not merely detect raw statistical associations; it detects the shape of a model’s processing dynamics, including the compensatory reflexes instilled by alignment training.

A crucial question for any such measure is whether it captures something meaningful about behaviour or is merely a statistical curiosity. The researchers addressed this by testing convergent validity: they examined whether RM-IAT effects predicted biases in downstream model outputs on tasks known to elicit biases in large language models. They found evidence that models showing stronger RM-IAT effects also displayed measurable biases in word association tasks and in decision-making scenarios — two domains where LLM bias has been extensively documented in prior research. This predictive relationship echoes the meta-analytic literature on the human IAT, where implicit measures show modest but reliable correlations with judgement and behaviour. In the machine context, the analogy suggests that the effortful override seen in reasoning tokens is not decoupled from what the models ultimately produce.

The theoretical framing draws heavily from the psychology of automaticity. Implicit biases are characterised as automatic mental processes that shape perception, judgement and behaviour — processes that are efficient, unintentional and often outside awareness. The human IAT operationalises this through the principle that compatible associations facilitate processing while incompatible ones impede it. Lee and Lai’s contribution is to argue that the same logic can be applied to reasoning models, where chain-of-thought generation provides a visible, countable trace of processing. Previous studies of bias in language models have focused almost exclusively on outputs — whether the model’s answers are discriminatory, whether generated text contains stereotypes, whether word embeddings encode prejudicial associations. The RM-IAT shifts the analytical lens upstream, to the reasoning process itself, opening a window on bias-like dynamics that output-level audits can miss.

The findings also connect to a growing body of evidence that surface-level debiasing does not eliminate deeper associations. Prior work has shown that explicitly unbiased language models can still form biased internal associations, and that alignment techniques such as reinforcement learning from human feedback may suppress stereotypical outputs without eradicating the underlying statistical tendencies learned from training corpora. The RM-IAT results are consistent with this picture: the models studied presumably produce carefully hedged, often non-stereotypical answers on sensitive topics, yet their reasoning processes still show the signature of effortful override when tasks run against stereotypical associations. Bias, in this sense, appears to persist as a property of the models’ computational dynamics even when it is masked at the output layer.

For AI developers and auditors, the practical implications are significant. Reasoning-token counts are cheap to measure, require no special access to model weights, and can be collected at scale, making the RM-IAT a potential screening tool for bias-like processing in deployed systems. Because the measure is sensitive to training interventions — as the Claude 3.7 Sonnet reversal demonstrates — it could serve as a diagnostic for whether safety training changes not just what models say but how they think. At the same time, the authors are careful with the interpretation: the measure captures bias-like processing differences, not proof of subjective experience or attitudes in the human sense. The analogy is structural, drawing on a shared signature of processing efficiency, rather than a claim that models possess minds with unconscious prejudice.

The broader significance of the work lies in the deepening dialogue between cognitive science and machine learning. Tools built to illuminate the automatic workings of the human mind are proving unexpectedly informative about statistical systems trained on human-produced text, and the patterns they reveal — effortful override, association-driven processing costs, dissociations between expression and underlying tendency — are recognisably familiar. As reasoning models become the dominant interface through which people interact with artificial intelligence, understanding the hidden dynamics of their chains of thought becomes as important as auditing their answers. The RM-IAT offers a rigorous, replicable method for doing so, and its central finding — that the hardest thinking for a reasoning model is often the thinking that goes against its associations — is likely to shape how researchers study machine bias for years to come. The authors have released their data openly on Figshare and their code on GitHub, with archived versions on Zenodo and a reproducible capsule on Code Ocean, ensuring that other laboratories can immediately extend this new bridge between the psychology of implicit bias and the engineering of reasoning machines.

Subject of Research: Measurement of implicit-bias-like processing patterns in large language model reasoning systems

Article Title: Implicit-bias-like patterns in reasoning models

Article References: Lee, M. H. J., & Lai, C. K. (2026). Implicit-bias-like patterns in reasoning models. Nature Machine Intelligence. https://doi.org/10.1038/s42256-026-01300-1

Image Credits: AI Generated

DOI: 10.1038/s42256-026-01300-1

Keywords: implicit bias, reasoning models, large language models, RM-IAT, computational effort, stereotypes, AI fairness, chain-of-thought reasoning, psychology of AI, algorithmic bias, Nature Machine Intelligence, implicit association test