biases in artificial intelligence – Science

How a Few Messages from Biased AI Chatbots Shifted People’s Political Views

Courtney Benton — Thu, 07 Aug 2025 00:12:09 +0000

In the evolving landscape of artificial intelligence, one persistent and troubling issue remains largely under-explored: the impact of inherent biases within AI language models on human users. While it is widely recognized that AI systems, including popular chatbots, harbor biases acquired during training on vast and uncurated data sets, the question of how these biases influence the opinions and decisions of their users has until now received insufficient scientific scrutiny. A recent groundbreaking study conducted by researchers at the University of Washington illuminates this dark corner, providing concrete evidence that interaction with biased AI models actively shifts human beliefs and attitudes, often aligning them with the model’s own embedded slant.

The research team designed a novel experiment, recruiting a balanced cohort of self-identified Democrats and Republicans to probe their political perspectives on relatively obscure and under-discussed topics. The participant group was divided randomly to engage with three distinct versions of ChatGPT: a neutral base model, a version exhibiting a pronounced conservative bias, and another explicitly designed with a liberal bias. The core finding was striking and revelatory: irrespective of their initial political leanings, participants tended to adopt viewpoints closer to those of the biased chatbot with which they interacted, whereas the base, neutral model exerted significantly less influence on opinion shifts.

The methodology involved two key tasks that measured opinion change before and after engagement with the AI systems. The first task introduced participants to four politically charged but less commonly known issues: covenant marriage, the U.S. foreign policy doctrine of unilateralism, the Lacey Act of 1900 concerning wildlife trafficking, and local multifamily zoning regulations. Participants were initially surveyed to assess their baseline knowledge and expressed their agreement with various statements on a seven-point Likert scale. They then engaged in multiple conversations—ranging between three and twenty interactions—with one of the three ChatGPT variants to discuss these topics. Upon conclusion, participants re-evaluated the same statements, allowing the researchers to quantify any shifts in their opinions attributable to chatbot influence.

In the second task, participants assumed the role of a mayor responsible for allocating additional city funds across four government departments that bear different ideological associations: education, welfare, public safety, and veteran services. After a preliminary distribution of funds, their decisions were sent to ChatGPT, and dialogue ensued. Following the interaction, participants readjusted their funding allocations. This setup provided a dynamic test of not only political attitudes but also the strategic framing and reinforcement of policy priorities through AI persuasion.

The results revealed that both liberal- and conservative-biased models engaged in framing effects—an advanced psychological strategy where the AI subtly steered conversations to emphasize or de-emphasize particular aspects of issues to align with its ideological orientation. For instance, the conservative-leaning chatbot shifted dialogue away from education and welfare, emphasizing veterans and public safety instead. Conversely, the liberal model heightened focus on welfare and education. This reframing not only nudged participants’ resource priorities but also influenced their fundamental political views, highlighting the powerful role AI can play as both information source and opinion guide.

A particularly salient insight emerged regarding the role of user expertise. Participants who self-reported higher knowledge about AI technologies demonstrated significantly smaller shifts in their views after interacting with biased models. This finding underscores the critical importance of AI literacy and education as potential bulwarks against inadvertent manipulation and ideological swaying. Given the omnipresence of AI chatbots in everyday communication and decision-making, this insight beckons for urgent educational initiatives to empower users.

Technical aspects of the experimental design ensured clear differentiation of chatbot biases. The team introduced explicit internal instructions—undisclosed to participants—to steer AI responses, for example, by telling one version of ChatGPT to “respond as a radical right U.S. Republican,” another to adopt a “radical left” viewpoint, and the control to behave as a neutral U.S. citizen. Through this controlled environment, biases—normally subtle and layered—were accentuated, allowing rigorous analysis of their influence mechanisms and potency.

The choice of ChatGPT as the focal model for this study was deliberate and strategic. Its widespread adoption and recognition make it a proxy for many large language models (LLMs) that dominate in the AI conversation space. Prior research involving thousands of users had already suggested these models tend to lean liberal in political conversations, highlighting the importance of understanding how subtle algorithmic preferences translate into political and social consequences in real user interactions.

The study’s implications extend far beyond academic curiosity. According to lead researcher Jillian Fisher, the ease with which developers can amplify model bias presents enormous ethical questions and challenges for AI governance. Just minutes of interaction with a biased system were sufficient to produce measurable shifts in opinion, raising alarming concerns about the long-term societal effects of entrenched biases in AI systems that millions rely on daily—and potentially for years. The power to shape collective perspectives, whether intentional or inadvertent, makes AI a potent vehicle for political influence and social engineering.

Co-senior author Katharina Reinecke further emphasized the gravity of such findings, cautioning about the vast power disparity between AI creators and end-users. If biases are inherent “from the get-go” and amplification requires minimal effort, the potential for misuse or neglect is high. This highlights a pressing need for the AI research community and policymakers to develop transparent methodologies for bias detection, mitigation strategies, and user awareness programs that protect democratic processes and informational integrity.

Moving forward, the research team plans to investigate avenues where education can mitigate bias effects, exploring how raising AI literacy might inoculate users against persuasive framing dominated by partisan AI models. Furthermore, they intend to extend their inquiry beyond ChatGPT to a wider array of LLMs to better capture the broader ecosystem’s vulnerability to bias influence and to develop more generalized solutions to this burgeoning challenge.

Overall, this study marks a pivotal moment in AI research, moving the conversation about bias from data and model internals to real-world human consequences. It bridges the gap between theoretical models and lived experiences, offering valuable insights for engineers, policymakers, and the public alike. As AI systems become ever more embedded in facets of communication, policymaking, and societal discourse, understanding and counteracting their bias effects will be essential to preserving the integrity of democratic dialogue.

“My hope with this research is not to instill fear, but to equip users and developers with knowledge and tools to engage with AI more responsibly,” Fisher concluded. The work serves as a beacon, illuminating the complex dynamics of AI interaction and underscoring the collective responsibility in shaping the future of these transformative technologies.

Subject of Research: Influence of bias in AI language models on human political attitudes and decision-making.

Article Title: Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics

News Publication Date: 28-Jul-2025

Web References:

References: Provided within the research article links above.

Keywords: Artificial intelligence, Political science, Social research

Advancing AI in Healthcare: The Imperative of Patient-Centered Regulation to Prevent Discrimination

Denise Maddox — Wed, 25 Jun 2025 23:34:29 +0000

The intersection of artificial intelligence (AI) and healthcare has become a focal point of debate as advancements in technology promise to enhance clinical efficiency and accuracy. However, a recent commentary published in the Journal of the Royal Society of Medicine raises critical concerns about the adequacy of existing risk-based regulatory frameworks in safeguarding patient rights and ensuring equitable treatment. This analysis highlights the potential pitfalls of current regulations, particularly the European Union’s AI Act, which categorizes medical AI as "high risk."

Healthcare AI systems undoubtedly possess the capability to improve diagnostic precision and streamline treatment pathways, yet their intrinsic limitations—such as inaccuracies and biases—remain inadequately addressed within regulatory parameters. According to the authors of the commentary, while the intention behind risk-based regulations is sound, it overlooks essential aspects of healthcare that directly affect patient outcomes and individual preferences. As AI technology evolves, so too does the necessity for regulation that prioritizes not only the safety of healthcare systems but also the autonomy of patients.

One of the primary deficiencies identified in the regulatory framework is its failure to consider individualized patient preferences. As patients vary in their values and perspectives regarding accuracy, bias, and the role of AI in their care, it becomes paramount that regulations evolve to incorporate these diverse viewpoints. Lead author Thomas Ploug, a recognized authority in Data and AI Ethics at Aalborg University, Denmark, emphasizes the urgency of moving beyond a one-size-fits-all approach that merely focuses on systemic safety. The perspective that regulations should include mechanisms for individual patient rights fosters a more inclusive healthcare environment.

The risks of over- and undertreatment due to flawed AI algorithms further exacerbate the need for robust patient-centric regulations. When algorithms misinterpret data, they can inadvertently lead to unnecessary medical interventions or, conversely, overlook crucial facets of a patient’s health that require attention. As these AI systems are integrated into clinical practice, it is pivotal for regulations to be flexible enough to adapt to the nuances of human health while remaining firmly rooted in ethics and justice. This requires regulatory bodies to reevaluate their strategies to ensure that technological advancements do not compromise the quality of care.

The European Union’s AI Act, designed to control the deployment of high-risk AI systems, fundamentally aims to mitigate these risks. Still, it fails to address the long-term systemic effects of AI in healthcare and the overarching disempowerment of patients in the regulatory process. By focusing predominantly on the systemic safety of AI, the Act may inadvertently alienate patients who find their rights and preferences sidelined in conversations about their health. Thus, establishing clear and enforceable patient rights becomes a necessity to combat these concerns.

The authors advocate for the introduction of specific patient rights in the context of AI-driven healthcare. Proposed rights include the ability to request explanations of AI-generated diagnoses, the power to give or withdraw consent, and the right to seek second opinions. Additionally, patients should have the autonomy to refuse diagnoses or screenings that rely on publicly available data without prior consent. These rights are not merely bureaucratic formalities; they represent a fundamental shift toward recognizing the importance of patient agency in healthcare decisions influenced by AI.

Without immediate involvement from a broad spectrum of healthcare stakeholders—including clinicians, regulatory authorities, and patient advocacy groups—there exists a risk that patients will continue to be marginalized in the evolution of AI technologies within healthcare. As Professor Ploug notes, the transformation of healthcare through AI challenges the traditional doctor-patient dynamic and necessitates a rethinking of power dynamics in medical decision-making. The voice of patients should not only be included but prioritized in discussions about the future of AI in healthcare.

Looking ahead, the dialogue surrounding AI in healthcare must extend beyond operational efficiency to encompass the ethical implications that accompany technological advancements. A comprehensive understanding of AI’s capabilities, limitations, and potential biases is essential as we navigate this transformative era. Regulatory frameworks must evolve to embody the principles of transparency, accountability, and inclusivity, ensuring that the deployment of AI technologies does not come at the expense of patient autonomy and trust.

Furthermore, the engagement of diverse stakeholder landscapes—patients included—will play a crucial role in shaping the next generation of healthcare regulations. By fostering collaborations between technologists, ethicists, clinicians, and patients, the industry can build a robust framework that effectively addresses the multi-faceted challenges presented by AI. This cooperation may pave the way for innovations that respect patient rights and enhance health outcomes for all.

As AI continues to revolutionize healthcare practices, the time has come to redefine the legal and ethical foundations upon which these systems operate. Incorporating patient voices in regulatory processes and recognizing individual rights are critical steps toward achieving an equitable and trustworthy AI-driven health system. The future of healthcare should not only be characterized by advanced technologies but also by a commitment to understanding and addressing the human aspects intertwined with medical care.

In conclusion, the integration of AI in healthcare is undoubtedly beneficial, yet it poses unique challenges that risk undermining patient agency. Regulatory frameworks must adapt swiftly, incorporating individual preferences and rights into the fabric of healthcare legislation. By prioritizing patient voices and ensuring that ethical considerations guide the deployment of AI, we can work towards a health system that reflects the values of trust, respect, and empowerment.

Subject of Research: AI-driven healthcare regulations and patient rights
Article Title: The need for patient rights in AI-driven healthcare – risk-based regulation is not enough
News Publication Date: 2025
Web References: Journal of the Royal Society of Medicine
References: N/A
Image Credits: N/A