The investigation centered on whether an LLM could navigate the intricacies of reviewing real, unfiltered patient charts—often fraught with incomplete, inconsistent, or ambiguous data—and effectively synthesize the information to arrive at accurate diagnoses and recommend appropriate next steps. Unlike many prior studies that rely on sanitized or idealized datasets, this research embraced the inherent complexity and “messiness” of live electronic health records (EHRs), thereby reflecting authentic clinical environments and offering a robust assessment of AI’s practical performance.

Employing evaluation benchmarks rooted in long-established standards for assessing physician competence—some dating back to methodologies developed in the 1950s—the researchers subjected the model to rigorous diagnostic challenges, clinical reasoning exercises, and real-time emergency department case analyses. The LLM was tested continuously at various critical junctures of patient care, from initial triage when data are sparse to admission decisions informed by more comprehensive clinical findings.

Remarkably, the AI model not only matched but often surpassed the diagnostic accuracy of experienced attending physicians during these early decision points. This finding was particularly striking given the traditionally unpredictable and data-scarce nature of early emergency assessments. Researchers noted that the model’s ability to operate under these conditions signaled a transformative shift in AI’s readiness to contribute meaningfully to frontline medical decision-making.

Co-senior author Arjun (Raj) Manrai, assistant professor of biomedical informatics at Harvard Medical School, emphasized that while the AI model eclipsed previous iterations and physician baselines across multiple clinical tasks, this accomplishment does not imply that autonomous AI-driven medical practice is imminent. Instead, he underscored the importance of conducting rigorous prospective clinical trials to systematically evaluate the impact and safety of integrating AI tools in diverse care settings before widespread adoption.

Peter Brodeur, MD, MA, a co-first author and clinical researcher at BIDMC, highlighted a significant implication of these findings for the future of AI evaluation metrics. Traditional assessment methodologies, such as multiple-choice tests long used to gauge medical knowledge, no longer offer sufficient resolution to differentiate the rapidly advancing capabilities of modern AI systems, which are now routinely achieving near-perfect scores. This ceiling effect necessitates innovative, contextually rich benchmarks that mirror the nuanced realities of clinical practice.

Furthermore, the study’s design preserved the authenticity of emergency department workflows by presenting the LLM with clinical data precisely as recorded in the EHR, unprocessed and unfiltered. Adam Rodman, MD, MPH, hospitalist and co-senior author, noted the deliberate avoidance of data smoothing techniques common in many AI trials, thereby challenging the model to contend with the full breadth of real-world clinical variability and imperfections.

Despite the model’s promising performance, the researchers maintain a cautious stance regarding its clinical deployment. They acknowledge that although the AI may frequently propose the correct leading diagnosis, it might also recommend additional tests or interventions that are unnecessary or potentially harmful, underscoring that human clinicians must remain integral to the diagnostic workflow to ensure patient safety and care quality.

Thomas Buckley, a doctoral student at Harvard’s AI in Medicine PhD program and co-first author of the study, emphasized the significance of assessing AI’s capabilities early in the diagnostic trajectory, when patient information is limited. This approach more accurately reflects real-world decision-making processes and challenges, challenging the AI to demonstrate proficiency in ambiguous and evolving clinical scenarios rather than well-defined, retrospective cases.

Collectively, these results herald a pivotal moment in the field of medical artificial intelligence. Rather than viewing these systems’ promising diagnostic accuracy as endpoints, the authors advocate for their evaluation through the lens of medical science’s gold standard: controlled clinical trials in authentic healthcare environments. This approach will elucidate the true benefits, limitations, and safety considerations inherent in adopting AI-assisted clinical practice.

The institutions spearheading this research—Harvard Medical School and Beth Israel Deaconess Medical Center—are renowned for their leadership in medical innovation, education, and research. Their combined expertise has facilitated a landmark study that not only challenges previous assumptions about AI’s clinical abilities but also sets a new benchmark for future investigations exploring how artificial intelligence can augment human judgment in medicine.

Looking ahead, the study propels the conversation about AI’s role in healthcare beyond theoretical performance metrics into practical, patient-centered applications. It underscores the pressing need for interdisciplinary collaboration among technologists, clinicians, ethicists, and policymakers to navigate the complex landscape of AI integration responsibly and effectively.

In sum, this research redefines expectations for large language models in clinical environments, proving that AI systems are now capable of reasoning and decision-making at a level that rivals seasoned physicians, particularly in the fast-paced and unpredictable context of emergency medicine. However, it equally stresses that the path forward requires prudence, comprehensive validation, and a reaffirmation of the indispensable role of human expertise in ensuring patient welfare.

Subject of Research: Not applicable

Article Title: Performance of a large language model on the reasoning tasks of a physician

News Publication Date: 30-Apr-2026

Web References: 10.1126/science.adz4433

Keywords

AI common sense knowledge, Computer science, Machine learning, Clinical medicine

Flinders University experts are warning that artificial intelligence (AI) must be carefully evaluated and governed before it is adopted widely in healthcare, saying rapid advances do not automatically translate into safe use for patients.

In an expert commentary titled ‘AI can reason like a physician; what comes next? published in Science, Flinders researchers caution that while new AI systems show impressive capabilities, strong results in controlled studies do not mean they are ready for routine use in hospitals or clinics.

The authors say there is an urgent need to understand how emerging AI tools can be safely integrated into everyday clinical practice, with patient outcomes remaining the central focus.

Despite these warnings, the researchers acknowledge that recent advances in AI create genuine opportunities to support doctors, particularly in busy and high-pressure care settings.

The commentary reviews new research showing that advanced reasoning-based AI systems can work through diagnostic scenarios step by step and, in some cases, closely match or even exceed the diagnostic performance of experienced doctors.

Erik Cornelisse, a PhD candidate at Flinders University and co-author of the commentary, says this shift marks a move from simple question answering tools towards algorithms capable of seemingly human-like clinical reasoning on text-based tasks.

However, the Flinders team stresses that real world medical care involves far more than text-based reasoning or test performance.

They say clinical practice depends on physical examination, listening to patients, understanding medical and social context, and taking responsibility for outcomes, elements that current AI systems cannot safely provide on their own.

“Health care decisions are complex, high stakes, and deeply human, and accuracy alone, particularly on just text-based cases, does not make a system safe for patients,” says Mr Cornelisse from the College of Medicine and
Public Health.

Senior author Associate Professor Ash Hopkins, an NHMRC Investigator and leader of Flinders’ Clinical Cancer Epidemiology Lab, says modern healthcare relies on judgement, accountability, and ethical oversight.

“AI systems have demonstrated that they can reason through clinical problems with similar performance to doctors, notably on the same scenarios used to train clinicians themselves. This presents genuine opportunities to support clinicians in the future,” says Associate Professor Hopkins.

“Multiple stakeholders are currently working on the frameworks for AI in terms of legal, professional, or moral responsibility for its decisions, and presently there is a critical need for deliberate and controlled integration into clinical care.”

The commentary highlights known risks linked to poorly evaluated systems, including bias, inequitable care, and unintended patient harm.

“History shows that algorithms can worsen outcomes when deployed without sufficient safeguards and can amplify problems as easily as they solve them, particularly when systems are trained on incomplete or unrepresentative data,” says Mr Cornelisse.

Looking ahead, the Flinders researchers argue that enthusiasm for medical AI must be matched by strong governance and clearer standards for evaluation.

“We do not allow doctors to practise without supervision and evaluation, and AI should be held to comparable standards,” says Mr Cornelisse.

The researchers stress that improvement in real patient outcomes, not exam scores, benchmarks, or demonstrations, must be the true measure of success.

Associate Professor Hopkins says AI holds enormous promise but must be applied responsibly.

“Patients deserve technology that improves care in the real world, not systems that only look impressive in studies,” he says.

“With careful design, strong oversight, and rigorous evaluation, AI could become a powerful tool to deliver safer, fairer, and more effective care across health systems worldwide,” concludes Associate Professor Hopkins.

The paper, ‘AI can reason like a physician; what comes next?’, by Ashley M. Hopkins and Erik Cornelisse is published in SCIENCE.  DOI 10.1126/science.aeg8766 (link live after embargo lifts)

Journal

Science

Funder

National Health and Medical Research Council

DOI

10.1126/science.aeg8766

Pediatric fractures remain a critical concern, particularly when considering the delicate nature of children’s health and the potential for misdiagnosis. Current diagnostic methods rely heavily on traditional imaging techniques, which may not always accurately identify small but significant lesions. The researchers’ investigation was prompted by the urgent need for faster and more reliable imaging interpretations, especially when these diagnoses can impact legal outcomes. The implications of incorrect diagnoses are profound, underscoring the necessity for innovative solutions in pediatric radiology.

The study’s core focus was on the diagnostic performance of AI algorithms in detecting small fractures, often missed by human radiologists. Utilizing a vast dataset comprising radiographic images, the researchers developed and trained AI models to identify high-risk pediatric fractures. The results were striking; the AI exhibited an impressive capability to accurately detect these fractures, often surpassing the performance of traditional diagnostic approaches. This is a pivotal finding that could transform how fractures in children are diagnosed, ensuring that critical lesions do not go unnoticed.

The implications of these findings extend beyond mere diagnostics. Lowering the risk of misdiagnosis can directly impact treatment protocols, reducing the chances of complications from untreated fractures. With the swift identification of high-risk injuries, healthcare professionals can institute timely and appropriate interventions. This efficiency not only enhances patient care but also minimizes the potential for legal challenges that may arise from misdiagnoses, a critical factor in today’s complex medicolegal landscape.

The researchers emphasized the importance of the AI’s reliability and accuracy. By integrating AI into the diagnostic workflow, radiologists can significantly enhance their interpretations, especially in ambiguous cases where human judgment may falter. The potential for AI to serve as a powerful adjunct to human expertise can lead to improved outcomes for pediatric patients, provided that the technology is implemented effectively and ethically within clinical practice.

Moreover, this study highlights a vital intersection between technology and healthcare, where advancements in AI are paving the way for more comprehensive diagnostic tools. The researchers acknowledged that while AI offers significant promise, it is crucial to maintain rigorous standards of safety and efficacy. The deployment of AI in medical settings must be accompanied by ongoing validation and assessments to ensure that these systems continuously meet the necessary clinical benchmarks.

Addressing the ethical concerns surrounding AI in medicine is also paramount. Ensuring patient confidentiality and data security while utilizing AI technologies is essential in maintaining trust between patients and healthcare providers. The research team called for stringent guidelines and frameworks to govern the usage of AI in diagnostics, emphasizing that the goal should be to enhance, rather than replace, the human element in patient care.

Looking toward the future, the potential for AI in pediatric radiology seems boundless. Ongoing advancements in machine learning and imaging technologies may lead to even more refined tools capable of accurately diagnosing a wider array of conditions. The hope is that AI will not only reduce the incidence of diagnostic errors but will also play a role in predictive analytics, allowing for preemptive measures based on risk assessments.

As the landscape of pediatric healthcare continues to evolve, the significance of research like that conducted by Pape et al. cannot be understated. Their findings are expected to ignite a renewed interest in the integration of AI within radiology departments nationwide, thereby fostering collaboration between technologists and medical professionals. The insights gleaned from this study may well serve as a springboard for future research initiatives aimed at further understanding the role of AI in diagnostics.

Moreover, these innovations may help elevate the standard of care for children seeking treatment for fractures. If integrated properly, AI could empower healthcare professionals to make more informed decisions, thus improving overall patient outcomes. The radiology community stands on the precipice of significant changes, driven by cutting-edge technology that has the potential to fundamentally alter practices for the better.

In conclusion, the integration of artificial intelligence into pediatric fracture diagnostics holds tremendous potential for enhancing diagnostic accuracy and patient safety. As this field continues to develop, it will be essential to navigate the journey with careful consideration of ethical standards and the human elements of care. The vision for a future where AI assists in timely and accurate diagnoses is rapidly materializing, thanks to the vital research being conducted today.

Subject of Research: The role of artificial intelligence in diagnosing pediatric fractures

Article Title: Small lesion–high risk: diagnostic performance of artificial intelligence in paediatric fractures with medicolegal impact.

Article References:

Pape, J., Deffaa, O., Zimmermann, P. et al. Small lesion–high risk: diagnostic performance of artificial intelligence in paediatric fractures with medicolegal impact. Pediatr Radiol (2025). https://doi.org/10.1007/s00247-025-06456-3

Image Credits: AI Generated

DOI: 10.1007/s00247-025-06456-3

Keywords: Pediatric fractures, artificial intelligence, diagnostic accuracy, radiology, medicolegal impact, healthcare technology.

The research revealed that AI systems demonstrate considerable proficiency when addressing factual and procedural medical questions, aligning closely with established expert knowledge in these domains. Nevertheless, these models frequently faltered when confronted with nuanced questions requiring explanatory reasoning—commonly framed as “why” and “how” types—highlighting the persistent gap between algorithmic output and the depth of human clinical insight. This disparity underscores the current boundaries of AI’s interpretive and contextual understanding in complex healthcare scenarios, which remain fundamentally reliant on experiential judgment.

One of the study’s most striking findings concerned the consistency of AI responses. Within a given session, AI systems maintained stable answers, yet when the same queries were posed across multiple sessions, variations emerged. Such discrepancies raise significant concerns, especially when diagnostic accuracy and patient safety hang in the balance. This inconsistency suggests that while AI can be a valuable aid, it cannot yet replace the nuanced and adaptive thinking that human clinicians bring to evolving medical cases. These results call for ongoing refinement of AI algorithms to enhance reliability and foster trust among users.

The research further delves into the qualitative aspects of AI-generated responses, particularly their emotional resonance and communicative style. Unlike human clinicians, whose responses exhibited variable lengths tailored to the complexity of inquiries, AI answers were notably uniform, generally comprising between 400 and 475 words regardless of the question’s nature. Moreover, vocabulary analysis revealed AI’s tendency to employ clinical jargon without adapting its language to patient comprehension or emotional sensitivity. This mechanical delivery often lacked the empathy critical in contexts such as mental health discussions or terminal illness consultations, where human warmth and compassion fundamentally shape therapeutic rapport.

Experts consulting on the study emphasized that medical practice hinges on interpersonal connections unreplicable by AI. Physical presence, nuanced communication, and empathetic engagement form the cornerstone of effective healing, roles that technology cannot supplant. Kelley Strout, associate professor at UMaine’s School of Nursing, highlighted that the true transformative potential lies in synergistic integration—where AI augments clinical judgment and compassion rather than attempting to substitute human care providers. Such integration, however, mandates stringent ethical frameworks and vigilant oversight to preempt errors and unintended consequences.

Contextualizing the study within the broader healthcare landscape reveals a striking urgency propelled by systemic strain, particularly in the U.S. The nation grapples with acute shortages in primary and specialty care providers, exacerbating wait times, inflating costs, and disproportionately affecting rural populations. Projections paint a sobering picture: nonmetropolitan areas alone are expected to face a 42% shortfall in primary care physicians by 2037, intensifying existing healthcare disparities. In parallel, the aging population—projected to increase by more than 50% among those aged 65 and older between 2022 and 2026—further amplifies the demand for effective and accessible health services.

Against this backdrop, AI emerges as a potential ally in alleviating some pressure points. The technology could offer round-the-clock virtual assistance, triaging capabilities, and augment patient-provider communication via portals and remote platforms. Yet, researchers caution that the rapid rollout of AI tools, absent comprehensive regulatory guardrails and ethical safeguards, risks eroding care quality and may exacerbate societal inequities, especially if AI systems are trained on limited, non-representative datasets. Ensuring inclusivity in AI development is paramount to avoiding the reinforcement of existing healthcare biases.

A critical lesson drawn from prior technological adoptions—such as the widespread implementation of electronic health records (EHR)—resonates through the study. Despite the promise of EHRs to streamline workflows and improve outcomes, many systems were originally designed around billing imperatives, not clinical efficacy or user experience, resulting in provider dissatisfaction and compromised patient engagement. The study’s experts urge that AI developers heed these mistakes by centering patient outcomes and provider workflows in system design, thus fostering tools that genuinely enhance care delivery rather than provoke frustration or disengagement.

Moreover, the study highlights the pressing need for addressing accountability and patient privacy in the context of AI’s increasing role in clinical decision-making. Ethical concerns loom large, demanding thoughtful policies tailored to the regulatory and cultural environments of implementation locales. Transparency surrounding AI decision processes and mechanisms for error reporting and correction will be essential for widespread acceptance. Without these foundational pillars, AI’s role risks becoming a source of ambiguity and mistrust rather than clarity.

Despite the challenges, the study supports a growing consensus: AI technologies hold immense potential to optimize healthcare by augmenting rather than replacing human providers. By efficiently sifting through vast datasets and highlighting patterns, AI can expedite diagnosis and recommendation processes in ways previously unattainable. However, the emotional intelligence that human clinicians bring, coupled with their ethical judgment, remains irreplaceable in delivering patient-centered care. Balancing these dimensions stands as the new frontier in digital health evolution.

Future research directions outlined by the study underscore the importance of advancing AI’s interpretive capabilities while concurrently managing ethical risks. Tailoring AI tools to diverse healthcare systems—accounting for differences in regulation, culture, and infrastructure—is critical to ensuring equitable and effective deployment. Such adaptations will enable AI to function as a truly supportive asset, enhancing the humanity and efficiency of medical practice without undermining the clinician-patient relationship.

Technological progress in artificial intelligence is poised to reshape healthcare delivery profoundly. Yet, as C. Matt Graham, author of the study, poignantly states, “Technology should enhance the humanity of medicine, not diminish it.” The crux of innovation lies in designing AI systems to serve as complementary extensions of the clinician’s expertise—intelligent assistants enabling more informed, compassionate, and timely care—rather than autonomous decision-makers disconnected from the nuances that define human-centered medicine.

As healthcare systems worldwide wrestle with growing logistical complexities, workforce shortages, and expanding patient needs, the integration of AI offers both formidable opportunities and daunting challenges. This University of Maine study represents a pivotal stepping stone toward clarifying AI’s role, charting a course that maximizes benefits while safeguarding core humanistic values intrinsic to the art and science of healing.

Subject of Research: Comparative analysis of AI and human clinician diagnostic performance on complex medical queries across different healthcare systems

Article Title: Artificial intelligence vs human clinicians: a comparative analysis of complex medical query handling across the USA and Australia

News Publication Date: 27-May-2025

Web References:

• Journal article: https://www.emerald.com/insight/content/doi/10.1108/jhom-02-2025-0100/full/html
• DOI: http://dx.doi.org/10.1108/JHOM-02-2025-0100

References:

• Health Resources and Services Administration (2024). State of the Primary Care Workforce Report. https://bhw.hrsa.gov/sites/default/files/bureau-health-workforce/state-of-the-primary-care-workforce-report-2024.pdf

Keywords: Artificial intelligence, Generative AI, Machine learning, Computer science, Technology, Health and medicine, Health care, Health care delivery, Clinical medicine