Thursday, November 19, 2026
Science
No Result
View All Result
  • Login
  • HOME
  • SCIENCE NEWS
  • CONTACT US
  • HOME
  • SCIENCE NEWS
  • CONTACT US
No Result
View All Result
Scienmag
No Result
View All Result
Home Science News Medicine

Study Finds ChatGPT Outperforms Gemini and Copilot on Basic Orthodontic Questions

November 19, 2026
in Medicine
Ophelia Keating
By Ophelia Keating Scienmag Editorial Profile - Health Services Research
Reading Time: 3 mins read
0
Study Finds ChatGPT Outperforms Gemini and Copilot on Basic Orthodontic Questions

Study Finds ChatGPT Outperforms Gemini and Copilot on Basic Orthodontic Questions

65
SHARES
587
VIEWS
Share on FacebookShare on Twitter
ADVERTISEMENT

In a cross-sectional comparative evaluation of conversational artificial intelligence platforms, researchers determined that ChatGPT generated significantly more accurate and reliable answers to layperson orthodontic queries than Google Gemini or Microsoft Copilot. The investigation assessed how effectively these widely accessible chatbots address common questions regarding retainers, mini-implants, and lateral cephalograms, identifying measurable differences in reliability across models and topic domains.

Artificial intelligence systems based on large language models have rapidly become prominent information sources in medical and dental contexts, yet their factual dependability for orthodontic inquiries has remained uncertain. To evaluate their performance under standardized conditions, investigators examined how three free conversational tools answered questions typical of prospective dental patients seeking foundational knowledge online.

The experimental protocol utilized a dataset of 61 orthodontic questions gathered directly from frequently asked queries in the Google search bar. Between May 10 and May 15, 2026, identical standardized prompts formulated for a lay audience were entered into the free tiers of ChatGPT using GPT-4o, Gemini running version 1.5 Flash, and Microsoft Copilot across three primary orthodontic categories: retainers, mini-implants, and lateral cephalograms.

To evaluate the outputs, five board-certified orthodontists independently reviewed each AI-generated response using a validated five-point scoring rubric ranging from 1, representing completely inaccurate or poor content, to 5, designating highly accurate or excellent explanations. Inter-examiner agreement among the five clinical evaluators was excellent, demonstrating a two-way random-effects intraclass correlation coefficient of 0.87 with a 95 percent confidence interval spanning from 0.81 to 0.92.

Statistical evaluation revealed significant overall performance disparities among the three platforms, evidenced by a Friedman test statistic of 48.32 with a p-value below 0.001 and a Kendall’s W effect size of 0.396. Across all 61 evaluated prompts, ChatGPT achieved the highest overall mean score of 4.31 with a 95 percent confidence interval from 4.20 to 4.42, demonstrating superior educational quality across the tested domains.

Gemini achieved the second-highest overall mean rating at 3.94 with a 95 percent confidence interval from 3.82 to 4.06, while Microsoft Copilot recorded an overall mean score of 3.67 with a 95 percent confidence interval between 3.53 and 3.81. Pairwise post-hoc Wilcoxon signed-rank tests applying a Bonferroni correction threshold confirmed that ChatGPT significantly outperformed both Gemini and Copilot, with p-values falling below 0.001 for both comparisons.

Topic-specific consistency varied notably across the different orthodontic domains analyzed in the trial.

The study concluded that while AI-driven conversational agents present promising potential as supplementary educational instruments in orthodontics, substantial variability in scientific reliability and clinical consistency remains. The authors emphasized that limitations surrounding dynamic model updates and evaluator subjectivity necessitate careful professional supervision, underscoring that AI outputs should complement rather than replace professional clinical consultations.

Beyond general factual correctness, the study framework established four distinct evaluative criteria: reliability, accuracy, completeness, and clinical applicability. By evaluating questions across retainers, mini-implants, and lateral cephalograms against these multidimensional benchmarks, the protocol determined whether freely available AI platforms can generate sufficiently complete and dependable guidance for laypersons seeking basic orthodontic knowledge.

In analyzing the resulting scores, the investigators selected statistical methods suited to the paired structure of the experimental dataset. Because all three conversational platforms answered the identical 61 questions, the data points were paired per query rather than treated as independent samples. This dependent structure informed the non-parametric paired comparisons conducted via the Friedman test, which evaluated rank differences across two degrees of freedom and quantified the overall effect size using Kendall’s W. For post-hoc pairwise comparisons between individual AI models, the researchers applied Wilcoxon signed-rank tests adjusted by a Bonferroni correction threshold of alpha equals 0.017 to maintain statistical rigor. Furthermore, inter-examiner reliability was specifically calculated using a single-measures formulation, denoted as ICC (2,1), to assess the consistency of the scoring rubric across independent raters.

Subject of Research: Comparative accuracy and reliability of AI chatbots in answering basic orthodontic queries

Article Title: Assessing the reliability of artificial intelligence tools for laypersons seeking basic orthodontic knowledge: focus on retainers, mini-implants, and lateral cephalograms

Article References: Rizwan, S., Nasir, L., Ahmed, I., Sattar, A., Tabassum, H., & Anis, B. (2026). Assessing the reliability of artificial intelligence tools for laypersons seeking basic orthodontic knowledge: focus on retainers, mini-implants, and lateral cephalograms. BMC Oral Health. https://doi.org/10.1186/s12903-026-10439-7

Image Credits: AI Generated

DOI: 10.1186/s12903-026-10439-7

Keywords: orthodontics, artificial intelligence, ChatGPT, GPT-4o, Google Gemini, Gemini 1.5 Flash, Microsoft Copilot, dental education, retainers, mini-implants, lateral cephalograms, inter-examiner reliability, Friedman test, BMC Oral Health, clinical consultations, patient education

Cite Scienmag News

Ophelia Keating. (November 19, 2026). Study Finds ChatGPT Outperforms Gemini and Copilot on Basic Orthodontic Questions. Scienmag. https://scienmag.com/study-finds-chatgpt-outperforms-gemini-and-copilot-on-basic-orthodontic-questions/

Ophelia Keating. "Study Finds ChatGPT Outperforms Gemini and Copilot on Basic Orthodontic Questions." Scienmag, 19 November 2026, https://scienmag.com/study-finds-chatgpt-outperforms-gemini-and-copilot-on-basic-orthodontic-questions/. Accessed 19 November 2026.

Ophelia Keating. "Study Finds ChatGPT Outperforms Gemini and Copilot on Basic Orthodontic Questions." Scienmag. November 19, 2026. https://scienmag.com/study-finds-chatgpt-outperforms-gemini-and-copilot-on-basic-orthodontic-questions/

Tags: Artificial IntelligenceBMC Oral HealthChatGPTclinical consultationsdental educationFriedman testGemini 1.5 FlashGoogle GeminiGPT-4ointer-examiner reliabilitylateral cephalogramsMicrosoft Copilotmini-implantsorthodonticspatient educationretainers
Share26Tweet16
Previous Post

Faricimab Resolves Refractory Macular Edema in Two UGH Syndrome Cases

Next Post

Composite Metabolic Adiposity Indices Predict Incident Diabetes in Adults With Clinical Obesity

Related Posts

Serum OGG1 Levels Are Lower in Prediabetes and Type 2 Diabetes
Medicine

Serum OGG1 Levels Are Lower in Prediabetes and Type 2 Diabetes

November 19, 2026
Maternal KIR and Fetal HLA-C Pairings Show Insufficient Evidence for Routine IVF Interventions
Medicine

Maternal KIR and Fetal HLA-C Pairings Show Insufficient Evidence for Routine IVF Interventions

November 19, 2026
Adaptive Functioning Challenges Distinguish Prenatal Alcohol Exposure From ADHD Symptoms
Psychology & Psychiatry

Adaptive Functioning Challenges Distinguish Prenatal Alcohol Exposure From ADHD Symptoms

November 19, 2026
Docking Scores Do Not Establish Binding Affinity in Lung Adenocarcinoma Study
Cancer

Docking Scores Do Not Establish Binding Affinity in Lung Adenocarcinoma Study

November 19, 2026
Deep Learning Predicts Schizophrenia Risk Following Antecedent Psychosis in Claims Cohorts
Psychology & Psychiatry

Deep Learning Predicts Schizophrenia Risk Following Antecedent Psychosis in Claims Cohorts

November 19, 2026
Signaling Axis in Amniotic Membrane Drives Labor Onset and Preterm Birth
Medicine

Signaling Axis in Amniotic Membrane Drives Labor Onset and Preterm Birth

November 19, 2026
Next Post
Composite Metabolic Adiposity Indices Predict Incident Diabetes in Adults With Clinical Obesity

Composite Metabolic Adiposity Indices Predict Incident Diabetes in Adults With Clinical Obesity

  • Mothers who receive childcare support from maternal grandparents show more optimized

    Mothers who receive childcare support from maternal grandparents show more parental warmth, finds NTU Singapore study

    27656 shares
    Share 11059 Tweet 6912
  • University of Seville Breaks 120-Year-Old Mystery, Revises a Key Einstein Concept

    1061 shares
    Share 424 Tweet 265
  • Bee body mass, pathogens and local climate influence heat tolerance

    682 shares
    Share 273 Tweet 171
  • Researchers record first-ever images and data of a shark experiencing a boat strike

    546 shares
    Share 218 Tweet 137
  • Groundbreaking Clinical Trial Reveals Lubiprostone Enhances Kidney Function

    531 shares
    Share 212 Tweet 133
Science

Embark on a thrilling journey of discovery with Scienmag.com—your ultimate source for cutting-edge breakthroughs. Immerse yourself in a world where curiosity knows no limits and tomorrow’s possibilities become today’s reality!

RECENT NEWS

  • Serum OGG1 Levels Are Lower in Prediabetes and Type 2 Diabetes
  • Maternal KIR and Fetal HLA-C Pairings Show Insufficient Evidence for Routine IVF Interventions
  • MACH2 Maps Complete Spaces of Optimal Cancer Migration Histories Across Metastatic Tumors
  • Self-Compassion and Academic Burnout Show Bidirectional Links in Chinese Adolescents

Categories

  • Agriculture
  • Anthropology
  • Archaeology
  • Athmospheric
  • Biology
  • Biotechnology
  • Blog
  • Bussines
  • Cancer
  • Chemistry
  • Climate
  • Earth Science
  • Editorial Policy
  • Marine
  • Mathematics
  • Medicine
  • Pediatry
  • Policy
  • Psychology & Psychiatry
  • Science Education
  • Science News
  • Social Science
  • Space
  • Technology and Engineering

Subscribe to Blog via Email

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 5,151 other subscribers

© 2026 Scienmag - Science Magazine

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In
No Result
View All Result
  • HOME
  • SCIENCE NEWS
  • CONTACT US

© 2026 Scienmag - Science Magazine

Discover more from Science

Subscribe now to keep reading and get access to the full archive.

Continue reading