Sunday, September 7, 2025
Science
No Result
View All Result
  • Login
  • HOME
  • SCIENCE NEWS
  • CONTACT US
  • HOME
  • SCIENCE NEWS
  • CONTACT US
No Result
View All Result
Scienmag
No Result
View All Result
Home Science News Cancer

Researchers reduce bias in pathology AI algorithms using foundation models

April 18, 2024
in Cancer
Reading Time: 4 mins read
0
Researchers reduce bias in pathology AI algorithms using foundation models
66
SHARES
601
VIEWS
Share on FacebookShare on Twitter
ADVERTISEMENT

 

  • Findings of substantial variability in pathology AI models’ performance based on race, insurance type and age group serve as a “call to action” to researchers and regulators to improve medical equity
  • Large foundation models that incorporate a richer level of detail may mitigate disparities between different demographic groups and enhance model accuracy.

 

Advanced artificial intelligence (AI) systems have shown promise in revolutionalizing the field of pathology through transforming the detection, diagnosis, and treatment of disease; however, the underrepresentation of certain patient populations in pathology datasets used to develop AI models may limit the overall quality of their performance and widen health disparities. A new study led by investigators from Mass General Brigham highlights that standard computational pathology systems perform differently depending on the demographic profiles associated with histology images, but that larger “foundation models” can help partly mitigate these disparities. Findings, published April 19th in Nature Medicine, emphasize the need for more diverse training datasets and demographic-stratified evaluations of AI systems to ensure all patient groups benefit equitably from their use.

“There has not been a comprehensive analysis of the performance of AI algorithms in pathology stratified across diverse patient demographics on independent test data,” said corresponding author Faisal Mahmood, PhD, of the Division of Computational Pathology in the Department of Pathology at Mass General Brigham. “This study, based on both publicly available datasets that are extensively used for AI research in pathology and internal Mass General Brigham cohorts, reveals marked performance differences for patients from different races, insurance types, and age groups. We showed that advanced deep learning models trained in a self-supervised manner known as ‘foundation models’ can reduce these differences in performance and enhance accuracy.”

Based on data from the widely used Cancer Genome Atlas and EBRAINS brain tumor atlas, which predominantly include data from white patients, the researchers developed computational pathology models for breast cancer subtyping, lung cancer subtyping, and glioma IDH1 mutation prediction (an important factor in therapeutic response). When the researchers tested the accuracy of these models using histology slides from over 4,300 patients with cancer at Mass General Brigham and the Cancer Genome Atlas, and stratified the results by race, they found that the models performed more accurately in white patients than Black patients. The models the team tested for subtyping breast and lung cancers and predicting IDH1 mutation in glioma found respective disparities of 3.7, 10.9, and 16 percent in producing correct classifications.

The researchers sought to reduce the observed disparities with standard machine learning methods for bias-mitigation, such as emphasizing examples from underrepresented groups during model training; however, these methods only marginally decreased the bias. Instead, disparities were reduced by using self-supervised  foundation models, which are an emerging form of advanced AI trained on large datasets to perform a wide range of clinical tasks. These models encode richer representations of histology images that may reduce the likelihood of model bias.

Despite the observed improvements, gaps in performance were still evident, which reflects the need for further refinement of foundation models in pathology. Furthermore, the study was limited by small numbers of patients from some demographic groups. The researchers are pursuing ongoing investigations of how multi-modality foundation models, which incorporate multiple forms of data, such as genomics or electronic health records, may improve these models.

The emergence of AI tools in medicine has the potential to positively reshape the delivery of care. It is imperative to balance the innovative potential of AI with a commitment to quality and safety. Mass General Brigham is leading the way in responsible AI, conducting rigorous research on new and emerging technologies to inform the incorporation of AI in medicine.

“Overall, the findings from this study represent a call to action for developing more equitable AI models in medicine,” Mahmood said. “It is a call to action for scientists to use more diverse datasets in research, but also a call for regulatory and policy agencies to include demographic-stratified evaluations of these models in their assessment guidelines before approving and deploying them, to ensure that AI systems benefit all patient groups equitably.”

 

Authorship: Mass General Brigham authors include co-first authors Anurag Vaidya, Richard Chen, and Drew Williamson, as well as Andrew Song, Guillame Jaume, Ming Lu, Jana Lipkova, Muhammad Shaban, and Tiffany Chen (MGB Department of Pathology).

Disclosures: None.

Funding: This work was supported in part by the Brigham and Women’s Hospital (BWH) President’s Fund, BWH and Massachusetts General Hospital Pathology, and National Institute of General Medical Sciences (R35GM138216) to Mahmood.

Paper cited: Vaidya, A et al. “Demographic bias in misdiagnosis by computational pathology models” Nature Medicine DOI: 10.1038/s41591-024-02885-z

###

About Mass General Brigham

Mass General Brigham is an integrated academic health care system, uniting great minds to solve the hardest problems in medicine for our communities and the world. Mass General Brigham connects a full continuum of care across a system of academic medical centers, community and specialty hospitals, a health insurance plan, physician networks, community health centers, home care, and long-term care services. Mass General Brigham is a nonprofit organization committed to patient care, research, teaching, and service to the community. In addition, Mass General Brigham is one of the nation’s leading biomedical research organizations with several Harvard Medical School teaching hospitals. For more information, please visit massgeneralbrigham.org.



Journal

Nature Medicine

DOI

10.1038/s41591-024-02885-z

Method of Research

Computational simulation/modeling

Subject of Research

Human tissue samples

Article Title

Demographic bias in misdiagnosis by computational pathology models

Article Publication Date

18-Apr-2024

COI Statement

None

Share26Tweet17
Previous Post

Dana-Farber Chief Scientific Officer, Kevin Haigis, PhD, elected as Fellow of the American Association for the Advancement of Science

Next Post

Palaeontology: Discovery of new ancient giant snake in India

Related Posts

blank
Cancer

Promising Outcomes from First-in-Human Trial of DLL3-Targeted Antibody-Drug Conjugate SHR-4849 in Relapsed Small Cell Lung Cancer

September 7, 2025
blank
Cancer

Phase 2 IDeate-Lung01 Trial Shows Ifinatamab Deruxtecan Achieves High Response Rates in Previously Treated Extensive-Stage Small Cell Lung Cancer

September 7, 2025
blank
Cancer

Zidesamtinib Demonstrates Lasting Efficacy in ROS1 TKI-Pretreated NSCLC, Including Cases with CNS Involvement and ROS1 G2032R Mutations

September 7, 2025
blank
Cancer

Crizotinib Does Not Enhance Disease-Free Survival in Resected Early-Stage ALK-Positive NSCLC

September 7, 2025
blank
Cancer

Ivonescimab Combined with Chemotherapy Enhances Progression-Free Survival in EGFR-Positive NSCLC Patients After Third-Generation EGFR-TKI Treatment

September 7, 2025
blank
Cancer

FLAURA2 Trial Demonstrates Enhanced Overall Survival with Osimertinib and Chemotherapy in EGFR-Mutated Advanced NSCLC

September 7, 2025
Next Post
Palaeontology: Discovery of new ancient giant snake in India

Palaeontology: Discovery of new ancient giant snake in India

  • Mothers who receive childcare support from maternal grandparents show more parental warmth, finds NTU Singapore study

    Mothers who receive childcare support from maternal grandparents show more parental warmth, finds NTU Singapore study

    27545 shares
    Share 11015 Tweet 6884
  • University of Seville Breaks 120-Year-Old Mystery, Revises a Key Einstein Concept

    961 shares
    Share 384 Tweet 240
  • Bee body mass, pathogens and local climate influence heat tolerance

    643 shares
    Share 257 Tweet 161
  • Researchers record first-ever images and data of a shark experiencing a boat strike

    510 shares
    Share 204 Tweet 128
  • Warm seawater speeding up melting of ‘Doomsday Glacier,’ scientists warn

    313 shares
    Share 125 Tweet 78
Science

Embark on a thrilling journey of discovery with Scienmag.com—your ultimate source for cutting-edge breakthroughs. Immerse yourself in a world where curiosity knows no limits and tomorrow’s possibilities become today’s reality!

RECENT NEWS

  • Targeting LncRNA938/TAF9/TTK Axis Enhances Hepatoblastoma Treatment
  • Nitric Oxide Knockdown Affects GABA Neuron Metabolism in Rats
  • Gender Variations in Microglial Stress Response Uncovered
  • Refining Bat Species Identification with VGG16-CBAM

Categories

  • Agriculture
  • Anthropology
  • Archaeology
  • Athmospheric
  • Biology
  • Blog
  • Bussines
  • Cancer
  • Chemistry
  • Climate
  • Earth Science
  • Marine
  • Mathematics
  • Medicine
  • Pediatry
  • Policy
  • Psychology & Psychiatry
  • Science Education
  • Social Science
  • Space
  • Technology and Engineering

Subscribe to Blog via Email

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 5,183 other subscribers

© 2025 Scienmag - Science Magazine

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In
No Result
View All Result
  • HOME
  • SCIENCE NEWS
  • CONTACT US

© 2025 Scienmag - Science Magazine

Discover more from Science

Subscribe now to keep reading and get access to the full archive.

Continue reading