Thursday, November 19, 2026
Science
No Result
View All Result
  • Login
  • HOME
  • SCIENCE NEWS
  • CONTACT US
  • HOME
  • SCIENCE NEWS
  • CONTACT US
No Result
View All Result
Scienmag
No Result
View All Result
Home Science News Biotechnology

Transformer Encoder Network Improves Feature Selection in High Dimensional Gene Expression Datasets

November 19, 2026
in Biology, Biotechnology, Technology and Engineering
Juliet Wilcox
By Juliet Wilcox Scienmag Editorial Profile - Human Genetics
Reading Time: 2 mins read
0
Transformer Encoder Network Improves Feature Selection in High Dimensional Gene Expression Datasets

Transformer Encoder Network Improves Feature Selection in High Dimensional Gene Expression Datasets

65
SHARES
587
VIEWS
Share on FacebookShare on Twitter
ADVERTISEMENT

A research team has introduced a Transformer-based feature selection framework called Transformer Encoder Network to address the challenges of analyzing gene expression data characterized by high dimensionality and small sample sizes. Gene expression profiling often presents severe computational difficulties for cancer classification and biomarker discovery because the number of measured features vastly exceeds the available sample cohort.

To overcome these limitations, the authors engineered an integrated data augmentation strategy specifically tailored for low-sample, high-dimensional gene expression environments. This augmentation strategy expands the training sample distribution while incorporating the biological characteristics of gene expression profiles to enhance distinctions among measured features.

At the core of the framework is a self-attention mechanism designed to capture latent relational structures across sample representations.

The researchers conducted systematic evaluations of the architecture across ten benchmark datasets to assess general feature selection capabilities. To further confirm its practical utility, the investigators tested the model on five real-world gene expression datasets designated GSE68465, GSE12452, GSE76427, GSE14520, and GSE39582.

Downstream classification performance was assessed using a Support Vector Machine classifier applied to the selected features. Across the five real gene expression datasets, the Transformer Encoder Network achieved classification Area Under the Curve values of 1.0000, 0.9746, 0.9813, 0.9841, and 0.9960, demonstrating favorable performance relative to existing feature selection techniques.

Biological validation confirmed that multiple genes identified by the method were independently supported by differential expression analysis, survival analysis, and existing published literature. The authors reported that these prioritized genes correlate closely with tumor development and patient prognosis, indicating that the Transformer Encoder Network yields statistically robust features with strong biological interpretability.

The investigators observed that the proposed data augmentation strategy helped improve overall model performance under conditions characterized by high dimensionality and small sample sizes.

Subject of Research: Transformer-based feature selection for high-dimensional low-sample gene expression data

Article Title: An attention-based transformer feature selection method for high-dimensional, low-sample gene expression data

Article References: Wu, H., Liu, Z., Xiao, X., Liu, X., Lin, W. Z., & Qiu, W.-R. (2026). An attention-based transformer feature selection method for high-dimensional, low-sample gene expression data. BMC Bioinformatics. https://doi.org/10.1186/s12859-026-06747-y

Image Credits: AI Generated

DOI: 10.1186/s12859-026-06747-y

Keywords: Transformer Encoder Network, feature selection, gene expression, bioinformatics, biomarker discovery, cancer classification, data augmentation, self-attention mechanism, Support Vector Machine, AUC performance, high-dimensional data, low sample size, differential expression analysis, survival analysis, tumor development, patient prognosis

Cite Scienmag News

Juliet Wilcox. (November 19, 2026). Transformer Encoder Network Improves Feature Selection in High Dimensional Gene Expression Datasets. Scienmag. https://scienmag.com/transformer-encoder-network-improves-feature-selection-in-high-dimensional-gene-expression-datasets/

Juliet Wilcox. "Transformer Encoder Network Improves Feature Selection in High Dimensional Gene Expression Datasets." Scienmag, 19 November 2026, https://scienmag.com/transformer-encoder-network-improves-feature-selection-in-high-dimensional-gene-expression-datasets/. Accessed 19 November 2026.

Juliet Wilcox. "Transformer Encoder Network Improves Feature Selection in High Dimensional Gene Expression Datasets." Scienmag. November 19, 2026. https://scienmag.com/transformer-encoder-network-improves-feature-selection-in-high-dimensional-gene-expression-datasets/

Tags: AUC performancebioinformaticsbiomarker discoverycancer classificationdata augmentationdifferential expression analysisfeature selectiongene expressionhigh-dimensional datalow sample sizepatient prognosisself-attention mechanismsupport vector machinesurvival analysisTransformer Encoder Networktumor development
Share26Tweet16
Previous Post

Maternal Stress and Drug Use Linked to Lower Male Births in Rwanda

Next Post

Child Hair Cortisol Moderates Parental Distress Impact on Youth Chronic Illness Psychopathology

Related Posts

Most Converted Swedish Buildings Keep Ventilation Types While Airflow Frequently Drops
Technology and Engineering

Most Converted Swedish Buildings Keep Ventilation Types While Airflow Frequently Drops

November 19, 2026
Cyclic Mechanical Stretch Impairs Cell Spreading and Delays Epithelial Wound Closure
Biology

Cyclic Mechanical Stretch Impairs Cell Spreading and Delays Epithelial Wound Closure

November 19, 2026
Long-Read Sequencing Reveals Dynamic mRNA Splicing Shifts During Retinal Organoid Development
Biology

Long-Read Sequencing Reveals Dynamic mRNA Splicing Shifts During Retinal Organoid Development

November 19, 2026
Open-Source 130-Nanometer CMOS Processor Cuts Fast Fourier Transform Power Consumption
Technology and Engineering

Open-Source 130-Nanometer CMOS Processor Cuts Fast Fourier Transform Power Consumption

November 19, 2026
Hyperspectral Leaf Petiole Reflectance Moderately Discriminates Latent Olive Pathogen Infections
Agriculture

Hyperspectral Leaf Petiole Reflectance Moderately Discriminates Latent Olive Pathogen Infections

November 19, 2026
Ferroptosis Drives Multi-Organ Toxic Injury Across Livestock and Poultry Species
Biology

Ferroptosis Drives Multi-Organ Toxic Injury Across Livestock and Poultry Species

November 19, 2026
Next Post
Child Hair Cortisol Moderates Parental Distress Impact on Youth Chronic Illness Psychopathology

Child Hair Cortisol Moderates Parental Distress Impact on Youth Chronic Illness Psychopathology

  • Mothers who receive childcare support from maternal grandparents show more optimized

    Mothers who receive childcare support from maternal grandparents show more parental warmth, finds NTU Singapore study

    27656 shares
    Share 11059 Tweet 6912
  • University of Seville Breaks 120-Year-Old Mystery, Revises a Key Einstein Concept

    1061 shares
    Share 424 Tweet 265
  • Bee body mass, pathogens and local climate influence heat tolerance

    682 shares
    Share 273 Tweet 171
  • Researchers record first-ever images and data of a shark experiencing a boat strike

    546 shares
    Share 218 Tweet 137
  • Groundbreaking Clinical Trial Reveals Lubiprostone Enhances Kidney Function

    531 shares
    Share 212 Tweet 133
Science

Embark on a thrilling journey of discovery with Scienmag.com—your ultimate source for cutting-edge breakthroughs. Immerse yourself in a world where curiosity knows no limits and tomorrow’s possibilities become today’s reality!

RECENT NEWS

  • Pilot Trial Launches to Evaluate Group Nature Activities for Depression and Anxiety
  • Most Converted Swedish Buildings Keep Ventilation Types While Airflow Frequently Drops
  • Anthracycline Therapy Induces Early Subclinical Alterations in Right Ventricular Coupling
  • Passive Temperature Drift in Pig Resuscitation Shows Hemodynamics Similar to Normothermia

Categories

  • Agriculture
  • Anthropology
  • Archaeology
  • Athmospheric
  • Biology
  • Biotechnology
  • Blog
  • Bussines
  • Cancer
  • Chemistry
  • Climate
  • Earth Science
  • Editorial Policy
  • Marine
  • Mathematics
  • Medicine
  • Pediatry
  • Policy
  • Psychology & Psychiatry
  • Science Education
  • Science News
  • Social Science
  • Space
  • Technology and Engineering

Subscribe to Blog via Email

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 5,151 other subscribers

© 2026 Scienmag - Science Magazine

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In
No Result
View All Result
  • HOME
  • SCIENCE NEWS
  • CONTACT US

© 2026 Scienmag - Science Magazine

Discover more from Science

Subscribe now to keep reading and get access to the full archive.

Continue reading