Thursday, November 19, 2026
Science
No Result
View All Result
  • Login
  • HOME
  • SCIENCE NEWS
  • CONTACT US
  • HOME
  • SCIENCE NEWS
  • CONTACT US
No Result
View All Result
Scienmag
No Result
View All Result
Home Science News Biotechnology

Transformer Encoder Network Improves Feature Selection in High Dimensional Gene Expression Datasets

November 19, 2026
in Biology, Biotechnology, Technology and Engineering
Juliet Wilcox
By Juliet Wilcox Scienmag Editorial Profile - Human Genetics
Reading Time: 2 mins read
0
Transformer Encoder Network Improves Feature Selection in High Dimensional Gene Expression Datasets

Transformer Encoder Network Improves Feature Selection in High Dimensional Gene Expression Datasets

65
SHARES
587
VIEWS
Share on FacebookShare on Twitter
ADVERTISEMENT

A research team has introduced a Transformer-based feature selection framework called Transformer Encoder Network to address the challenges of analyzing gene expression data characterized by high dimensionality and small sample sizes. Gene expression profiling often presents severe computational difficulties for cancer classification and biomarker discovery because the number of measured features vastly exceeds the available sample cohort.

To overcome these limitations, the authors engineered an integrated data augmentation strategy specifically tailored for low-sample, high-dimensional gene expression environments. This augmentation strategy expands the training sample distribution while incorporating the biological characteristics of gene expression profiles to enhance distinctions among measured features.

At the core of the framework is a self-attention mechanism designed to capture latent relational structures across sample representations.

The researchers conducted systematic evaluations of the architecture across ten benchmark datasets to assess general feature selection capabilities. To further confirm its practical utility, the investigators tested the model on five real-world gene expression datasets designated GSE68465, GSE12452, GSE76427, GSE14520, and GSE39582.

Downstream classification performance was assessed using a Support Vector Machine classifier applied to the selected features. Across the five real gene expression datasets, the Transformer Encoder Network achieved classification Area Under the Curve values of 1.0000, 0.9746, 0.9813, 0.9841, and 0.9960, demonstrating favorable performance relative to existing feature selection techniques.

Biological validation confirmed that multiple genes identified by the method were independently supported by differential expression analysis, survival analysis, and existing published literature. The authors reported that these prioritized genes correlate closely with tumor development and patient prognosis, indicating that the Transformer Encoder Network yields statistically robust features with strong biological interpretability.

The investigators observed that the proposed data augmentation strategy helped improve overall model performance under conditions characterized by high dimensionality and small sample sizes.

Subject of Research: Transformer-based feature selection for high-dimensional low-sample gene expression data

Article Title: An attention-based transformer feature selection method for high-dimensional, low-sample gene expression data

Article References: Wu, H., Liu, Z., Xiao, X., Liu, X., Lin, W. Z., & Qiu, W.-R. (2026). An attention-based transformer feature selection method for high-dimensional, low-sample gene expression data. BMC Bioinformatics. https://doi.org/10.1186/s12859-026-06747-y

Image Credits: AI Generated

DOI: 10.1186/s12859-026-06747-y

Keywords: Transformer Encoder Network, feature selection, gene expression, bioinformatics, biomarker discovery, cancer classification, data augmentation, self-attention mechanism, Support Vector Machine, AUC performance, high-dimensional data, low sample size, differential expression analysis, survival analysis, tumor development, patient prognosis

Cite Scienmag News

Juliet Wilcox. (November 19, 2026). Transformer Encoder Network Improves Feature Selection in High Dimensional Gene Expression Datasets. Scienmag. https://scienmag.com/transformer-encoder-network-improves-feature-selection-in-high-dimensional-gene-expression-datasets/

Juliet Wilcox. "Transformer Encoder Network Improves Feature Selection in High Dimensional Gene Expression Datasets." Scienmag, 19 November 2026, https://scienmag.com/transformer-encoder-network-improves-feature-selection-in-high-dimensional-gene-expression-datasets/. Accessed 19 November 2026.

Juliet Wilcox. "Transformer Encoder Network Improves Feature Selection in High Dimensional Gene Expression Datasets." Scienmag. November 19, 2026. https://scienmag.com/transformer-encoder-network-improves-feature-selection-in-high-dimensional-gene-expression-datasets/

Tags: AUC performancebioinformaticsbiomarker discoverycancer classificationdata augmentationdifferential expression analysisfeature selectiongene expressionhigh-dimensional datalow sample sizepatient prognosisself-attention mechanismsupport vector machinesurvival analysisTransformer Encoder Networktumor development
Share26Tweet16
Previous Post

Maternal Stress and Drug Use Linked to Lower Male Births in Rwanda

Next Post

Child Hair Cortisol Moderates Parental Distress Impact on Youth Chronic Illness Psychopathology

Related Posts

Hilfer Fractional Stochastic Systems Achieve Approximate Controllability via Multivalued Control Maps
Technology and Engineering

Hilfer Fractional Stochastic Systems Achieve Approximate Controllability via Multivalued Control Maps

November 19, 2026
Survey Highlights Institutional and Attitudinal Obstacles to University AI Adoption in Jordan
Technology and Engineering

Survey Highlights Institutional and Attitudinal Obstacles to University AI Adoption in Jordan

November 19, 2026
Fabric Structure and Mechanical Rigidity Drive Microplastic Fiber Shedding During Laundering
Technology and Engineering

Fabric Structure and Mechanical Rigidity Drive Microplastic Fiber Shedding During Laundering

November 19, 2026
Glucosamine Coated Silica Nanoparticles Show Multifunctional Delivery Potential for Motor Neuron Disease
Technology and Engineering

Glucosamine Coated Silica Nanoparticles Show Multifunctional Delivery Potential for Motor Neuron Disease

November 19, 2026
Proximal Tubule Membrane Asymmetry Explains Lipotoxic Damage in Diabetic Kidney Disease
Biology

Proximal Tubule Membrane Asymmetry Explains Lipotoxic Damage in Diabetic Kidney Disease

November 19, 2026
Diffusion Model Remodels Aging DNA Methylation Signatures While Preserving Individual Identity
Biotechnology

Diffusion Model Remodels Aging DNA Methylation Signatures While Preserving Individual Identity

November 19, 2026
Next Post
Child Hair Cortisol Moderates Parental Distress Impact on Youth Chronic Illness Psychopathology

Child Hair Cortisol Moderates Parental Distress Impact on Youth Chronic Illness Psychopathology

  • Mothers who receive childcare support from maternal grandparents show more optimized

    Mothers who receive childcare support from maternal grandparents show more parental warmth, finds NTU Singapore study

    27656 shares
    Share 11059 Tweet 6912
  • University of Seville Breaks 120-Year-Old Mystery, Revises a Key Einstein Concept

    1061 shares
    Share 424 Tweet 265
  • Bee body mass, pathogens and local climate influence heat tolerance

    682 shares
    Share 273 Tweet 171
  • Researchers record first-ever images and data of a shark experiencing a boat strike

    546 shares
    Share 218 Tweet 137
  • Groundbreaking Clinical Trial Reveals Lubiprostone Enhances Kidney Function

    531 shares
    Share 212 Tweet 133
Science

Embark on a thrilling journey of discovery with Scienmag.com—your ultimate source for cutting-edge breakthroughs. Immerse yourself in a world where curiosity knows no limits and tomorrow’s possibilities become today’s reality!

RECENT NEWS

  • CRISPR Screening Identifies Essential RNA-Binding Proteins and Prognostic Signature in AML
  • Review Documents Twenty-One Native Mosquito Species in Ireland Amid European Disease Shifts
  • Survey Shows Public Awareness Remains Low as U.S. Mpox Cases Persist
  • Optimized Dung Beetle Clustering and Adaptive Fusion Extend Sensor Network Lifespan

Categories

  • Agriculture
  • Anthropology
  • Archaeology
  • Athmospheric
  • Biology
  • Biotechnology
  • Blog
  • Bussines
  • Cancer
  • Chemistry
  • Climate
  • Earth Science
  • Editorial Policy
  • Marine
  • Mathematics
  • Medicine
  • Pediatry
  • Policy
  • Psychology & Psychiatry
  • Science Education
  • Science News
  • Social Science
  • Space
  • Technology and Engineering

Subscribe to Blog via Email

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 5,151 other subscribers

© 2026 Scienmag - Science Magazine

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In
No Result
View All Result
  • HOME
  • SCIENCE NEWS
  • CONTACT US

© 2026 Scienmag - Science Magazine

Discover more from Science

Subscribe now to keep reading and get access to the full archive.

Continue reading