Saturday, November 21, 2026
Science
No Result
View All Result
  • Login
  • HOME
  • SCIENCE NEWS
  • CONTACT US
  • HOME
  • SCIENCE NEWS
  • CONTACT US
No Result
View All Result
Scienmag
No Result
View All Result
Home Science News

HeteroGrad-DT Improves Multi-Task Offline Reinforcement Learning on DeepMind Control Tasks

November 11, 2026
in Science News
Reading Time: 2 mins read
0
HeteroGrad-DT Improves Multi-Task Offline Reinforcement Learning on DeepMind Control Tasks

HeteroGrad-DT Improves Multi-Task Offline Reinforcement Learning on DeepMind Control Tasks

65
SHARES
587
VIEWS
Share on FacebookShare on Twitter
ADVERTISEMENT

In a newly reported study, researchers Ye Wang, Donghui Ma, Jiang Li, and Lihong Guo introduced HeteroGrad-DT, an integrated framework designed for heterogeneous multi-task offline reinforcement learning. Evaluated across benchmark configurations on the DeepMind Control Suite involving up to 30 distinct tasks, the proposed architecture demonstrated improvements in average normalized return over representative multi-task methods.

The investigation addresses key constraints in offline reinforcement learning, an approach that enables policy learning directly from static datasets without requiring active online exploration. Because it operates without online exploration, offline reinforcement learning is particularly suitable for robotic control under safety and data constraints. In recent work, Decision Transformer recasts offline reinforcement learning as conditional sequence modeling. However, extending Decision Transformer models to heterogeneous multi-task settings remains challenging because task representations and dynamics differ across tasks, while joint model training can suffer from destructive gradient interference.

To address these challenges, the authors introduced HeteroGrad-DT as an integrated framework that employs task-specific tokenizers and decoupled prediction heads. These specialized interface components retain task-native input and output dimensionality at the model interfaces while the system learns a shared sequence backbone.

HeteroGrad-DT further introduces a Gradient Flow Transformer that periodically coordinates cross-task updates across the shared sequence backbone. Rather than relying only on stepwise projection or static regularization, the system coordinates updates through an alignment-based coordination objective. This mechanism coordinates cross-task updates by utilizing fixed-dimensional task statistics along with compact summaries of shared-backbone gradients that are accumulated within the current synchronization interval.

In the 30-task setting, the framework achieved a 32.3 percent relative improvement over standard training with a shared backbone and an 8.6 percent gain over a representative gradient-conflict mitigation baseline using the same task-aware interfaces. In addition, ablation, mechanism, and sensitivity analyses reported in the paper further supported complementary benefits from pairing task-aware interfaces with periodic gradient coordination in the evaluated settings.

Subject of Research: Heterogeneous multi-task offline reinforcement learning

Article Title: HeteroGrad-DT: Gradient Flow Transformer for heterogeneous multi-task offline reinforcement learning

Article References: Wang, Y., Ma, D., Li, J., & Guo, L. (2026). HeteroGrad-DT: Gradient Flow Transformer for heterogeneous multi-task offline reinforcement learning. PLOS One, 21(11), e0362298. https://doi.org/10.1371/journal.pone.0362298

Image Credits: AI Generated

DOI: 10.1371/journal.pone.0362298

Keywords: HeteroGrad-DT, offline reinforcement learning, Decision Transformer, Gradient Flow Transformer, multi-task learning, robotic control, DeepMind Control Suite, gradient interference, task-specific tokenizers, decoupled prediction heads, conditional sequence modeling, shared sequence backbone, gradient coordination, static datasets, task statistics, gradient-conflict mitigation, alignment-based coordination

Cite Scienmag News

Scienmag. (November 11, 2026). HeteroGrad-DT Improves Multi-Task Offline Reinforcement Learning on DeepMind Control Tasks. https://scienmag.com/heterograd-dt-improves-multi-task-offline-reinforcement-learning-on-deepmind-control-tasks/

Scienmag. "HeteroGrad-DT Improves Multi-Task Offline Reinforcement Learning on DeepMind Control Tasks." Scienmag, 11 November 2026, https://scienmag.com/heterograd-dt-improves-multi-task-offline-reinforcement-learning-on-deepmind-control-tasks/. Accessed 21 November 2026.

Scienmag. "HeteroGrad-DT Improves Multi-Task Offline Reinforcement Learning on DeepMind Control Tasks." Scienmag. November 11, 2026. https://scienmag.com/heterograd-dt-improves-multi-task-offline-reinforcement-learning-on-deepmind-control-tasks/

Tags: alignment-based coordinationconditional sequence modelingDecision Transformerdecoupled prediction headsDeepMind Control Suitegradient coordinationGradient Flow Transformergradient interferencegradient-conflict mitigationHeteroGrad-DTmulti-task learningoffline reinforcement learningrobotic controlshared sequence backbonestatic datasetstask statisticstask-specific tokenizers
Share26Tweet16
Previous Post

Nitrogen-Doped Carbon Dots Suppress Bacterial Infections by Disrupting Membranes and Biofilms

Next Post

Acid Reflux and Clearance Explain Age-Related Changes in Esophageal Baseline Impedance

Related Posts

Positive Selection in Human Proteins Targets Exposed Extracellular Surfaces Facing Pathogens
Biology

Positive Selection in Human Proteins Targets Exposed Extracellular Surfaces Facing Pathogens

November 21, 2026
Heterogeneous Graph Neural Networks Accurately Predict Longitudinal Middle School Performance Indicators
Technology and Engineering

Heterogeneous Graph Neural Networks Accurately Predict Longitudinal Middle School Performance Indicators

November 21, 2026
Comprehensive Review Synthesizes Intimate Partner Violence Mechanisms, Health Impacts, and Interventions
Medicine

Comprehensive Review Synthesizes Intimate Partner Violence Mechanisms, Health Impacts, and Interventions

November 21, 2026
Co-Assembled Molecular Monolayers Propel Organic Solar Cells Past 20 Percent Efficiency
Science News

Co-Assembled Molecular Monolayers Propel Organic Solar Cells Past 20 Percent Efficiency

November 21, 2026
Dietary Polyphenols Protect Animal Bone Health by Modulating the Gut Microbiota
Biotechnology

Dietary Polyphenols Protect Animal Bone Health by Modulating the Gut Microbiota

November 21, 2026
Preschool Acute Laryngitis Surges in Autumn With Peak in Early November
Science News

Preschool Acute Laryngitis Surges in Autumn With Peak in Early November

November 21, 2026
Next Post
Acid Reflux and Clearance Explain Age-Related Changes in Esophageal Baseline Impedance

Acid Reflux and Clearance Explain Age-Related Changes in Esophageal Baseline Impedance

  • Mothers who receive childcare support from maternal grandparents show more optimized

    Mothers who receive childcare support from maternal grandparents show more parental warmth, finds NTU Singapore study

    27656 shares
    Share 11059 Tweet 6912
  • University of Seville Breaks 120-Year-Old Mystery, Revises a Key Einstein Concept

    1061 shares
    Share 424 Tweet 265
  • Bee body mass, pathogens and local climate influence heat tolerance

    682 shares
    Share 273 Tweet 171
  • Researchers record first-ever images and data of a shark experiencing a boat strike

    546 shares
    Share 218 Tweet 137
  • Groundbreaking Clinical Trial Reveals Lubiprostone Enhances Kidney Function

    531 shares
    Share 212 Tweet 133
Science

Embark on a thrilling journey of discovery with Scienmag.com—your ultimate source for cutting-edge breakthroughs. Immerse yourself in a world where curiosity knows no limits and tomorrow’s possibilities become today’s reality!

RECENT NEWS

  • Positive Selection in Human Proteins Targets Exposed Extracellular Surfaces Facing Pathogens
  • Heterogeneous Graph Neural Networks Accurately Predict Longitudinal Middle School Performance Indicators
  • Comprehensive Review Synthesizes Intimate Partner Violence Mechanisms, Health Impacts, and Interventions
  • Co-Assembled Molecular Monolayers Propel Organic Solar Cells Past 20 Percent Efficiency

Categories

  • Agriculture
  • Anthropology
  • Archaeology
  • Athmospheric
  • Biology
  • Biotechnology
  • Blog
  • Bussines
  • Cancer
  • Chemistry
  • Climate
  • Earth Science
  • Editorial Policy
  • Marine
  • Mathematics
  • Medicine
  • Pediatry
  • Policy
  • Psychology & Psychiatry
  • Science Education
  • Science News
  • Social Science
  • Space
  • Technology and Engineering

Subscribe to Blog via Email

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 5,151 other subscribers

© 2026 Scienmag - Science Magazine

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In
No Result
View All Result
  • HOME
  • SCIENCE NEWS
  • CONTACT US

© 2026 Scienmag - Science Magazine

Discover more from Science

Subscribe now to keep reading and get access to the full archive.

Continue reading