Sunday, November 22, 2026
Science
No Result
View All Result
  • Login
  • HOME
  • SCIENCE NEWS
  • CONTACT US
  • HOME
  • SCIENCE NEWS
  • CONTACT US
No Result
View All Result
Scienmag
No Result
View All Result
Home Science News

Transformer Model Boosts Activity Recognition Accuracy but Increases Computing Latency

November 22, 2026
in Science News
Blake Davidson
By Blake Davidson Scienmag Editorial Profile - Data Science
Reading Time: 3 mins read
0
Transformer Model Boosts Activity Recognition Accuracy but Increases Computing Latency

Transformer Model Boosts Activity Recognition Accuracy but Increases Computing Latency

65
SHARES
587
VIEWS
Share on FacebookShare on Twitter
ADVERTISEMENT

A deep learning model based on Transformer architecture can improve activity recognition performance on sequential wearable sensor data compared to conventional recurrent baselines, although the gains are accompanied by substantial increases in computational latency. Researchers designed TransAct to capture long-range temporal dependencies in multivariate time-series data using optimized input projections, learnable positional encodings, and multi-headed self-attention mechanisms. The team benchmarked the architecture against an identically preprocessed and trained hybrid convolutional long short-term memory baseline across multiple public sensor datasets, evaluating whether attention mechanisms offer measurable advantages for wearable human activity tracking.

The experimental evaluation was conducted across five independent random seeds using three established benchmarks: UCI HAR, PAMAP2, and OPPORTUNITY. TransAct and the matched CNN-LSTM comparator were tested to evaluate classification accuracy, macro-averaged F1 scores, computational execution speed, and the specific contributions of architectural subcomponents under controlled training settings.

On the UCI HAR benchmark, which relies on reshaped engineered-feature vectors rather than direct chronological sensor streams, TransAct recorded a held-out test accuracy of 95.10 percent with a standard deviation of 0.37 percent, compared to 94.26 percent with a standard deviation of 0.55 percent for the CNN-LSTM baseline. While this yielded a borderline-significant difference under a paired t-test with a p-value of 0.050, the performance advantage did not reach statistical significance when evaluated under the non-parametric Wilcoxon signed-rank test, which yielded a p-value of 0.125.

In contrast, the PAMAP2 dataset provided an evaluation on genuine, chronologically ordered raw inertial signals rather than engineered feature representations. On this continuous time-series stream, TransAct demonstrated a clearer and statistically significant improvement over the baseline, recording a mean test accuracy of 86.13 percent with a standard deviation of 0.68 percent, compared to 82.75 percent with a standard deviation of 1.70 percent for the CNN-LSTM model, supported by a p-value of 0.012.

Testing on the OPPORTUNITY dataset examined model resilience under severe class imbalance across an 18-class gesture-recognition problem. In overall classification accuracy, the two architectures remained statistically indistinguishable, with TransAct achieving 88.48 percent with a standard deviation of 3.54 percent against 89.01 percent with a standard deviation of 2.64 percent for CNN-LSTM, yielding a p-value of 0.452. However, TransAct achieved a significantly higher macro-F1 score of 54.15 percent with a standard deviation of 9.17 percent versus 51.55 percent with a standard deviation of 9.04 percent for the comparator, with a p-value of 0.030, showing improved recognition across minority classes without being masked by the dominant null category.

To assess which mechanisms drove performance, the authors carried out a multi-seed ablation study on the UCI HAR dataset. The ablation isolated positional encoding, multi-head attention versus single-head attention, and layer normalization. In all individual tests, removing or modifying each component left model accuracy statistically indistinguishable from the full TransAct model, with p-values exceeding 0.9 across every variation, showing no statistically detectable necessity for any single tested element.

The benchmark tests also documented substantial differences in processing efficiency between the two architectures when executed on a T4 graphics processing unit. TransAct was consistently slower than the matched CNN-LSTM baseline across all three evaluated datasets, displaying both mean epoch training times and per-sample inference latencies that were roughly two to three times higher, with differences reaching statistical significance at a p-value below 0.0001, aligning with TransAct’s larger overall parameter count.

The investigators emphasized that while attention-based modeling can yield reproducible improvements in accuracy or macro-F1 metrics on wearable time-series signals, the advantages depend heavily on data structure and come with persistent computational trade-offs. The team noted that unresolved questions remain before broader claims can be established, including probability-calibrated discrimination curves, resolving an identified channel count discrepancy on the OPPORTUNITY dataset, and formulating a mechanistic explanation for the ablation null findings.

Subject of Research: Deep learning models for wearable human activity recognition

Article Title: TransAct: efficient attention-based temporal modelling for real-time wearable human activity recognition

Article References: Rajesh, S., Rani, I. A., Nalajala, A., Pramod, A., & Yarlagadda, B. (2026). TransAct: efficient attention-based temporal modelling for real-time wearable human activity recognition. Scientific Reports. https://doi.org/10.1038/s41598-026-80279-6

Image Credits: AI Generated

DOI: 10.1038/s41598-026-80279-6

Keywords: human activity recognition, wearable sensors, Transformers, deep learning, temporal modelling, TransAct, CNN-LSTM, inertial sensors, UCI HAR, PAMAP2, OPPORTUNITY benchmark, macro-F1 score, inference latency, ablation study, self-attention

Cite Scienmag News

Blake Davidson. (November 22, 2026). Transformer Model Boosts Activity Recognition Accuracy but Increases Computing Latency. Scienmag. https://scienmag.com/transformer-model-boosts-activity-recognition-accuracy-but-increases-computing-latency/

Blake Davidson. "Transformer Model Boosts Activity Recognition Accuracy but Increases Computing Latency." Scienmag, 22 November 2026, https://scienmag.com/transformer-model-boosts-activity-recognition-accuracy-but-increases-computing-latency/. Accessed 22 November 2026.

Blake Davidson. "Transformer Model Boosts Activity Recognition Accuracy but Increases Computing Latency." Scienmag. November 22, 2026. https://scienmag.com/transformer-model-boosts-activity-recognition-accuracy-but-increases-computing-latency/

Tags: ablation studyCNN-LSTMdeep learninghuman activity recognitioninertial sensorsinference latencymacro F1-scoreOPPORTUNITY benchmarkPAMAP2self-attentiontemporal modellingTransActtransformersUCI HARwearable sensors
Share26Tweet16
Previous Post

VasoClip Demonstrates Noninferior Ligation Success to WeckClip in Robotic Surgery Trial

Next Post

Machine Learning Framework Improves Economic Loss Predictions for Natural Disasters

Related Posts

Speech-Guided Phoneme Temporal Net Improves Multimodal Speech-to-Image Generation Accuracy
Technology and Engineering

Speech-Guided Phoneme Temporal Net Improves Multimodal Speech-to-Image Generation Accuracy

November 22, 2026
Soil Texture and Machinery Traffic Dictate Carbon Sampling in Brazilian Sugarcane
Agriculture

Soil Texture and Machinery Traffic Dictate Carbon Sampling in Brazilian Sugarcane

November 22, 2026
Crab-eating frog gut microbes process chitin in distinct stages
Biology

Crab-eating frog gut microbes process chitin in distinct stages

November 22, 2026
Clinical Trial Tests Metformin to Slow Accelerated Aging in Emphysema
Medicine

Clinical Trial Tests Metformin to Slow Accelerated Aging in Emphysema

November 22, 2026
VA Prescribes Advanced Microprocessor Prosthetic Knees at Higher Rates Than Private Sector
Technology and Engineering

VA Prescribes Advanced Microprocessor Prosthetic Knees at Higher Rates Than Private Sector

November 22, 2026
Ultrahigh Frequency Ultrasound Enables 3D Pancreatic Tumor Imaging in Avian Membrane Models
Medicine

Ultrahigh Frequency Ultrasound Enables 3D Pancreatic Tumor Imaging in Avian Membrane Models

November 22, 2026
Next Post
Machine Learning Framework Improves Economic Loss Predictions for Natural Disasters

Machine Learning Framework Improves Economic Loss Predictions for Natural Disasters

  • Mothers who receive childcare support from maternal grandparents show more optimized

    Mothers who receive childcare support from maternal grandparents show more parental warmth, finds NTU Singapore study

    27656 shares
    Share 11059 Tweet 6912
  • University of Seville Breaks 120-Year-Old Mystery, Revises a Key Einstein Concept

    1061 shares
    Share 424 Tweet 265
  • Bee body mass, pathogens and local climate influence heat tolerance

    682 shares
    Share 273 Tweet 171
  • Researchers record first-ever images and data of a shark experiencing a boat strike

    546 shares
    Share 218 Tweet 137
  • Groundbreaking Clinical Trial Reveals Lubiprostone Enhances Kidney Function

    531 shares
    Share 212 Tweet 133
Science

Embark on a thrilling journey of discovery with Scienmag.com—your ultimate source for cutting-edge breakthroughs. Immerse yourself in a world where curiosity knows no limits and tomorrow’s possibilities become today’s reality!

RECENT NEWS

  • Speech-Guided Phoneme Temporal Net Improves Multimodal Speech-to-Image Generation Accuracy
  • Soil Texture and Machinery Traffic Dictate Carbon Sampling in Brazilian Sugarcane
  • Crab-eating frog gut microbes process chitin in distinct stages
  • Clinical Trial Tests Metformin to Slow Accelerated Aging in Emphysema

Categories

  • Agriculture
  • Anthropology
  • Archaeology
  • Athmospheric
  • Biology
  • Biotechnology
  • Blog
  • Bussines
  • Cancer
  • Chemistry
  • Climate
  • Earth Science
  • Editorial Policy
  • Marine
  • Mathematics
  • Medicine
  • Pediatry
  • Policy
  • Psychology & Psychiatry
  • Science Education
  • Science News
  • Social Science
  • Space
  • Technology and Engineering

Subscribe to Blog via Email

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 5,151 other subscribers

© 2026 Scienmag - Science Magazine

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In
No Result
View All Result
  • HOME
  • SCIENCE NEWS
  • CONTACT US

© 2026 Scienmag - Science Magazine

Discover more from Science

Subscribe now to keep reading and get access to the full archive.

Continue reading