Tag: transformer models

A review of 2019–2025 research finds that transformer models show promise for lung cancer detection and classification, but variable validation ...

A systematic review of 87 studies identifies fragmentation across multimodal fusion, adaptive learning, edge inference, privacy and explainability as the ...

Researchers built the first extractive summarization system for Indonesian Friday sermon transcripts by fine-tuning IndoBERT on automatically generated pseudo-labels, achieving ...

A controlled benchmark of four pre-trained transformer models on the Devign dataset found CodeBERT achieved the highest mean accuracy, precision, ...

A PSO-fused model combining text, speech and video representations reached 94.0% accuracy on 690 labeled television-dialogue utterances in the MUStARD ...

CarBench evaluates 11 neural-surrogate configurations on more than 8,000 high-fidelity car simulations, comparing accuracy, pressure-field fidelity, efficiency, uncertainty and cross-category ...

A transformer-autoencoder method that groups federated clients without labels improved sentiment-classification accuracy across controlled label-skew conditions on Sentiment140 and IMDB.

A context-aware deep-learning model classified rodent sleep stages across unseen animals and retained near-baseline performance after training only on vehicle-control ...

A comparative study finds that a fine-tuned DistilBERT pipeline reliably detects deceptive hotel reviews while a Perceiver-based pipeline collapses toward ...

A new transformer model called LitGene learns gene function by reading the scientific literature and aligning it with Gene Ontology ...