Tag: masked autoencoders

A new review maps how Transformer architectures, from temporal and spatial attention models to self-supervised brain foundation models, are reshaping ...

Researchers at ETH Zürich have shown that self-supervised pretraining on simulated detector data can teach a single neural encoder to ...

A new survey from the Shanghai AI Laboratory maps the explosive progress in 3D self-supervised pre-training, from contrastive learning and ...