AI Reads Brain Waves and Eye Movements to Spot Depression With New Accuracy

Depression is one of the most widespread and disabling health conditions on the planet, yet its diagnosis still rests almost entirely on subjective clinical interviews and self-reported questionnaires. There is no blood test, no scan, no single objective marker that a physician can point to and say, with confidence, that a patient is depressed. That gap between the scale of the problem and the crudeness of the diagnostic toolkit has pushed researchers toward an intriguing alternative: reading the illness directly from the body’s physiological signals. Now, a team at Lanzhou University in China has unveiled a machine learning system that fuses brain electrical activity, eye movements, and pupil dynamics into a single diagnostic picture, achieving accuracy of up to 90.33 percent in identifying depression — a result that could reshape how the disorder is screened and detected.

The new model, described in the journal Medical & Biological Engineering & Computing, is called AMGFM, short for Adversarial–Metric Graph Fusion Model. It was developed by Jing Zhu, Aohan Zhang, Xiaowei Li, Yizhou Li, and Bin Hu of the Gansu Provincial Key Laboratory of Wearable Computing at Lanzhou University, with Hu also affiliated with the School of Medical Technology at the Beijing Institute of Technology. Their work addresses a problem that has dogged the field of physiological psychiatry for years: the signals that betray depression come from many different parts of the body at once, and each of those signals speaks a different statistical language.

Electroencephalography, or EEG, records the tiny electrical voltages produced by firing neurons through electrodes on the scalp. Eye-tracking devices capture where a person looks, how quickly their gaze shifts, and how long they fixate on particular images. Pupil measurements track the moment-to-moment dilation of the eye, which reflects activity of the autonomic nervous system. Each of these modalities carries information relevant to depression — altered neural oscillations, atypical attentional biases toward negative stimuli, and abnormal pupillary responses have all been documented in patients — but combining them computationally is far from trivial. The signals differ in sampling rate, dimensionality, noise characteristics, and statistical distribution, so a naive fusion often produces a model that leans heavily on one modality while ignoring the others.

AMGFM attacks this misalignment problem with two complementary learning strategies. The first is adversarial learning, a technique borrowed from generative adversarial networks in which two neural networks compete against each other. In this case, the system learns feature transformations that pull the distributions of the different modalities into a shared space, reducing the global discrepancies between, say, EEG features and eye-movement features. The second strategy is metric learning, which shapes that shared space so that examples of the same class — depressed or non-depressed — cluster tightly together while examples from different classes are pushed far apart. This combination enforces what the authors call intra-class compactness and inter-class separability, effectively sculpting a latent space in which a simple classifier can draw a clean boundary between patients and healthy controls.

On top of this aligned representation sits the model’s most distinctive component: a hierarchical graph fusion module. Rather than simply concatenating all the features together, the module explicitly models interactions at different levels — the information carried by each modality alone, the complementary information carried by each pair of modalities, and the joint information carried by all three together. A graph neural network then adaptively weighs these unimodal, bimodal, and trimodal interactions, deciding dynamically how much each level of interaction should contribute to the final decision. This design gives the model a degree of interpretability that is rare in deep learning systems, because researchers can inspect which interaction pathways the network relied on for a given classification.

The team evaluated AMGFM on two datasets, EFVP and AADP, which contain physiological and behavioral recordings from human participants collected under ethical approval from the Second Hospital of Lanzhou University and Gansu Provincial Hospital respectively, with informed consent from all participants. Across both datasets, the model consistently outperformed unimodal baselines that used only EEG, only eye movement, or only pupil data, as well as representative multimodal fusion approaches from the recent literature. The headline figure — up to 90.33 percent accuracy — places the system among the strongest reported results for physiological depression recognition, a task where typical accuracies have often hovered well below that threshold.

Perhaps the most surprising finding came from the team’s systematic analysis of how different kinds of emotional stimuli affect recognition performance. Participants in these paradigms are typically shown images or clips designed to provoke emotional responses, on the assumption that depressed individuals react differently to negative or emotionally charged content. But the Lanzhou analysis found that neutral stimuli — material with no particular emotional valence — actually provided stronger discriminative cues than emotional stimuli. This echoes earlier clinical observations that depressed patients show distinctive patterns of processing even neutral faces, and it suggests that screening protocols might not need elaborate emotional provocation to work well. A simpler, calmer stimulus set could make future screening sessions shorter and less stressful for participants.

The second analytical insight concerns which modality should serve as the anchor for aligning the others. The experiments indicated that EEG works best as the target modality — the reference signal into which eye movement and pupil features are aligned. That makes physiological sense: EEG offers a rich, high-dimensional, and relatively direct window into neural activity, while eye and pupil signals are noisier proxies of underlying cognitive and autonomic states. For engineers designing future multimodal systems, the practical lesson is that the choice of alignment target is not arbitrary, and treating EEG as the backbone of a multi-signal depression screener is a principled starting point rather than a guess.

The significance of this work extends beyond the specific accuracy numbers. Depression affects hundreds of millions of people worldwide and is recognized by public health authorities as a leading cause of disability, with prevalence studies among groups such as Chinese university students underscoring how widespread the condition is among young populations. Earlier detection means earlier intervention, and objective, sensor-based screening could eventually bring detection into settings where psychiatrists are scarce — primary care clinics, university health centers, or even wearable devices. The Lanzhou group has a long track record in this area, with prior work on EEG-based cognitive interfaces, mutual-information fusion of EEG and pupil signals, transformer networks for EEG and eye-tracking fusion, and graph neural network approaches to depression detection. AMGFM represents a synthesis of those threads into a single, more principled architecture.

Important caveats remain. The EFVP and AADP datasets are not publicly available because they contain sensitive human physiological data, and the model’s source code is likewise not yet in a public repository, though the authors say both may be shared with qualified researchers under appropriate ethical and data-use agreements. Independent validation on external datasets, across different populations and recording hardware, will be essential before any clinical deployment. Depression is also a heterogeneous condition, and a classifier trained on one cohort may not generalize to another. Still, the convergence of adversarial alignment, metric learning, and hierarchical graph fusion into a model that hits 90 percent accuracy marks a genuine step forward. If the results hold up in broader testing, the quiet electrical whispers of the brain — read alongside the flicker of an eye — may one day become a routine part of how medicine listens for depression.

Subject of Research: Multimodal machine learning for depression identification using EEG, eye movement, and pupil signals

Article Title: AMGFM: A multimodal fusion model for depression identification based on adversarial metric learning

Article References: AMGFM: A multimodal fusion model for depression identification based on adversarial metric learning. (n.d.). https://doi.org/10.1007/s11517-026-03676-z

Image Credits: AI Generated

DOI: 10.1007/s11517-026-03676-z

Keywords: depression, EEG, eye movement, pupil dynamics, multimodal fusion, adversarial learning, metric learning, graph neural network, machine learning, mental health screening, physiological signals, AMGFM