AI Role-Play Interviews Boost Depression Detection in Machine Learning Breakthrough

Depression affects hundreds of millions of people worldwide, yet the deep learning systems that promise to flag it early have long been starved of the one thing they need most: real clinical interview data. Now a team at Sichuan University in China has shown that large language models can be coaxed into playing the role of patients so convincingly that the synthetic conversations they generate can train depression-detection models to outperform systems built on real interviews alone. The framework, called PRISM, lifted the Macro-F1 score of a state-of-the-art detector from 0.61 to 0.762 on a widely used clinical benchmark, according to the study published in the International Journal of Machine Learning and Cybernetics.

The data bottleneck the researchers set out to break is a familiar one in medical machine learning. High-quality psychological interviews are expensive to collect, slow to transcribe and annotate, and guarded by strict privacy rules because they contain some of the most sensitive information a person can disclose. Cloud-based commercial language model APIs, which might seem like an easy shortcut for generating substitute data, raise their own risks of exposing medical records to third parties. The Sichuan University team, led by Yixuan Liu with Junjie Hu, Yuanyuan Chen and Zhang Yi, designed PRISM — short for Psychological Role-playing for Interview Synthetic Modeling — to sidestep both problems at once, generating interview dialogues locally without ever touching real patient records.

PRISM works in three coordinated stages, each of which tackles a different failure mode of naive text generation. The first is a theme-based Markov model that learns how real clinical interviews unfold. Rather than letting a language model ramble freely, the Markov component captures the statistical structure of interview flow — which topics tend to follow which, when interviewers probe deeper, and how conversations drift between small talk and symptoms. This gives the synthetic dialogues a clinically plausible skeleton, mimicking the way trained interviewers move from opening questions about daily life toward questions about sleep, mood and diagnosis history.

The second stage supplies the psychological depth. The team built a multi-dimensional persona template grounded in the biopsychosocial model, the long-standing clinical framework that views mental health as the product of biological, psychological and social factors. Each synthetic patient is generated with a sampled age, gender and symptom profile drawn from the PHQ-8 depression questionnaire, covering eight dimensions including loss of interest, depressed mood, sleep problems, fatigue, appetite changes, self-blame, concentration difficulties and psychomotor changes. The template deliberately leaves many fields blank — hobbies, recent life events, social support, marital status, education, financial situation, personality — and instructs the language model to fill them in, ensuring each persona is internally consistent before a single line of dialogue is spoken.

The results of this persona construction are strikingly lifelike. In the paper’s demonstration, a 51-year-old male persona named Ethan Granger emerges as a career Army officer recently returned from a year-long deployment, suffering chronic back pain and occasional insomnia, reluctant to discuss personal struggles even with a supportive spouse, and stoic to the point of being described as locked up. When interviewed, Granger deflects questions about his military assignments, admits sleep has been better than a few weeks ago but still troubled, and acknowledges regrets that stick with him — exactly the kind of guarded, symptom-laden conversational texture that real clinical interviews capture and that simpler synthetic data lacks.

The third stage is a two-stage, metric-driven optimization strategy that decides how much synthetic data to generate and how useful it is. Rather than assuming more data is always better, the framework measures the quality and diversity of generated dialogues using established text-generation metrics, including BLEU scores for fluency and perplexity-based filtering to catch degenerate outputs. The filtering rule proves its worth in the paper’s own examples: when a generated response contains a garbled second sentence with perplexity above threshold, only the clean first sentence is retained. This quality control keeps the synthetic corpus from polluting the training signal with the hallucinations and artifacts that large language models are known to produce.

When the PRISM-generated interviews were used to augment training data for depression detection on the DAIC-WoZ benchmark — a widely used corpus of semi-clinical interviews collected by the University of Southern California’s Institute for Creative Technologies — the results were dramatic. Macro-F1, a metric that balances performance across both depressed and non-depressed classes, rose from 0.61 to 0.762, comfortably surpassing zero-shot baselines in which large language models attempt detection directly without task-specific training. The improvement matters because depression detection is a heavily imbalanced problem: depressed individuals are a minority in most datasets, and models that optimize naive accuracy can quietly fail the very people they are meant to help.

Generalizability was tested on two fronts. Cross-dataset experiments on the Chinese EATD corpus, an emotional audio-textual depression dataset, confirmed that the benefits of PRISM-augmented training transfer beyond the original English-language benchmark. The team also verified that the synthetic data improves multiple underlying network architectures rather than being an artifact of one particular model, suggesting the approach is a general-purpose data remedy rather than a model-specific trick. The work builds on a growing line of research into role-playing language models and LLM-simulated patients, including systems designed to train mental health professionals, but PRISM is distinguished by its explicit grounding in clinical interview structure and biopsychosocial persona modeling.

The implications reach beyond depression detection. The study demonstrates that carefully structured role-playing can turn general-purpose language models into sources of clinically plausible training data for mental health tasks, potentially easing data scarcity across psychiatry-adjacent machine learning problems where privacy rules and annotation costs have long throttled progress. Because the framework avoids cloud APIs and real records, it offers a template for institutions that want to pursue synthetic data generation without compromising patient confidentiality. The researchers caution that synthetic data is a supplement, not a replacement, for real clinical evidence, and that hallucination in language models remains an open challenge their filtering pipeline only partially addresses.

For a field where the gap between laboratory benchmarks and clinical reality remains wide, PRISM offers a pragmatic path forward: teach the machine not just to recognize depression, but to imagine the conversations in which it reveals itself. With depression detection models now capable of exceeding 0.76 Macro-F1 on standard benchmarks using purely synthetic augmentation, the study marks a step toward screening tools that could one day work in settings where real interview data simply does not exist — and toward a future in which the hardest part of building a mental health AI is no longer finding the data, but asking the right questions of the machines that generate it.

Subject of Research: Advancing depression detection with role-playing LLMs and synthetic psychological interviews

Article Title: Advancing depression detection with role-playing LLMs and synthetic psychological interviews

Article References: Liu, Y., Hu, J., Chen, Y., & Yi, Z. (2026). Advancing depression detection with role-playing LLMs and synthetic psychological interviews. International Journal of Machine Learning and Cybernetics, 17(11), Article 499. https://doi.org/10.1007/s13042-026-03337-5

Image Credits: AI Generated

DOI: 10.1007/s13042-026-03337-5

Keywords: Advancing, depression, detection, role-playing, LLMs, synthetic, psychological, interviews, scientific research