The motivation stems from a persistent and costly bottleneck. Cross-domain research and development in urban mobility—where batteries, artificial intelligence, vehicle-to-everything communication, and logistics systems must converge—has long been stalled by disciplinary silos. Traditional foresight methods such as expert panels, technology roadmaps, and bibliometric analyses can identify promising trends, but they rarely translate those trends into actionable, structured collaboration plans that pair the right industrial innovators with the right academic partners. Lee’s framework is designed to close that gap by converting patent-based convergence signals directly into industry–academia R&D proposals.

Technically, the system operates in several tightly coupled stages. First, a Bayesian long short-term memory (LSTM) network performs walk-forward signal detection on patent classification data, identifying high-potential technology pairs whose convergence trajectories suggest fertile ground for joint research. The walk-forward design is deliberately conservative: the model is trained only on earlier periods and tested on immediately following held-out periods, with no access to target data during training. In the short-window setting—training on 2000–2014 and predicting 2015–2019—the Bayesian LSTM achieved perfect directional accuracy on six validated technology pairs, outperforming four transparent baseline models under identical conditions.

Once promising technology pairs are identified, the framework builds expert personas directly from inventor records in the patent corpus. Rather than relying on simple patent counts, Lee employs a Linear Weighted Score that recency-weights each inventor’s contributions: a patent filed in 2024 receives roughly 25 times the weight of one filed in 2000. This ensures that simulated experts reflect the current innovation frontier rather than historical output. Sensitivity checks confirmed the robustness of this approach—replacing the weighted score with raw counts or exponential weighting shifted top-10 expert rankings by at most two positions in most cases. The distribution analysis also revealed a striking concentration of expertise: both productivity and influence are heavily right-skewed, with high-impact innovators being exceptionally rare.

The heart of the system is a three-phase dialogue orchestrated through LangGraph, a framework for coordinating multi-agent workflows. In Phase 1, two industry expert agents—constructed from real inventor data, such as specialists in AI-driven smart parking systems and notification control technologies—hold a virtual convergence meeting under one of three facilitation strategies: Consensus-Driven, Greedy-Exploitation, or Exploratory-Brainstorming. The goal is to identify the single most critical academic research field needed to enable a proposed technology fusion. In Phase 2, the system queries ArXiv to discover a suitable academic collaborator, synthesizing the literature into a detailed persona. In Phase 3, the industry and academic agents convene to produce a structured joint R&D plan with quarterly milestones, role divisions, and expected outcomes, output as a parsable JSON meeting log.

The results from 30 capability-demonstration runs were striking. ArXiv retrieval succeeded on the first or second query in all 30 runs, with independent raters scoring persona-to-knowledge-gap alignment at a mean of 4.1 out of 5.0. Every refined proposal incorporated at least one frontier AI paradigm—foundation models, federated learning, quantum machine learning, or agentic intelligence—compared with none at the initial convergence stage, illustrating what Lee terms the candidate synthesis effect. Only one run fell below the quality threshold, and a structural analysis traced the failure to a mismatch between the Greedy-Exploitation strategy and the specific technology pair, producing a proposal with too few milestones to be actionable.

What distinguishes the study methodologically is its Two-Track evaluation architecture, designed to confront one of the most serious criticisms of LLM-based research: the ‘LLM-as-judge’ circularity problem, in which the same family of generative models both produces and evaluates the output. Track A demonstrates the framework’s generative ceiling using GPT-4-class models. Track B, the primary validity evidence, employs six non-generative discriminative scorers—none sharing computational lineage with the generative models—to produce a Collaborative Quality Score. This design substantially reduces evaluator–generator circularity, yielding a pipeline advantage of Δ = +0.275 with a large effect size (d = 2.227) over strong baselines, including a cross-family comparison against Alibaba’s Qwen2.5-3B under both chain-of-thought and direct prompting conditions.

Human validation reinforced the automated findings. Three independent domain experts—an AI/ML professor, a senior ITS/V2X research engineer, and an innovation policy specialist—blind-rated 24 proposals using a 13-item rubric, achieving an intraclass correlation of 0.918, indicating strong inter-rater reliability. An FDR-corrected ablation analysis at 35 runs per condition showed that removing academic integration or LSTM forecasting produced large-effect degradations in proposal quality, while removing personas caused medium-effect degradation—evidence that the pipeline’s modules work synergistically rather than redundantly. Notably, a calibration gap emerged: automated scores were systematically higher than human ratings, and sub-dimension correlations between proxy scorers and holistic human judgments were low, an honest limitation the study documents in detail.

Lee is candid about the framework’s boundaries. Signal detection operates over relatively short windows, automated scoring remains proxy-level, and real-world feasibility of the generated proposals has not yet been confirmed—no simulated collaboration has been executed by actual laboratories or companies. The generalization check comparing centrality-selected versus randomly sampled technology pairs is explicitly flagged as confounded and non-confirmatory, with the author calling for replication with at least 20 pairs per group under a common evaluation model. These caveats, far from undermining the work, reflect a design science ethos in which transparency about limitations accompanies every claim.

The implications nonetheless extend well beyond urban mobility. If patent data can seed credible expert personas, if retrieval systems can locate genuine academic counterparts, and if orchestrated multi-agent dialogue can produce structured, evaluable R&D roadmaps, then the same architecture could be applied to energy transition, biotechnology, semiconductor design, or any domain where convergence across disciplinary boundaries determines the pace of innovation. All datasets and simulation outputs have been released in a public repository, inviting replication and extension. As generative AI matures from a tool for drafting text into infrastructure for planning discovery itself, this study offers a rigorous, carefully validated template for what simulated innovation ecosystems might look like—and a sober reminder that trustworthy evaluation, not generation alone, is what will make them useful.

Subject of Research: A data-grounded multi-agent large language model framework for planning industry–academia R&D collaboration in urban mobility using patent-based technology convergence signals.

Article Title: Simulating the Future of Innovation: A Data-Grounded, Multi-Agent LLM Framework for R&D Collaboration Planning in Urban Mobility

Article References: Lee, Y.-J. (2026). Simulating the Future of Innovation: A Data-Grounded, Multi-Agent LLM Framework for R&D Collaboration Planning in Urban Mobility. Information Systems Frontiers. https://doi.org/10.1007/s10796-026-10797-1

Image Credits: AI Generated

DOI: 10.1007/s10796-026-10797-1

Keywords: urban mobility, multi-agent LLM, R&D collaboration, patent analysis, technology convergence, Bayesian LSTM, innovation simulation, LangGraph, ArXiv retrieval, expert personas, large language models, technology forecasting