The standardized vocabulary in question is SNOMED CT, the Systematized Nomenclature of Medicine–Clinical Terminology, an international reference containing 368,285 active concepts spanning diagnoses, procedures, findings, and the hierarchical relationships among them. When clinical narratives are mapped to SNOMED CT concepts, electronic health records become computable, multi-center data integration becomes feasible, and the growing appetite of clinical artificial intelligence for machine-interpretable data can be satisfied. The trouble is that mapping has traditionally been done by hand, one phrase at a time, and studies have shown that even professional coding services disagree with one another to a striking degree when assigning concepts to the same text.

Researchers led by Hyeonhoon Lee and Hyung-Chul Lee built an agent system on the LangChain framework using GPT-4 Turbo as its underlying model, and designed it not to replace human coders but to widen their field of view. The system processes each piece of clinical text through three sequential modules. A Translation Module detects the language and converts Korean or mixed Korean–English passages into English while preserving medical terms already written in English, consulting external web search tools when phrases are ambiguous. An Abbreviation Expansion Module then resolves domain-specific acronyms using the clinical category and department as context, so that “PCI” becomes “Percutaneous Coronary Intervention” in a cardiology setting but can be expanded differently elsewhere. Finally, a Retriever Module encodes the normalized text with MedCPT, a biomedical transformer model, and searches a pre-embedded vector database of SNOMED CT concepts using cosine similarity, returning the twenty best-matching candidate concepts.

The test bed was real and demanding. From 85,031 discharge cases at the tertiary academic hospital between March 2022 and June 2024, the team assembled 2,261 de-identified free-text segments drawn from complex disease assessment forms, spread evenly across nine clinical categories ranging from symptoms and medications to advanced procedures and underlying diseases. The segments were brutally short, with a median of just twelve characters and two words, packed with abbreviations. A reference panel of three professional health information managers, later joined by a physician professor of medical informatics, independently assigned consensus SNOMED CT concepts to every segment in two blind adjudication rounds, and about half the segments turned out to require more than one concept.

Three health information managers then mapped the same segments under three conditions: entirely by hand using the SNOMED CT Browser, entirely by the agent alone, and with the agent’s top-twenty candidate list presented through a custom web interface that let them select, modify, or reject any suggestion. The results were unambiguous. The agent-assisted approach achieved a pooled hit rate at rank one of 0.868, beating both unassisted human mapping at 0.837 and the agent alone at 0.701, with all differences statistically significant. On R-precision, a metric that adapts to the number of correct concepts each segment carries, the collaborative workflow scored 0.674 against 0.632 for humans working alone. The agent by itself was reliably worse than the experts, confirming that fully automated coding is not yet ready to fly solo.

The efficiency gains were even more dramatic. Total mapping time fell 53.9 percent, from 59.2 hours to 27.3 hours for the full dataset, or from 1.57 minutes to 0.72 minutes per segment once the agent’s own processing time of about eleven seconds per segment was included. The reduction held across every clinical category, ranging from 35.8 percent for advanced treatment text to 64.6 percent for symptom descriptions, and every individual mapper saved between roughly 52 and 57 percent of their previous working time. For terminology standardization programs, where manual coding is a chronic resource drain, those numbers translate directly into capacity.

Perhaps the most intriguing finding lies in how the collaboration changed human behavior. Mappers selected about 79 percent of their final concepts directly from the agent’s candidate list, typically from the top few ranks, but a full 21 percent they still hunted down independently through the SNOMED CT Browser, showing that the experts were thinking beyond the machine’s suggestions. The authors argue that the key mechanism is an expansion of the space of valid candidates: the agent surfaced correct concepts that mappers would never have found through conventional keyword search, letting them pick different but individually valid answers when multiple correct options existed. Consistent with that interpretation, agreement between mappers, measured by the Jaccard index, dropped from 0.915 to 0.639 under assistance, and plunged to 0.450 for segments requiring multiple concepts, precisely where the space of legitimate answers is widest.

The architecture also carries practical advantages for real hospitals. The vector database of SNOMED CT concepts runs entirely on local infrastructure with no external calls during retrieval, and because SNOMED CT is updated monthly, the system stays current simply by refreshing the database rather than retraining any model, a sharp contrast with supervised entity-linking approaches that require labeled clinical notes. The translation and abbreviation modules do currently rely on proprietary external APIs, which the authors acknowledge would need locally hosted open-source replacements for deployments under strict data governance rules. The bilingual capability also addresses a recognized gap, since most terminology-mapping tools were built for English text alone.

The study is honest about its limits. It unfolded at a single institution with three mappers, segments were mapped in isolation without the surrounding clinical record, the two conditions ran in fixed order separated by a four-month wash-out rather than counterbalanced, and the reference panel shared an institution with the mappers, so measured accuracy should be read as a plausible upper estimate. Mapping time was logged automatically in the assisted condition but self-reported in the manual one, introducing measurement asymmetry. Still, the subgroup analysis showed the collaborative approach winning on F1 in eight of nine clinical categories and in both single- and multi-concept strata, and the authors call for multi-center, prospective validation, additional language pairs, and open-source model substitution as next steps.

The broader lesson may outlast the specific technology. As large language models flood into medicine, the seductive promise is full automation, yet this study adds to mounting evidence that the highest-value configuration is neither machine nor human alone but a division of labor in which the machine generates and ranks possibilities while the expert retains judgment, context, and accountability. Here, that division produced something neither party achieved separately: more accurate standardized coding than experts working unaided, faster than anyone thought possible, and a template for how hospitals everywhere might finally tame their mountains of unstructured clinical text.

Subject of Research: Human-AI collaborative large language model workflow for mapping bilingual clinical text to SNOMED CT concepts

Article Title: Development and Validation of Human-AI Collaborative Workflow in SNOMED CT Mapping of Bilingual Clinical Text

Article References: Lee, H., Choi, S., Kim, D., Hong, K., Kim, H., Jeong, C. W., & Lee, H.-C. (2026). Development and Validation of Human-AI Collaborative Workflow in SNOMED CT Mapping of Bilingual Clinical Text. Journal of Medical Systems, 50(1), Article 141. https://doi.org/10.1007/s10916-026-02465-3

Image Credits: AI Generated

DOI: 10.1007/s10916-026-02465-3

Keywords: SNOMED CT, large language models, clinical terminology mapping, human-AI collaboration, retrieval-augmented generation, electronic health records, semantic interoperability, bilingual clinical text, health information management, vector database, GPT-4, medical coding