The historical starting point is instructive. ELIZA, written by Joseph Weizenbaum in 1966, sustained engaging conversations using nothing more than string matching and templated responses, famously simulating a Rogerian psychotherapist by rephrasing user statements as questions. Finite-state dialogue systems and frame-based architectures with slot-filling mechanisms followed, powering predictable, task-oriented applications such as interactive voice response. These systems were interpretable and controllable, but their rigidity, poor scalability, and inability to acquire new knowledge made them fundamentally unsuited to open-ended dialogue. The survey treats them as essential context: they established the principles of human-computer conversation while exposing the ceiling of hand-crafted rules.

Generative chatbots built on Transformer architectures shattered that ceiling, producing fluent, context-aware responses across virtually any topic. Yet the survey is blunt about their structural weaknesses. Because factual knowledge lives implicitly in model weights, generative systems hallucinate, especially on ambiguous or out-of-distribution queries; their knowledge freezes at training time; and their outputs lack transparent attribution, a serious problem in regulated domains like healthcare, finance, and law. Even high average benchmark performance conceals occasional but confident failures that erode user trust. Scale alone, the authors argue, has proven insufficient to guarantee reliability in real-world conversational settings.

RAG emerged as the answer by decoupling knowledge access from model parameters. Instead of relying solely on memorized facts, a RAG system retrieves relevant documents at inference time and conditions its response on that evidence. The survey models this as a modular pipeline: query processing, knowledge chunking and representation, retrieval, optional re-ranking, retrieval-generation fusion, response generation, and finally grounding, attribution, and safety controls. Design decisions at earlier stages propagate downstream, which is why the authors insist that RAG must be understood as a family of architectures with internal trade-offs rather than a single algorithm. Their framework identifies six core dimensions, from chunking strategy to safety controls, that recur across the literature.

Those trade-offs are quantitatively striking. Shrinking chunk size from 512 to 128 tokens improves recall@5 by roughly 8 to 12 percent on open-domain benchmarks, but degrades generation coherence by 3 to 5 percent because fragmented context forces the generator to reconstruct meaning, elevating hallucination risk. Cross-encoder re-ranking can lift precision by up to 15 percent in mean reciprocal rank, yet adds 200 to 300 milliseconds of latency per query, a cost that can violate real-time interaction constraints. Dense retrieval cuts retrieval latency by 40 to 60 percent compared with lexical methods at scale, but demands costly vector indexing infrastructure. Hybrid pipelines that combine sparse lexical retrieval with dense semantic matching are increasingly favoured in production, balancing efficiency against robustness at the price of orchestration complexity.

The survey’s failure-mode analysis may be its most valuable contribution. RAG chatbots fail in distinctive, systematic ways: retrieval returns semantically similar but pragmatically irrelevant passages that anchor responses to wrong assumptions; heterogeneous sources yield contradictory evidence that generators resolve arbitrarily; retrieved text can carry prompt injections that override system intent; and generators engage in citation laundering, attaching plausible-looking references to unsupported claims. Perhaps most troubling, models with high BERTScore values still produced unsupported claims in 28 to 35 percent of responses when evaluated against their retrieved evidence. The authors also highlight a subtler insight from recent in-context learning research: retrieved passages act as demonstrations whose effectiveness is model-dependent, so optimal retrieval must account for the specific generator’s conditional entropy, not just generic similarity.

Evaluation practices come in for sharp criticism. Standard metrics like BLEU and ROUGE correlate only weakly with human judgments of factual consistency, with Pearson coefficients of roughly 0.21 to 0.38 across knowledge-grounded dialogue benchmarks. Systems with identical retrieval performance produced generation quality varying by more than 15 percentage points in human-rated faithfulness depending on fusion strategy, showing that end-task metrics conflate retrieval quality with generation quality. Newer frameworks attempt to fix this: RAGAS decomposes quality into faithfulness, answer relevance, and context relevance; ARES adds statistically rigorous confidence intervals via prediction-powered inference; and RAGChecker diagnoses whether errors stem from the retriever or the generator. LLM-as-judge approaches scale well but inherit self-preference bias, inflating scores by 5 to 15 percent when evaluator and generator share a model family, plus position bias tied to passage ordering.

Domain case studies show there is no universal RAG configuration. In healthcare, MedRAG retrieved from five million PubMed abstracts to reach 78.3 percent accuracy on the MedQA-USMLE benchmark, against 60.2 percent for non-RAG GPT-4, while systems with explicit grounding achieved clinician-rated accuracy of 86 to 92 percent versus 68 to 74 percent without it. Legal deployments demand citation accuracy above 95 percent and jurisdictional tagging, with hybrid retrieval reaching an MRR of 0.87 but incurring 350 milliseconds of extra latency. Enterprise systems such as FinRAG process over 10,000 queries daily at 1.8-second average latency while maintaining fine-grained access controls, and educational platforms report 82 percent student satisfaction with RAG-based tutoring versus 65 percent for non-RAG baselines. Regulatory frameworks from HIPAA to the EU AI Act increasingly make grounding verification a compliance requirement rather than an optional feature.

Looking forward, the survey identifies frontiers that could define the next decade of conversational AI. Self-RAG teaches a single model to decide when retrieval is needed and critique its own outputs using reflection tokens, while Corrective RAG deploys a lightweight evaluator that discards poor retrievals and falls back to web search. Agentic RAG treats retrieval as a tool invoked on demand within reasoning loops, and GraphRAG exploits knowledge graphs for multihop reasoning that flat retrieval cannot capture. The authors call for controlled ablation experiments that isolate chunking, retrieval depth, and fusion effects under fixed generator conditions, alongside privacy-preserving retrieval pipelines, attribution-aware generation, and multimodal grounding. Their central message is that RAG chatbots are evolving socio-technical systems: building ones that are genuinely reliable requires managing interactions across the whole pipeline, not optimizing components in isolation.

Subject of Research: Retrieval-augmented generation architectures for knowledge-grounded conversational AI systems

Article Title: A Survey of conversational AI from rule based to generative and retrieval augmented generation chatbots

Article References: Ghaywat, V., Singh, A., Shahade, A. K., Khan, W., & Deshmukh, P. V. (2026). A Survey of conversational AI from rule based to generative and retrieval augmented generation chatbots. Discover Artificial Intelligence, 6(1), Article 1292. https://doi.org/10.1007/s44163-026-02373-y

Image Credits: AI Generated

DOI: 10.1007/s44163-026-02373-y

Keywords: retrieval-augmented generation, chatbots, conversational AI, large language models, hallucination, dense retrieval, knowledge grounding, Self-RAG, GraphRAG, evaluation metrics, healthcare AI, systematic survey

Their system, called React-to-Me, is a conversational assistant built on top of the Reactome Pathway Knowledgebase, one of the most rigorously maintained curated resources in molecular biology. Reactome, stewarded by a team of expert biologists, documents human biological pathways, molecular interactions, and disease mechanisms with a level of care that ordinary web search cannot match. Yet the knowledgebase has a usability problem: its data model is intricate, and its search interface rewards people who already know the vocabulary and structure of the underlying database. For a graduate student, a clinician, or a researcher crossing into a new field, that learning curve can be discouraging. React-to-Me was designed to let such users ask questions in plain natural language while still receiving answers that are traceable, verifiable, and anchored in curated content.

The engineering heart of the system is a hybrid retrieval-augmented generation pipeline, a technique that constrains a language model to answer only from documents fetched at query time rather than from its internal memory. In React-to-Me, an incoming question triggers two complementary searches over the Reactome corpus. The first is a semantic vector search, which uses neural embeddings to match the meaning of the question against the meaning of database entries, capturing paraphrases and conceptual overlap that keyword matching would miss. The second is a lexical keyword search, of the BM25 variety familiar from classic information retrieval, which excels at pinning down precise identifiers, gene names, and chemical terms. The two ranked lists are merged with reciprocal rank fusion, a method that rewards documents appearing near the top of both lists, and the fused evidence is handed to a language model that is instructed to generate an answer grounded strictly in that retrieved material.

Grounding alone is not enough; the system also insists on provenance. Every response is directly linked to the corresponding Reactome entries from which it was assembled, so users can click through and inspect the curated pathways behind the answer. And when the retrieved evidence is thin or absent, React-to-Me is designed to defer rather than improvise: it declines to speculate and instead points users toward trusted external biomedical sources. This refusal behavior, the authors argue, is a feature rather than a failure, because an honest admission of limited coverage is far more valuable to a scientist than a fabricated pathway. The team tested how well that refusal logic worked in the wild by manually classifying logged instances where the system declined to answer, finding that out-of-scope biology questions were the largest category, accounting for 31.9 percent of refusals.

Before any human saw the system, the researchers put the retrieval engine itself through computational benchmarking using the Ragas evaluation framework, scoring configurations on context utilization, relevance, and faithfulness across several query types: simple factual lookup, mechanistic reasoning, multi-context synthesis, and conditional logic. The results showed a clear pattern. Semantic retrieval on its own preserved relevance but faltered on faithfulness, letting unsupported statements slip through, while pure keyword retrieval weakened on complex reasoning tasks that required synthesizing multiple sources. The combined hybrid approach, ranked by reciprocal rank fusion, delivered the highest and most stable scores across every metric and every query type, confirming that the two retrieval strategies compensate for each other’s blind spots.

Real-world deployment brought a second wave of evidence. Analyzing user queries logged during October 2025 and March 2026, the team found that factual lookup and mechanistic or relational biology questions dominated, together accounting for 56.1 percent of classified logged-in queries. Notably, the mix shifted over time: factual lookups rose from 24.7 percent to 33.7 percent of classified queries, while mechanistic and relational questions declined from 32.7 percent to 21.2 percent, a pattern suggesting that as users became comfortable with the tool, they leaned on it increasingly as a rapid reference rather than a reasoning partner. The study received ethics approval from the University of Toronto Research Ethics Board under protocol number 47192, and all survey participants provided informed consent.

The most demanding test was a blinded head-to-head comparison against a general-purpose model, GPT-4o-mini, judged by ten external molecular biology experts who did not know which system produced which answer. The verdict favored grounding decisively. Grounded React-to-Me responses were more likely to receive higher quality ratings than their ungrounded counterparts, with an overall odds ratio of 2.01. The gains were strongest where scientific rigor matters most: factual accuracy improved with an odds ratio of 2.97, biological specificity with an odds ratio of 2.88, and mechanistic depth with an odds ratio of 1.83. Individual evaluator preferences, recorded in the supplementary data, showed consistent majority favoring of the grounded system across question-level comparisons, an exploratory mixed-effects ordinal regression accounting for variation among evaluators and questions.

User sentiment reinforced the expert verdict. In a survey of 25 consenting users drawn from the publicly deployed system, 92 percent expressed strong satisfaction with ease of use, 88 percent with citation reliability, and 85 percent with factual accuracy. Strikingly, perceived accuracy showed the strongest association with overall confidence in the system, with a correlation of r = 0.81, meaning that users who trusted the answers did so primarily because the facts checked out, not because the interface was pretty. Respondents spanned organization types and research fields, with human biology research most represented, followed by computational biology, cell biology, and genetics, and satisfaction held up across education levels and levels of prior Reactome experience.

Beyond the headline numbers, the study offers a practical template for institutions wrestling with how to deploy AI responsibly. The team published monthly operating costs, the full survey instrument, benchmark questions, and analysis code as supplementary materials, an unusual degree of transparency for a production AI deployment. The willingness to defer to trusted sources when coverage runs out, the insistence on clickable citations for every claim, and the hybrid retrieval architecture that balances conceptual breadth with lexical precision together sketch what credible scientific AI might look like. As funders and publishers grapple with hallucination risks in research tooling, React-to-Me demonstrates that domain-specific grounding is not a theoretical nicety but a measurable design choice, one that nearly triples the odds that an expert will judge an answer factually accurate. The broader lesson may extend well beyond pathways: for specialized knowledge, the future of conversational AI belongs to systems that know the boundaries of what they can honestly say.

Subject of Research: A grounded conversational AI interface for querying the Reactome Pathway Knowledgebase

Article Title: React-to-Me: real-world experience of a grounded conversational interface to the Reactome Pathway Knowledgebase

Article References: Mohammadi, H., Almodaresi, F., Hogue, G. F. J., Wright, A., Orlic-Milacic, M., Li, N. T., Mawani, A., & Stein, L. (2026). React-to-Me: real-world experience of a grounded conversational interface to the Reactome Pathway Knowledgebase. BMC Biology. https://doi.org/10.1186/s12915-026-02740-2

Image Credits: AI Generated

DOI: 10.1186/s12915-026-02740-2

Keywords: Reactome Pathway Knowledgebase, conversational AI, retrieval-augmented generation, large language models, knowledge grounding, biological pathways, biomedical question answering, hybrid retrieval, language model evaluation, computational biology, expert evaluation, responsible AI