AI Prototype Brings Page-Cited Medical Answers to Somali Speakers

A team of computer scientists at Somali National University in Mogadishu has built and verified a prototype system that could one day let Somali speakers describe their symptoms in their own language and receive medical information grounded in English-language textbooks, complete with page-level citations. The work, published in Discover Artificial Intelligence, tackles a problem that has long been overlooked: Somali remains largely absent from evaluated health-oriented natural-language systems, leaving millions of speakers to rely on general-purpose chatbots whose answers cannot be traced to any defined medical source.

The researchers, led by Hamza Abdiaziz Mohamed, were careful to frame what they have and have not achieved. Their system is a software prototype, verified through deterministic engineering tests, not a clinically validated triage tool. The team explicitly states that no claims of clinical accuracy, linguistic quality, user acceptance, or deployment effectiveness are supported by the study. Yet the architecture itself represents a meaningful contribution, because it documents every parameter needed to reproduce the pipeline, from chunk sizes to embedding dimensions to the exact model identifiers used at each stage.

At the heart of the system is a cross-lingual retrieval-augmented generation, or RAG, architecture. The knowledge base was built from five established English medical textbooks, including CURRENT Medical Diagnosis & Treatment, which required a dedicated optical character recognition correction pass because the source PDF contained extraction defects. In total, the processed collection spans 25,562 PDF pages, which were divided into overlapping chunks of 275 words with a 40-word overlap, yielding 64,177 discrete text segments. Each chunk was encoded into a 1,536-dimensional vector using OpenAI’s text-embedding-3-small model and indexed with FAISS, a similarity-search library, using inner product over L2-normalized vectors, which is mathematically equivalent to cosine similarity.

A crucial design decision was to keep the textbooks in English rather than machine-translating them into Somali before indexing. This avoids storing an unvalidated translated medical corpus and allows retrieval against the original source language, preserving access to authentic passages for audit. The trade-off is that translation quality becomes a runtime dependency. When a user submits a Somali symptom narrative, GPT-4o-mini translates it into clinical English while preserving symptoms, duration, negated findings, severity, anatomy, age or pregnancy status, and emergency signals. The translation step is explicitly instructed not to diagnose or add facts, because previous research has shown that multilingual models perform markedly worse in Somali than in English for long-context retrieval and reasoning tasks.

Safety routing begins before any retrieval happens. A deterministic bilingual rule set scans both the original Somali text and the translated English text for emergency signals, including unconsciousness, severe bleeding, seizures, stroke-like signs, suicidal intent, and the combination of chest pain with breathlessness. If any signal is detected, the system bypasses retrieval and generation entirely, labels the response as an emergency, and advises the user to seek immediate local emergency care rather than waiting for further chatbot interaction. This fail-fast pathway reduces dependence on the language model for the phrases encoded in the rules, though the authors caution that it cannot cover every emergency presentation, synonym, spelling variation, or culturally specific expression of distress.

For non-emergency queries, the translated English question is embedded and matched against the FAISS index, returning up to five passages with a cosine similarity of at least 0.25, a fixed configuration value rather than an optimized threshold. These retrieved passages are then supplied to the generator under an evidence-only prompt that restricts the model to using only the supplied excerpts, forbids prescribing drugs or doses, and permits citation only of chunk identifiers actually returned by retrieval. The generated English response contains structured fields for urgency, summary, guidance, red flags, recommended action, evidence identifiers, and limitations, and is then translated back into Somali under constraints that preserve urgency and prohibit new diagnoses or medication information.

One of the most technically interesting components is the citation guard. The system constructs an allow-list of chunk identifiers returned by retrieval, and if the model cites an identifier outside that set, the response is rejected outright. If evidence was retrieved but the answer cites none of it, the response is likewise rejected. When no passage meets the retrieval threshold, the system returns an uncertain status, states that evidence was insufficient, and recommends assessment by a qualified professional. The authors are careful to note that citation validity and claim validity remain different properties: the guard prevents fabricated references but does not prove that a cited passage actually entails every generated statement. Sentence-level entailment checking and clinician review remain future work.

The verification protocol followed a design-science and software-engineering approach, using deterministic test scenarios with isolated substitutes for external model calls where appropriate. The tests covered API request validation, document extraction and cleaning, repeated-header removal, chunk size and overlap correctness, deterministic identifier generation, metadata preservation, embedding-vector consistency, resumable processing, stale-row filtering, index construction, nearest-neighbour retrieval, emergency overrides, citation integrity, invalid-reference rejection, and structured response generation. All defined scenarios completed successfully, and the final index contained 64,177 vectors aligned one-to-one with the processed chunks. An illustrative live transaction, using the Somali query about abdominal pain and diarrhoea, traversed the complete data path and returned citations to three of the source textbooks, confirming that the integrated pipeline executes as designed.

The authors are transparent about the study’s limitations, listing seven principal constraints. No patient records, clinician-labelled cases, or human participants were involved, so no triage accuracy, sensitivity, specificity, or usability figures can be reported. Somali lacks a sufficiently large, clinician-validated medical dataset for supervised fine-tuning, which constrained the work to retrieval-based grounding. The safety rules cover a limited phrase set, the English-only knowledge base depends on runtime translation, source metadata are incomplete for three of the locally held textbook files, and reliance on an external API introduces privacy, availability, cost, and model-version dependencies. The team also emphasizes that symptom narratives transmitted to an external provider may be sensitive, and any production deployment would require data minimization, consent processes, transport encryption, and jurisdiction-specific compliance.

Looking forward, the researchers outline a staged evaluation pathway before any clinical claims could be made. A preregistered test set should be developed by qualified Somali-speaking clinicians, covering routine, urgent, emergency, ambiguous, negated, misspelled, colloquial, code-switched, paediatric, pregnancy-related, and mental-health presentations, with at least two independent clinicians assigning reference labels and inter-rater agreement reported. Required comparisons include keyword retrieval, semantic retrieval without generation, a base language model without RAG, and the full cross-lingual safety-constrained system, with retrieval metrics such as precision at k and mean reciprocal rank, safety confusion matrices with confidence intervals, and separate scoring of citation correctness, evidence entailment, and Somali fluency. Until such evaluations are complete, the prototype stands as a rigorously documented demonstration that auditable, cross-lingual medical information systems for low-resource languages are technically feasible, and as a template for how such systems should report their own boundaries.

Subject of Research: A cross-lingual retrieval-augmented generation prototype providing Somali speakers with evidence-grounded medical symptom guidance retrieved from English textbooks.

Article Title: A medical retrieval augmented generation prototype for somali symptom guidance with cross lingual evidence retrieval and technical verification

Article References: Mohamed, H. A., Mohamud, D. A., Mohamed, Z. A., & Hirsi, A. M. (2026). A medical retrieval augmented generation prototype for somali symptom guidance with cross lingual evidence retrieval and technical verification. Discover Artificial Intelligence, 6(1), Article 1249. https://doi.org/10.1007/s44163-026-02180-5

Image Credits: AI Generated

DOI: 10.1007/s44163-026-02180-5

Keywords: retrieval-augmented generation, Somali language, medical question answering, cross-lingual retrieval, FAISS, large language models, GPT-4o-mini, clinical decision support, low-resource languages, patient safety, citation validation, emergency triage