Teaching AI to Think Before It Extracts: New Reasoning Framework Tops Benchmarks

Information extraction has long been one of the most deceptively difficult problems in natural language processing. Ask a machine to pull a company name out of a sentence and it will usually oblige. Ask it to untangle a multi-paragraph news story in which events, causes, and implicit relationships thread through one another, and even the most powerful large language models begin to stumble. A new framework called MR-UIE, developed by researchers at the Institute of Artificial Intelligence at China Telecom together with a collaborator at Beihang University, argues that the missing ingredient is not more data or bigger models, but a fundamental change in how extraction models reason about what they read.

The core idea behind MR-UIE is a shift from treating large language models as passive extractors to training them as active reasoners. Rather than simply asking a model to map input text onto a fixed output structure, the framework teaches it to consider multiple analytical perspectives, weigh different reasoning strategies, and select the path most likely to yield a correct, faithful extraction. The researchers describe this as enabling models to understand not only what to extract but also how to reason, a distinction they argue is critical when texts are riddled with ambiguity, implicit causal links, and context-dependent information that simple pattern matching cannot resolve.

Technically, the framework rests on four pillars. The first is a unified schema representation, drawing on function-call semantics, that converts task-specific schemas for entities, relations, and events into a common hierarchical JSON structure with class identifiers, property-defining arguments, and semantic descriptors. This abstraction allows a single model to handle named entity recognition, relation extraction, and event extraction within one consistent output grammar, and it lets schemas for unseen tasks be projected into the same space at inference time, supporting zero-shot generalization without task-specific adapters.

The second pillar is the construction of a multi-perspective reasoning dataset, modeled on a human cognitive cycle of brainstorming, generating multiple solutions, and converging on the best one. For each input text and schema, a large language model acting as a strategy generator produces fine-grained thinking strategies along three dimensions: cognitive perspective, professional role, and heuristic rules. These raw strategies are then clustered into keyword-defined paradigms, ranked by TF-IDF embeddings and cosine similarity, and sampled to balance distinctiveness against representativeness. DeepSeek-R1 is then prompted to produce step-by-step chain-of-thought rationales together with structured predictions for each retained strategy, and rejection sampling discards any strategy whose prediction disagrees with the ground truth. Samples that fail to accumulate a minimum number of correct strategies are withheld from supervised training and routed instead to the reinforcement learning stage, ensuring the model learns from cases where reasoning demonstrably helps.

Training proceeds in three stages. The model, built on Qwen3-8B, first undergoes supervised fine-tuning on a curated corpus of roughly one million instances drawn from the bilingual IEPile collection, teaching it to interpret instructions and emit outputs that strictly conform to the unified schema. In the second stage, multi-perspective reasoning fine-tuning injects strategy prefixes into inputs and introduces special thinking tokens that segment reasoning steps, with a composite objective that optimizes both the chain-of-thought rationales and the structured predictions. To prevent overfitting to any single strategy, the team employs a regularization trick called strategy hiding, in which ten percent of training examples instruct the model to skip reasoning entirely. The final stage applies reinforcement learning using a rule-based Group Relative Policy Optimization procedure, in which the model generates multiple candidate reasoning chains per question and learns from a multi-grained reward function that scores both results and process.

The reward design is notable for its granularity. The result reward decomposes correctness into category-level and argument-level components, reweighted to reflect the fact that category prediction is easier than argument extraction, and combined as a weighted harmonic mean to encourage joint optimization. The process reward evaluates faithfulness, checking whether the reasoning strictly follows the schema, effectively uses the source text, and reflects a sound strategy. A convex combination of the two guides the policy, allowing the model to internalize effective reasoning patterns rather than memorize specific templates. During reinforcement learning, difficult samples are deliberately emphasized to raise the ceiling of model capability while leaving reasoning formats unconstrained, encouraging autonomous exploration of optimal strategies.

The experimental results are striking. Across eleven supervised benchmarks spanning newswire, finance, biomedicine, and general science, MR-UIE set new state-of-the-art Micro-F1 scores on five datasets, and on the remaining six never trailed the best published result by more than 3.2 F1 points. The wins span the full spectrum of extraction tasks: the framework topped the mit-restaurant dataset with its eight colloquial entity types and ambiguous boundaries, led on the terminology-dense biomedical AnatEM corpus despite limited training data, achieved the best overall scores on the skewed eighteen-category KBP37 relation benchmark, and ranked first on argument extraction for DUEE-fin, a financial event dataset with thirteen event types, ninety-one argument roles, and severe role overlap.

Zero-shot performance tells perhaps the more important story. Evaluated on datasets from domains and schemas never seen during training, spanning literature, music, law, and social media in both English and Chinese, MR-UIE achieved top-two results on most tasks and beat GPT-4 in five experimental settings, including a new state-of-the-art for zero-shot named entity recognition on CrossNER. The researchers attribute this generalization to the unified schema, which lets supervised capabilities transfer without structural adaptation, and to adaptive chain-of-thought reasoning that dynamically decomposes problems into finer-grained sub-steps, helping the model distinguish easily confused elements on schema-heavy datasets.

Ablation studies confirm that each component earns its place. Removing the unified schema cost between 0.42 and 0.72 F1 points across subtasks, while dropping multi-perspective reasoning training caused a maximum decline of 2.48 F1 points, demonstrating that explicit multi-angle fine-tuning is essential rather than decorative. Reinforcement learning alignment proved to internalize the diverse strategies rather than memorize them: when compared directly against static alternatives, the reinforcement-learned dynamic strategy beat random template selection, which actually degraded performance below a no-strategy baseline, and outperformed similarity-based template matching, whose effectiveness varied by task. Intriguingly, the training dynamics showed that as reinforcement learning progressed, generated reasoning chains shortened and converged to roughly 300 tokens while reward scores steadily climbed, suggesting that concise, efficient thinking benefits extraction performance more than lengthy elaboration.

The authors are candid about limitations, noting that the framework still struggles to dynamically integrate diverse reasoning paths and to handle highly noisy text, and they point toward noise-aware reasoning modules, contrastive path selection, refined reward design, and extension to multimodal settings as future directions. Even so, the work makes a compelling case that the road to robust structured understanding runs through reasoning itself. By rewarding models for faithful, efficient thinking and giving them multiple analytical lenses to think through, MR-UIE demonstrates that teaching language models how to reason may matter as much as teaching them what to know, a conclusion likely to shape how the next generation of extraction systems is built.

Subject of Research: Multi-perspective reasoning with reinforcement learning for universal information extraction

Article Title: MR-UIE: multi-perspective reasoning with reinforcement learning for universal information extraction

Article References: Li, Z., Wang, S., Fang, R., Bao, M., Wu, Z., Song, S., Li, Y., & He, Z. (2025). MR-UIE: multi-perspective reasoning with reinforcement learning for universal information extraction. Vicinagearth, 2(1), Article 17. https://doi.org/10.1007/s44336-025-00019-8

Image Credits: AI Generated

DOI: 10.1007/s44336-025-00019-8

Keywords: information extraction, multi-perspective reasoning, reinforcement learning, large language models, chain-of-thought, universal information extraction, named entity recognition, relation extraction, event extraction, GRPO, zero-shot generalization, schema representation