Tuesday, November 17, 2026
Science
No Result
View All Result
  • Login
  • HOME
  • SCIENCE NEWS
  • CONTACT US
  • HOME
  • SCIENCE NEWS
  • CONTACT US
No Result
View All Result
Scienmag
No Result
View All Result
Home Science News

Multimodal Framework Improves Chemical Reaction Extraction From Complex Scientific Texts

November 17, 2026
in Science News
Gavin Prescott
By Gavin Prescott Scienmag Editorial Profile - Ecology and Ecosystem Dynamics
Reading Time: 2 mins read
0
Multimodal Framework Improves Chemical Reaction Extraction From Complex Scientific Texts

Multimodal Framework Improves Chemical Reaction Extraction From Complex Scientific Texts

65
SHARES
587
VIEWS
Share on FacebookShare on Twitter
ADVERTISEMENT

A multimodal framework named CREST effectively improves the extraction of chemical reaction information from scientific literature on a self-built evaluation dataset, according to a research study published in the Journal on Image and Video Processing. The development of large language models for the chemical domain relies heavily on access to high-quality structured data, but key experimental details are frequently distributed across published documents in varied formats. The newly reported system demonstrates that an end-to-end pipeline can achieve extraction performance comparable to certain closed-source models while relying on a relatively small model size.

The research identifies a major operational challenge in chemical informatics: crucial experimental information in chemical literature is scattered across scientific PDF documents in multimodal forms. Within these documents, experimental records are presented through visual reaction schemes, dense experimental tables, figure captions, and supplementary footnotes. This diverse presentation makes automated structured information extraction substantially more difficult than traditional single-modality text extraction.

The authors outline several specific problems that have limited automated extraction in previous workflows. Chief among these issues are the technical difficulty of finely segmenting reaction schemes located within complex publication layouts, the core challenge of conducting unified semantic parsing across multiple modalities simultaneously, and the widespread lack of an end-to-end workflow designed for local deployment and continuous model optimization.

To address layout segmentation hurdles directly, the CREST framework combines two tools, VisualHeist and MinerU, to carry out fine-grained segmentation of PDF document content. In addition to segmenting visual elements, this processing pipeline systematically extracts document titles, descriptive text blocks, and footnotes. These extracted textual components are subsequently utilized as auxiliary text prompts to support downstream interpretation.

At the core of the framework is an end-to-end information extraction pipeline built upon the Qwen3 multimodal language model. By implementing Low-Rank Adaptation (LoRA) fine-tuning, the research team trained the Qwen3 architecture to jointly parse graphical reaction schemes, experimental data tables, and related textual descriptions within a unified semantic parsing workflow.

To validate the system’s extraction accuracy, the researchers developed an evaluation mechanism that integrates automated evaluation metrics with independent expert verification. In experimental trials conducted on the self-built chemical literature dataset, CREST demonstrated effective improvements in multimodal reaction information extraction, achieving performance levels comparable to closed-source models despite its smaller model size.

The authors emphasized that these experimental findings confirm the practical value and application potential of the framework for chemical research. Moving beyond experimental testing, the team also deployed a functional online information extraction service powered by CREST, making the multimodal extraction pipeline accessible to the broader scientific community through a dedicated online portal.

Subject of Research: Multimodal chemical reaction information extraction from scientific literature

Article Title: CREST: Chemical Reaction Extraction from Scientific Texts

Article References: Li, X., Liang, H., Wang, X., Yang, F., & Xu, F. (2026). CREST: Chemical Reaction Extraction from Scientific Texts. Journal on Image and Video Processing. https://doi.org/10.1186/s13640-026-00704-8

Image Credits: AI Generated

DOI: 10.1186/s13640-026-00704-8

Keywords: chemical reaction extraction, scientific literature, multimodal framework, CREST, Qwen3, LoRA fine-tuning, VisualHeist, MinerU, PDF segmentation, reaction schemes, experimental tables, figure captions, chemical domain language models, semantic parsing, expert verification, automated evaluation, structured data extraction

Cite Scienmag News

Gavin Prescott. (November 17, 2026). Multimodal Framework Improves Chemical Reaction Extraction From Complex Scientific Texts. Scienmag. https://scienmag.com/multimodal-framework-improves-chemical-reaction-extraction-from-complex-scientific-texts/

Gavin Prescott. "Multimodal Framework Improves Chemical Reaction Extraction From Complex Scientific Texts." Scienmag, 17 November 2026, https://scienmag.com/multimodal-framework-improves-chemical-reaction-extraction-from-complex-scientific-texts/. Accessed 17 November 2026.

Gavin Prescott. "Multimodal Framework Improves Chemical Reaction Extraction From Complex Scientific Texts." Scienmag. November 17, 2026. https://scienmag.com/multimodal-framework-improves-chemical-reaction-extraction-from-complex-scientific-texts/

Tags: automated evaluationchemical domain language modelschemical reaction extractionCRESTexperimental tablesexpert verificationfigure captionsLoRA fine-tuningMinerUmultimodal frameworkPDF segmentationQwen3reaction schemesscientific literaturesemantic parsingstructured data extractionVisualHeist
Share26Tweet16
Previous Post

Interconnected Water Risks Amplify Infectious Disease in Informal Urban Settlements

Next Post

Crop Water Stress Detection Accuracy Drops 22 Percentage Points Field-Side

Related Posts

Photonic Crystals Enhance Perovskite Nanocrystal Light Emission Up to 110-Fold
Science News

Photonic Crystals Enhance Perovskite Nanocrystal Light Emission Up to 110-Fold

November 17, 2026
Physicians Prioritize Survival Benefits in Treating Advanced Non–Small Cell Lung Cancer
Cancer

Physicians Prioritize Survival Benefits in Treating Advanced Non–Small Cell Lung Cancer

November 17, 2026
Two Italian Radiology Journals Transition to Springer Nature SNAPP Editorial Platform
Science News

Two Italian Radiology Journals Transition to Springer Nature SNAPP Editorial Platform

November 17, 2026
Ketogenic Diet Improves Renal Fanconi Syndrome in Single Pediatric Cystinosis Case
Medicine

Ketogenic Diet Improves Renal Fanconi Syndrome in Single Pediatric Cystinosis Case

November 17, 2026
Self-Supervised Framework Enhances Anomaly Detection Accuracy Across Dynamic Internet of Things Networks
Technology and Engineering

Self-Supervised Framework Enhances Anomaly Detection Accuracy Across Dynamic Internet of Things Networks

November 17, 2026
Most Patients Achieve Pouch Preservation Using Endoscopic or Revisional Approaches, Narrative Review Finds
Medicine

Most Patients Achieve Pouch Preservation Using Endoscopic or Revisional Approaches, Narrative Review Finds

November 17, 2026
Next Post
Crop Water Stress Detection Accuracy Drops 22 Percentage Points Field-Side

Crop Water Stress Detection Accuracy Drops 22 Percentage Points Field-Side

  • Mothers who receive childcare support from maternal grandparents show more optimized

    Mothers who receive childcare support from maternal grandparents show more parental warmth, finds NTU Singapore study

    27656 shares
    Share 11059 Tweet 6912
  • University of Seville Breaks 120-Year-Old Mystery, Revises a Key Einstein Concept

    1061 shares
    Share 424 Tweet 265
  • Bee body mass, pathogens and local climate influence heat tolerance

    682 shares
    Share 273 Tweet 171
  • Researchers record first-ever images and data of a shark experiencing a boat strike

    546 shares
    Share 218 Tweet 137
  • Groundbreaking Clinical Trial Reveals Lubiprostone Enhances Kidney Function

    531 shares
    Share 212 Tweet 133
Science

Embark on a thrilling journey of discovery with Scienmag.com—your ultimate source for cutting-edge breakthroughs. Immerse yourself in a world where curiosity knows no limits and tomorrow’s possibilities become today’s reality!

RECENT NEWS

  • Photonic Crystals Enhance Perovskite Nanocrystal Light Emission Up to 110-Fold
  • Physicians Prioritize Survival Benefits in Treating Advanced Non–Small Cell Lung Cancer
  • Two Italian Radiology Journals Transition to Springer Nature SNAPP Editorial Platform
  • Ketogenic Diet Improves Renal Fanconi Syndrome in Single Pediatric Cystinosis Case

Categories

  • Agriculture
  • Anthropology
  • Archaeology
  • Athmospheric
  • Biology
  • Biotechnology
  • Blog
  • Bussines
  • Cancer
  • Chemistry
  • Climate
  • Earth Science
  • Editorial Policy
  • Marine
  • Mathematics
  • Medicine
  • Pediatry
  • Policy
  • Psychology & Psychiatry
  • Science Education
  • Science News
  • Social Science
  • Space
  • Technology and Engineering

Subscribe to Blog via Email

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 5,150 other subscribers

© 2026 Scienmag - Science Magazine

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In
No Result
View All Result
  • HOME
  • SCIENCE NEWS
  • CONTACT US

© 2026 Scienmag - Science Magazine

Discover more from Science

Subscribe now to keep reading and get access to the full archive.

Continue reading