Tuesday, November 17, 2026
Science
No Result
View All Result
  • Login
  • HOME
  • SCIENCE NEWS
  • CONTACT US
  • HOME
  • SCIENCE NEWS
  • CONTACT US
No Result
View All Result
Scienmag
No Result
View All Result
Home Science News

Multimodal Framework Improves Chemical Reaction Extraction From Complex Scientific Texts

November 17, 2026
in Science News
Gavin Prescott
By Gavin Prescott Scienmag Editorial Profile - Ecology and Ecosystem Dynamics
Reading Time: 2 mins read
0
Multimodal Framework Improves Chemical Reaction Extraction From Complex Scientific Texts

Multimodal Framework Improves Chemical Reaction Extraction From Complex Scientific Texts

65
SHARES
587
VIEWS
Share on FacebookShare on Twitter
ADVERTISEMENT

A multimodal framework named CREST effectively improves the extraction of chemical reaction information from scientific literature on a self-built evaluation dataset, according to a research study published in the Journal on Image and Video Processing. The development of large language models for the chemical domain relies heavily on access to high-quality structured data, but key experimental details are frequently distributed across published documents in varied formats. The newly reported system demonstrates that an end-to-end pipeline can achieve extraction performance comparable to certain closed-source models while relying on a relatively small model size.

The research identifies a major operational challenge in chemical informatics: crucial experimental information in chemical literature is scattered across scientific PDF documents in multimodal forms. Within these documents, experimental records are presented through visual reaction schemes, dense experimental tables, figure captions, and supplementary footnotes. This diverse presentation makes automated structured information extraction substantially more difficult than traditional single-modality text extraction.

The authors outline several specific problems that have limited automated extraction in previous workflows. Chief among these issues are the technical difficulty of finely segmenting reaction schemes located within complex publication layouts, the core challenge of conducting unified semantic parsing across multiple modalities simultaneously, and the widespread lack of an end-to-end workflow designed for local deployment and continuous model optimization.

To address layout segmentation hurdles directly, the CREST framework combines two tools, VisualHeist and MinerU, to carry out fine-grained segmentation of PDF document content. In addition to segmenting visual elements, this processing pipeline systematically extracts document titles, descriptive text blocks, and footnotes. These extracted textual components are subsequently utilized as auxiliary text prompts to support downstream interpretation.

At the core of the framework is an end-to-end information extraction pipeline built upon the Qwen3 multimodal language model. By implementing Low-Rank Adaptation (LoRA) fine-tuning, the research team trained the Qwen3 architecture to jointly parse graphical reaction schemes, experimental data tables, and related textual descriptions within a unified semantic parsing workflow.

To validate the system’s extraction accuracy, the researchers developed an evaluation mechanism that integrates automated evaluation metrics with independent expert verification. In experimental trials conducted on the self-built chemical literature dataset, CREST demonstrated effective improvements in multimodal reaction information extraction, achieving performance levels comparable to closed-source models despite its smaller model size.

The authors emphasized that these experimental findings confirm the practical value and application potential of the framework for chemical research. Moving beyond experimental testing, the team also deployed a functional online information extraction service powered by CREST, making the multimodal extraction pipeline accessible to the broader scientific community through a dedicated online portal.

Subject of Research: Multimodal chemical reaction information extraction from scientific literature

Article Title: CREST: Chemical Reaction Extraction from Scientific Texts

Article References: Li, X., Liang, H., Wang, X., Yang, F., & Xu, F. (2026). CREST: Chemical Reaction Extraction from Scientific Texts. Journal on Image and Video Processing. https://doi.org/10.1186/s13640-026-00704-8

Image Credits: AI Generated

DOI: 10.1186/s13640-026-00704-8

Keywords: chemical reaction extraction, scientific literature, multimodal framework, CREST, Qwen3, LoRA fine-tuning, VisualHeist, MinerU, PDF segmentation, reaction schemes, experimental tables, figure captions, chemical domain language models, semantic parsing, expert verification, automated evaluation, structured data extraction

Cite Scienmag News

Gavin Prescott. (November 17, 2026). Multimodal Framework Improves Chemical Reaction Extraction From Complex Scientific Texts. Scienmag. https://scienmag.com/multimodal-framework-improves-chemical-reaction-extraction-from-complex-scientific-texts/

Gavin Prescott. "Multimodal Framework Improves Chemical Reaction Extraction From Complex Scientific Texts." Scienmag, 17 November 2026, https://scienmag.com/multimodal-framework-improves-chemical-reaction-extraction-from-complex-scientific-texts/. Accessed 17 November 2026.

Gavin Prescott. "Multimodal Framework Improves Chemical Reaction Extraction From Complex Scientific Texts." Scienmag. November 17, 2026. https://scienmag.com/multimodal-framework-improves-chemical-reaction-extraction-from-complex-scientific-texts/

Tags: automated evaluationchemical domain language modelschemical reaction extractionCRESTexperimental tablesexpert verificationfigure captionsLoRA fine-tuningMinerUmultimodal frameworkPDF segmentationQwen3reaction schemesscientific literaturesemantic parsingstructured data extractionVisualHeist
Share26Tweet16
Previous Post

Interconnected Water Risks Amplify Infectious Disease in Informal Urban Settlements

Next Post

Crop Water Stress Detection Accuracy Drops 22 Percentage Points Field-Side

Related Posts

Shared Biological Pathways Link Male Infertility and Erectile Dysfunction
Medicine

Shared Biological Pathways Link Male Infertility and Erectile Dysfunction

November 17, 2026
Longer Embryo Cryostorage Linked to Higher Odds of Large-for-Gestational-Age Births
Medicine

Longer Embryo Cryostorage Linked to Higher Odds of Large-for-Gestational-Age Births

November 17, 2026
3D Epigenome Maps Reveal Regulatory Architecture in Developing Human Glial Cells
Science News

3D Epigenome Maps Reveal Regulatory Architecture in Developing Human Glial Cells

November 17, 2026
Synthetic Protein Assemblies Designed by Artificial Intelligence Deliver Diverse Functional RNA Payloads
Science News

Synthetic Protein Assemblies Designed by Artificial Intelligence Deliver Diverse Functional RNA Payloads

November 17, 2026
Semaglutide Extends Lifespan and Slows Ageing in Female Mice
Science News

Semaglutide Extends Lifespan and Slows Ageing in Female Mice

November 17, 2026
Large Genetic Study Links Hundreds of DNA Variants to Human Personality Traits
Science News

Large Genetic Study Links Hundreds of DNA Variants to Human Personality Traits

November 17, 2026
Next Post
Crop Water Stress Detection Accuracy Drops 22 Percentage Points Field-Side

Crop Water Stress Detection Accuracy Drops 22 Percentage Points Field-Side

  • Mothers who receive childcare support from maternal grandparents show more optimized

    Mothers who receive childcare support from maternal grandparents show more parental warmth, finds NTU Singapore study

    27656 shares
    Share 11059 Tweet 6912
  • University of Seville Breaks 120-Year-Old Mystery, Revises a Key Einstein Concept

    1061 shares
    Share 424 Tweet 265
  • Bee body mass, pathogens and local climate influence heat tolerance

    682 shares
    Share 273 Tweet 171
  • Researchers record first-ever images and data of a shark experiencing a boat strike

    546 shares
    Share 218 Tweet 137
  • Groundbreaking Clinical Trial Reveals Lubiprostone Enhances Kidney Function

    531 shares
    Share 212 Tweet 133
Science

Embark on a thrilling journey of discovery with Scienmag.com—your ultimate source for cutting-edge breakthroughs. Immerse yourself in a world where curiosity knows no limits and tomorrow’s possibilities become today’s reality!

RECENT NEWS

  • Shared Biological Pathways Link Male Infertility and Erectile Dysfunction
  • Longer Embryo Cryostorage Linked to Higher Odds of Large-for-Gestational-Age Births
  • 3D Epigenome Maps Reveal Regulatory Architecture in Developing Human Glial Cells
  • Synthetic Protein Assemblies Designed by Artificial Intelligence Deliver Diverse Functional RNA Payloads

Categories

  • Agriculture
  • Anthropology
  • Archaeology
  • Athmospheric
  • Biology
  • Biotechnology
  • Blog
  • Bussines
  • Cancer
  • Chemistry
  • Climate
  • Earth Science
  • Editorial Policy
  • Marine
  • Mathematics
  • Medicine
  • Pediatry
  • Policy
  • Psychology & Psychiatry
  • Science Education
  • Science News
  • Social Science
  • Space
  • Technology and Engineering

Subscribe to Blog via Email

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 5,150 other subscribers

© 2026 Scienmag - Science Magazine

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In
No Result
View All Result
  • HOME
  • SCIENCE NEWS
  • CONTACT US

© 2026 Scienmag - Science Magazine

Discover more from Science

Subscribe now to keep reading and get access to the full archive.

Continue reading