Infrared Fingerprints and AI Reveal How Herbal Medicine Processing Changes Chemistry

A team of researchers in China has combined an old workhorse of the chemistry laboratory with modern machine learning to solve a problem that has long frustrated the herbal food and medicine trade: telling apart commercially sold products of the plant Polygonatum sibiricum that have been processed in different traditional ways. Writing in Food Science and Biotechnology, the group led by Zhonghua Guo of Yunnan Normal University and Quanhong Ou describes an interpretable framework built on Fourier transform infrared spectroscopy, or FTIR, that can classify products labeled as raw, nine-steamed-and-nine-sun-dried, honey-processed, and wine-processed. The study, published on 13 October 2026, offers a fast, low-cost route to verifying processing claims on shelves where such labels are otherwise difficult to check.

Polygonatum sibiricum, known in Chinese as huangjing, is an edible botanical material with a long history in traditional food culture. Like many botanical products, it is not simply sold as harvested. Producers apply traditional food-processing methods that can involve repeated steaming and drying cycles, soaking in honey, or treatment with wine. Each of these treatments is believed to alter the chemical composition of the plant material, changing its flavor, its spectral fingerprint, and potentially its functional properties. That variability is precisely what makes authentication hard: a dried rhizome that has been steamed nine times and sun-dried nine times looks, to the naked eye, broadly similar to one that has merely been dried, yet the market treats the two as distinct products with distinct values.

The core analytical tool in the new study is FTIR spectroscopy, a technique that shines broadband infrared light through or onto a sample and records which frequencies are absorbed. Because chemical bonds absorb infrared radiation at characteristic frequencies, the resulting spectrum acts as a molecular fingerprint. O–H stretches associated with hydroxyl groups, C–H vibrations from carbon-hydrogen bonds, and C–O and C–O–C vibrations typical of ethers and carbohydrates all leave signatures in the mid-infrared region. For carbohydrate-rich plant materials such as Polygonatum rhizomes, these bands carry a great deal of information, since processing methods such as steaming are known to transform sugars and polysaccharides. Crucially, FTIR requires minimal sample preparation, no reagents, and only minutes of measurement time, which makes it attractive for routine quality control compared with slower chromatographic methods.

A raw spectrum, however, is far too complex for a human inspector to decode into a processing category. The bands overlap, baselines drift, and the differences between processing types may be subtle shifts in relative intensity rather than the appearance of new peaks. This is where machine learning enters. The researchers treated each spectrum as a high-dimensional data vector and trained classification algorithms to recognize the patterns associated with each labeled processing type. But they went a step further than many previous studies by insisting on interpretability: rather than accepting a black-box verdict, they wanted the model to show which spectral features drove its decisions.

A central methodological concern in the study is information leakage, a subtle but serious pitfall in spectroscopy-based machine learning. When spectra are preprocessed, features selected, and models evaluated using randomly split measurements, spectra recorded from the same physical sample can end up on both sides of the train-test divide. The model then partly memorizes sample-specific quirks rather than learning genuine chemical differences, inflating reported accuracy. The team avoided this by performing model training, feature selection, and evaluation at the physical-sample level, ensuring that all measurements from a given product were kept together during splitting. This design choice makes the reported performance a more honest estimate of how the system would behave on genuinely new products.

Before classification, the researchers confronted the dimensionality problem. An FTIR spectrum contains thousands of data points, many of them redundant or noisy, and feeding all of them into a classifier invites overfitting. The team compared three dimensionality-reduction strategies: principal component analysis, the classic statistical technique that compresses data into orthogonal axes of maximum variance; the successive projections algorithm, a variable-selection method that seeks subsets of columns with minimal collinearity; and simulated annealing, an optimization procedure inspired by the metallurgical process of slowly cooling material to reach a low-energy state. Simulated annealing explores the space of possible feature subsets by accepting not only improvements but occasionally worse solutions, allowing it to escape local optima that greedy search methods would get stuck in.

The standout configuration paired simulated annealing feature selection with a Random Forest classifier, an ensemble method that builds many decision trees on random subsets of the data and averages their votes. The resulting SA–Random Forest model showed stable discrimination performance across the four labeled processing categories. Stability, in this context, matters as much as raw accuracy: a model that performs brilliantly on one data split but collapses on another is of little use in a regulatory or commercial setting. By anchoring both feature selection and evaluation to physical samples, the authors could demonstrate that the model’s discrimination reflected reproducible chemical differences rather than statistical artifacts.

The interpretability layer came from SHapley Additive exPlanations, or SHAP, a framework borrowed from cooperative game theory that assigns each input feature a contribution value for every individual prediction. Applied to the spectral data, SHAP analysis linked the model’s outputs to specific interpretable spectral features, identifying variables related to O–H, C–H, and C–O/C–O–C vibrations as the key discriminators. These assignments make chemical sense. Repeated steaming is known to promote transformations in carbohydrate-rich components, honey processing introduces sugars with their own hydroxyl-rich signatures, and wine processing can alter the profile of soluble carbohydrates and other constituents. The fact that the model latched onto hydroxyl and glycosidic-bond regions suggests it was reading genuine processing chemistry rather than exploiting confounders such as particle size or instrument drift.

The broader significance of the work lies in what it says about the future of food and botanical authentication. FTIR-based chemical fingerprinting coupled with machine learning has already been applied to saffron adulteration, edible oil verification, sea cucumber origin tracing, and the geographic identification of medicinal herbs, and the new study extends this toolkit to processing-type discrimination, a dimension of authenticity that is often overlooked. Because the approach works at the laboratory level with rapid measurements and no chemical reagents, it could in principle be adapted to screening incoming batches, auditing supplier claims, or supporting market surveillance of traditionally processed botanical foods. The authors are careful to frame the results as demonstrating potential at the lab level rather than a deployable field method, an appropriate caution given that the study examined commercially available products whose labels cannot be independently verified.

There are also instructive lessons here for anyone building spectroscopy-machine learning systems. The comparison of dimensionality-reduction methods shows that feature selection strategy can matter as much as classifier choice, and the emphasis on sample-level data handling sets a standard that many published chemometric studies still fail to meet. The pairing of a powerful ensemble classifier with SHAP explanations demonstrates that accuracy and transparency need not be traded off against each other. For Polygonatum sibiricum specifically, the study establishes that the chemical consequences of traditional processing are large enough to be captured in an infrared fingerprint and robust enough to survive honest validation. As demand for traditionally processed botanical foods grows across Asia and beyond, tools like this one may become the difference between a market built on trust and one built on verifiable chemistry. The work was supported by Yunnan Fundamental Research Projects, and the authors report no competing financial interests.

Subject of Research: FTIR spectroscopy combined with interpretable machine learning to classify processed Polygonatum sibiricum products

Article Title: Interpretable FTIR spectroscopy and machine learning for discriminating commercially available Polygonatum sibiricum products labeled as different processing types

Article References: Interpretable FTIR spectroscopy and machine learning for discriminating commercially available Polygonatum sibiricum products labeled as different processing types. (n.d.). https://doi.org/10.1007/s10068-026-02326-2

Image Credits: AI Generated

DOI: 10.1007/s10068-026-02326-2

Keywords: Polygonatum sibiricum, FTIR spectroscopy, machine learning, Random Forest, simulated annealing, SHAP, food authentication, chemical fingerprinting, traditional food processing, chemometrics, infrared spectroscopy, food analysis