New Quality Check Sorts Molecular Species Units in Metabarcoding Data

Metabarcoding has transformed the way ecologists take the pulse of an ecosystem. Instead of painstakingly identifying organisms under a microscope, researchers now sequence DNA barcodes directly from soil, water or sediment samples, producing millions of reads in a single run. The building blocks of these molecular biodiversity inventories are Operational Taxonomic Units, or OTUs: clusters of sequences that are mutually close enough to be assumed to represent a single biological entity. But the automated pipelines that assemble OTUs can make mistakes, and those mistakes can quietly distort the ecological conclusions drawn downstream. A team of researchers writing in Metabarcoding and Metagenomics now proposes a simple, automatic quality check that inspects the inner structure of every OTU and flags the ones that should not be trusted as they stand.

The core idea is elegant. In an ideal OTU, every sequence would sit at a dissimilarity smaller than the barcoding gap, the distance threshold that separates sequences of one taxon from those of another, with every read linked to every other read. Real OTUs deviate from this theoretical pattern, and the authors argue that the deviations are not random noise but carry structure of their own. They identify two characteristic ways in which an OTU can go wrong. The first is the composed OTU, an artificial merger of several true units, typically produced by the well-known chaining effect of single linkage clustering, in which sequences A and B are close, B and C are close, but A and C are far beyond the barcoding gap. The second is the OTU with noise, in which a handful of satellite sequences hang loosely off a densely connected core without forming a compact subgroup of their own.

To detect composed OTUs, the method relies on a single statistic computed directly from the array of pairwise dissimilarities within each OTU. The researchers build a graph in which each read is a node and an edge connects two reads whenever their dissimilarity falls below the barcoding gap. They then compute theta, the ratio of missing edges to all possible edges in that graph. For a single OTU, nearly all dissimilarities lie below the gap, so theta is small. For a composed OTU containing two balanced entities, the inter-entity dissimilarities are mostly above the gap, and theta approaches one half. Sorting the OTUs of a sample then becomes a matter of building a smoothed histogram of theta values with a Gaussian kernel and placing the critical threshold at the first local minimum between the first and second modes of the estimated density. Crucially, unlike the breaking phase of the SWARM algorithm, this procedure requires no arbitrarily fixed parameter.

Once composed OTUs have been separated from single ones, a second, supervised step hunts for noise among the single OTUs. The authors fit a two-block Stochastic Block Model to each dissimilarity array, a statistical framework that clusters sequences according to their shared patterns of connectivity and has the unusual plasticity of allowing blocks to be either assortative or dissortative. If an OTU is clean, both blocks are assortative and the diagonal elements of the inferred connectivity matrix are small. If noise reads are present, they are grouped into a dissortative block with large intra-block and inter-block dissimilarities. The two discriminating features, the mean inter-block dissimilarity and the largest mean intra-block dissimilarity, feed a linear Support Vector Machine trained on OTUs labelled by a degree-based expert classifier, which examines the percentage of gap-level connections each read maintains with the rest of the OTU.

Validation came from a rich dataset of diatoms collected in Arcachon Bay on the French Atlantic coast, made available through the Malabar project. Thirty-two samples were balanced across four seasons, four locations and two water columns, pelagic at high tide and benthic, yielding between 19,000 and 36,000 reads per sample of a 312 base pair region of the rbcL chloroplastic marker. Pairwise dissimilarities were computed with Smith-Waterman local alignment scores on a computing cluster, and OTUs were extracted as connected components of the gap-level graph, keeping only units with fifteen reads or more. For the eight samples of the Teychan location, an expert classification was built by visual inspection of heatmaps and community-structured graphs of 654 dissimilarity arrays, and the agreement with the automatic method was striking: only twelve false negatives among 104 expertly composed OTUs and nine false positives among 527 single ones.

Applied to the full dataset of 2,529 OTUs, the method revealed strong statistical links between OTU type and OTU size. A Wilcoxon Mann-Whitney test returned a p-value of roughly 1.5 times ten to the power of minus fifty-five for the composed-versus-single distinction, confirming that composed OTUs are systematically the largest ones. Among single OTUs, the test for noise returned a p-value of about 3.7 times ten to the power of minus twenty-two, showing that noisy units are also significantly larger than clean ones. Cross-validation of the Support Vector Machine on the training set achieved an Area Under Curve of 0.951, and on the 24 test samples the classifier caught every OTU with noise, although it recovered only about 64 percent of the OTUs without noise, a limitation the authors attribute to the gradient of noise intensity that the two SBM features trace simultaneously.

Taxonomic annotation provided an independent check. Among 180 fully annotated OTUs, about 85 percent were monospecific, and almost all single OTUs with noise, 153 of them, were monospecific as well, suggesting that satellite reads often belong to the same species as the core rather than to a different taxon. Only eight fully annotated OTUs were typed as composed, and they fell into three profiles: genuine multi-species mergers with clear two-block structure, monospecific units with loosely connected reads, and monospecific units whose dissimilarity arrays nevertheless split into two blocks, possibly reflecting structured intraspecific molecular diversity. One artefact also surfaced: a single reference sequence of the diatom Rhizosolenia fallax appeared repeatedly across OTUs of several genera and was set aside as a mapping anomaly.

Perhaps the most provocative result concerns the environment itself. The proportions of composed, noisy and clean OTUs varied from sample to sample, and a Wilcoxon rank test on the fractions of composed OTUs in benthic versus pelagic samples returned a p-value of 1.6 times ten to the power of minus four. Benthic samples carried a mean fraction of 0.19 composed OTUs against 0.10 in pelagic ones, strong evidence that the molecular diversity of the benthic diatom flora is structured differently, with species distances globally smaller than in the pelagic realm. The authors hypothesise that habitat may influence the alternation of sexual and asexual reproduction and thereby shape patterns of DNA diversity, though the chloroplastic rbcL marker makes any such influence indirect. No difference emerged for the fraction of noisy OTUs among single units.

The practical guidance that follows is a gradient of trust. Cliques, in which every read connects to every other, are the rarest and most reliable units, though only four were found across all 32 samples. Single OTUs without noise, whose SBM parameters stay below eight, below the barcoding gap of nine, can be used as such for ecological studies. Composed OTUs, which are very likely spurious mergers reflecting the inadequacy of a single barcoding gap for the largest clusters, should be post-treated with classical clustering or community detection tools to be reshaped into smaller, more reliable units. Single OTUs with noise, whose quality remains to be tested across a wider diversity of organisms, sit in between and deserve further scrutiny.

In an era when sequencing pipelines stream millions of reads faster than any expert can inspect them one by one, the appeal of this approach lies in its automation and its transparency. Every step, from the theta statistic to the SBM features and the SVM frontier, is elementary enough to be implemented in Python or R, and the associated code is openly available on the forgemia platform of INRAE. Used as a quality filter within a pipeline, the method promises to strengthen the foundations of molecular ecology, letting researchers know which OTUs can carry the weight of a biodiversity inventory and which ones need reshaping before any ecological conclusion is drawn from them.

Subject of Research: An automatic method for evaluating the quality of Operational Taxonomic Units in metabarcoding data based on dissimilarity arrays

Article Title: Simple approaches for evaluation of OTU quality based on dissimilarity arrays

Article References: Cros, M.-J., Frigerio, J.-M., Peyrard, N., & Franc, A. (2024). Simple approaches for evaluation of OTU quality based on dissimilarity arrays. Metabarcoding and Metagenomics, 8, Article e108649. https://doi.org/10.3897/mbmg.8.108649

Image Credits: AI Generated

DOI: 10.3897/mbmg.8.108649

Keywords: metabarcoding, OTU quality, dissimilarity arrays, diatoms, Arcachon Bay, barcoding gap, Stochastic Block Model, Support Vector Machine, chaining effect, biodiversity, rbcL marker, molecular ecology