The technical heart of the system is a customised deep learning model the team named RGD-YOLO. It builds on the YOLOv10m object detection architecture, which combines feature pyramids and multi-scale training to spot small objects, and adds two purpose-designed modules. The first, a C2f_FADC block based on frequency-adaptive dilated convolution, adaptively widens the model’s receptive field so that it preserves the high-frequency signals that mark grain edges and texture while suppressing low-frequency background noise from stems and reflections. The second, an SPPF-LSKA block, applies large-kernel depthwise convolutions with spatial attention, allowing the network to lock onto individual grains even when spikelets are densely packed and partially hidden. In attention heatmaps, the baseline YOLOv10m model tended to light up grain edges and panicle tips when grains overlapped, effectively guessing from peripheral cues, whereas RGD-YOLO continued to focus squarely on the grains themselves. In ablation tests, these modifications pushed the model’s strict COCO-benchmark detection score (mAP@0.5–0.95) to 82.2 percent, with precision of 98.97 percent and recall of 98.54 percent, while keeping the model a compact 34.6 megabytes — small enough for practical cloud deployment.

Detection alone is not enough, however, because meaningful measurements of grain length, width, perimeter, roundness, and seed-coat colour can only be taken from grains whose full outlines are visible. To solve this, the researchers paired a fine-tuned EfficientNet classifier with the Felzenszwalb superpixel segmentation algorithm. Each grain detected by RGD-YOLO is converted into a pseudo-coloured image using Otsu thresholding and JET colour mapping, segmented at a systematically optimised ratio, and then judged by the classifier as either a complete “whole grain” or an occluded fragment. Out of 885,011 grains detected across the study’s image collection, the pipeline confidently identified 77,812 whole grains. Those grains, together with their occluded counterparts, form the backbone of a new publicly released training resource called the World Rice Grain Dataset, or WRGD, which began with 50,000 whole grains and 50,000 occluded grains after augmentation and now contains 77,812 verified whole-grain images spanning 864 landraces.

The imaging workflow underlying the platform is deliberately frugal. Field workers place a rice panicle on a black matte board alongside a red reference label and a QR code, then photograph it from about half a metre above with an ordinary mid-range Android phone — Xiaomi Mi 11, Huawei Nova 7 SE, and vivo Y50 handsets were all used across the study, demonstrating that sensor differences between manufacturers do not break the analysis. The QR code carries accession metadata, the red label calibrates colour and provides a pixel-to-millimetre conversion factor, and histogram matching against a benchmark image harmonises exposure across devices. Roughly 64 gigabytes of imagery — 10,837 photographs covering 322 landraces in the 2020 season and 709 in 2022, plus 176 recombinant inbred lines — were collected at a throughput of about fifteen seconds per panicle, with no specialised camera, scanner, or lighting rig required.

The platform itself is hosted openly at rgpas.cemps.ac.cn and built on the Django framework following a Model-View-Controller architecture, with a logic layer for workflow control, an AI model layer housing the trained detectors, a service layer for visualisation and storage, and a MySQL-backed digital grain library. Users can run single-image analysis for quick grain counting, batch-process entire image series for panicle- and grain-level statistics, and browse a searchable database containing genotypic and phenotypic records for 864 landraces and 176 recombinant inbred lines, drawn from 1092 panicle images and 108,547 whole grain images. Registration is restricted to academic email addresses, results export to CSV, and the interface works in both English and Chinese. The source code and trained models are maintained on GitHub, and the WRGD dataset is archived at the EBI BioImage Archive, a level of openness the authors argue is essential for reproducibility.

To prove the platform’s numbers can be trusted, the team validated RGPAS-derived traits against ground truth in two ways: manual counting of grains per panicle on 1012 lines by field specialists, and benchmark measurements from a commercial SC-E rice appearance quality analyzer for grain size, shape, and colour traits. The agreement was strong, and the phenotypic distributions the platform produced matched well-established biology — indica varieties showed roughly 10 percent greater grain perimeter and longer, more slender grains, while japonica grains were shorter and wider, with overall grain size remaining statistically similar between the subspecies. When applied to the 176 recombinant inbred lines, a population the detection model had never seen during training, the platform again produced clean, near-Gaussian trait distributions, indicating that its generalisation was not an artefact of overfitting to the landrace panel.

The most consequential test, though, was whether photographs processed in the cloud could feed genuine genetics. For genome-wide association studies, the team drew on high-depth whole-genome resequencing data at roughly 14-fold coverage, filtering variants to retain 3,583,878 high-confidence biallelic SNPs and running the EMMAx mixed-model pipeline on 322 landraces from 2020 and 709 from 2022. The results were striking. RGPAS-derived grain length-to-width ratio pointed squarely at GS3 on chromosome 3 and GW5 on chromosome 5, the two canonical regulators of rice grain shape, with association signals reaching −log10P values above 26 in the 2022 data — and the same loci appeared when the traits were measured conventionally after harvest. Grain length analyses recovered GS3, OsSPL13, TGW6, and the flowering regulator Hd1; grain width recovered GW5, GW7, GE, and GW2; and grain number per panicle associated with OsCKX2, GS5, GRF4, OsMADS1, TGW6, and GATA28, among others. Even seed-coat colour, quantified from the images’ green channel, mapped to the Rc and Rd genes that govern pericarp pigmentation and proanthocyanidin biosynthesis in red- and black-grained rice.

Quantitative trait locus mapping in the recombinant inbred lines, built on a genetic map of 1,148 recombination bins spanning 2,499 centimorgans, reinforced the picture. RGPAS-derived traits detected QTLs containing D61, Sd1, GS3, GW5, OsMADS50, and OsMADS56, and — in a notable detail — the computational grain number trait recovered a locus near Hd1 on chromosome 6 that the manually counted trait failed to detect, while manual scoring alone picked up GAD1 on chromosome 8. Both approaches independently flagged an unknown locus on chromosome 11 explaining about 10 percent of phenotypic variation, and a second unknown locus on chromosome 6 explaining 9.3 percent of grain width variation, both flagged as promising candidates for future fine-mapping. The researchers note that loci consistently detected across both the 2020 and 2022 seasons, and across both the landrace and RIL populations, were treated as high-confidence associations, with quantile-quantile plot inspection confirming that genomic inflation reflected a handful of strong-effect loci rather than systematic confounding.

The team is candid about the platform’s limits. Cloud operation requires a stable internet connection, performance can suffer under concurrent load or limited bandwidth, and traits such as seed-setting rate, plump-to-shrivelled grain ratios, and spatial grain-filling patterns remain beyond its current scope. Looking forward, the authors envision edge-cloud hybrid computing that would keep AI analysis running smoothly in fields with patchy connectivity, integration of environmental data into an interconnected genotype–environment–phenotype framework, extension to panicle architecture traits such as branch number and grain distribution, and — thanks to the system’s modular design — straightforward adaptation to other cereals, including wheat and maize. For now, though, the significance of the work is hard to overstate. By chaining together a cheap smartphone, a lean and purpose-built neural network, and free cloud infrastructure, RGPAS lowers the cost of high-quality phenotyping to near zero and hands plant breeders a direct pipeline from a photo in the field to a candidate gene on the genome — precisely the kind of tool that grain-focused crop improvement, under the pressures of a changing climate, has been waiting for.