Shrinking AI for the Farm: Distilled Neural Networks Bring Soil Nutrient Classification to the Edge

Artificial intelligence has transformed how farmers monitor their fields, but a stubborn bottleneck remains: most smart agriculture systems still ship their sensor data to distant cloud servers for analysis. That round trip costs time, bandwidth, and reliability, especially in rural areas where network connectivity can be intermittent. A new study published in Smart Agricultural Technology tackles this problem head-on, demonstrating how large tabular neural networks can be compressed through knowledge distillation and deployed directly on an edge device to classify soil nutrient availability in shallot cultivation.

The research, led by Freddy Artadima Silaban of Institut Teknologi Bandung and colleagues, was conducted at an experimental site in Tajur, Bogor, Indonesia. Over an 81-day shallot growing season from October to December 2025, an Internet of Things sensor network recorded ten variables across 300 polybags: soil moisture, soil temperature, soil pH, electrical conductivity, nitrogen, phosphorus, and potassium levels, along with light intensity, air temperature, and air humidity. The resulting datasets were substantial, comprising 269,080 observations for nitrogen, 286,232 for phosphorus, and 338,242 for potassium. Each observation was labeled low, medium, or high according to the nutrient treatment levels applied in the experimental design, with nitrogen dosages ranging from 0.7 to 2.8 grams, phosphorus from 0.8 to 3.2 grams, and potassium from 1.0 to 3.0 grams.

The team evaluated three neural architectures suited to tabular data: a conventional multilayer perceptron, TabTransformer, which uses attention mechanisms to learn contextual relationships between features, and TabNet, which applies sequential attention for adaptive feature selection. The TabTransformer teacher model, with roughly 830,000 parameters, was the largest of the three, while the MLP teacher contained about 69,000 parameters and TabNet about 116,000. Rather than relying on a single training run, the researchers trained every model across five fixed random seeds and evaluated results on a chronological data split, in which the first 70 percent of dates were used for training, the next 15 percent for validation, and the remainder for testing. This temporal split prevents information from the future leaking into training, a critical safeguard when working with time-stamped sensor data.

The heart of the study is knowledge distillation, a compression technique in which a compact student model is trained to mimic the output distribution of a larger teacher model. The researchers froze each teacher’s parameters and trained a smaller student from the same architectural family using a combined loss function: 60 percent weight on standard cross-entropy against the true labels and 40 percent weight on Kullback-Leibler divergence against the teacher’s softened probability distribution, generated with a temperature of 4.0. The softening spreads the teacher’s confidence across classes, revealing not just what the teacher predicted but how certain it was about alternatives, information that helps the smaller student generalize. The compression results were dramatic. The MLP student shrank to just 1,795 parameters, a 38.65-fold reduction; the TabTransformer student dropped to 109,891 parameters, a 7.55-fold reduction; and the TabNet student reached 10,484 parameters, an 11.04-fold reduction.

The accuracy story, however, was more nuanced. For the nitrogen dataset, the TabNet teacher achieved the highest average accuracy at 91.26 percent, while the distilled TabTransformer student reached 84.99 percent. On the potassium dataset, the distilled TabTransformer student actually outperformed its teacher, achieving 54.55 percent accuracy. But in other configurations, distillation offered no clear benefit: for phosphorus, the distilled MLP and TabNet students fell 5.04 and 5.36 percentage points below their teachers, with confidence intervals lying entirely below zero. The authors are candid about this variability, noting that knowledge distillation does not establish a uniform pattern of improvement across all dataset and architecture combinations. What the technique reliably delivers is a far smaller model, and in several cases the distilled students matched or exceeded both their teachers and control students trained from scratch with identical architectures.

A particularly revealing part of the study is the feature ablation analysis, which probed what the models were actually learning. The researchers systematically removed individual features and measured the impact on accuracy. Surprisingly, removing the target nutrient channel itself, such as nitrogen readings from the nitrogen dataset, produced almost no change in performance. Even removing all three NPK channels together changed accuracy only slightly. Accuracy collapsed only when the models were restricted to nutrient and electrical conductivity inputs alone, with drops of roughly 14 to 32 percentage points. This demonstrates that the classification signal is distributed across the full combination of soil and environmental variables rather than residing in any single sensor channel. The authors caution that the low, medium, and high labels represent experimental treatment levels, not laboratory-verified nutrient availability, so the models classify treatment status rather than replacing chemical soil analysis.

Before deployment, the team verified that the conversion pipeline preserved predictions exactly. Models were exported from PyTorch to the Open Neural Network Exchange format and then compiled into TensorRT engines on the target hardware in three numerical precision configurations: FP32, FP16, and INT8. All 27 engine combinations, spanning three datasets, three architectures, and three precision levels, achieved 100 percent prediction agreement with the original models, with maximum logit errors in the range of one millionth to nearly one ten-thousandth. INT8 calibration used 4,096 samples drawn deterministically from training data only, keeping test data untouched. On the test set, INT8 precision maintained identical accuracy and macro-F1 scores to FP32 in every configuration, while FP16 shifted accuracy by at most 0.01 percentage points.

The edge inference benchmarks on an NVIDIA Jetson Orin NX, running in its 15-watt power mode, revealed striking differences between architectures. The distilled MLP was the clear efficiency champion, with mean latencies between 0.128 and 0.262 milliseconds and throughputs reaching nearly 7,600 samples per second, consuming roughly 1 millijoule per inference. The TabTransformer and TabNet students required roughly 4 to 6 millijoules per inference with latencies around 0.7 to 2 milliseconds. Notably, lower numerical precision did not always translate to faster inference: FP16 consistently reduced tail latency for TabTransformer, cutting the p99 latency for the nitrogen task from 8.5 milliseconds to 2.7 milliseconds, but INT8 sometimes increased latency for TabNet, reaching nearly 10.2 milliseconds on the potassium task. All 27 configurations passed a 300-second continuous inference stability test without failures or prediction mismatches, with GPU temperatures holding steady between 61 and 64 degrees Celsius.

The study also benchmarked the neural models against classical gradient-boosting baselines: XGBoost, LightGBM, and CatBoost, evaluated with the same seeds and temporal split. For nitrogen, LightGBM and CatBoost remained highly competitive, with CatBoost reaching 90.34 percent accuracy. For potassium, however, the distilled TabTransformer student outperformed all classical baselines on accuracy and macro-F1, though CatBoost achieved higher balanced accuracy. On the edge device, LightGBM and CatBoost achieved sub-millisecond p99 latencies on a single CPU thread, while XGBoost was considerably slower and more energy-hungry. The authors emphasize that the neural models ran on TensorRT GPU acceleration while the baselines used native CPU execution, so the deployment comparison reflects measured performance on the same hardware rather than identical computing backends.

The broader significance of this work lies in its honest, multi-dimensional evaluation framework. Rather than chasing a single accuracy figure, the researchers simultaneously assessed predictive robustness across seeds, compression ratios, feature dependencies, conversion fidelity, numerical precision, latency, throughput, energy consumption, and stability. Their conclusion is measured: knowledge distillation reliably shrinks tabular neural models for edge deployment, but its accuracy benefits depend on the interplay of dataset and architecture, and classical baselines remain formidable competitors that should never be dismissed. The team acknowledges limitations, including the absence of polybag identifiers for grouped evaluation, the lack of laboratory validation of nutrient labels, and the brevity of the 300-second stability tests. Future work, they suggest, should partition data by physical growing unit, validate labels through laboratory analysis, and conduct long-term field trials measuring thermal behavior and energy consumption under real operating conditions. For precision agriculture, the message is clear: the era of running meaningful AI directly in the field, without the cloud, is arriving one compressed model at a time.

Subject of Research: Knowledge distillation and edge deployment of tabular neural networks for classifying soil nutrient availability in shallot cultivation

Article Title: Knowledge distillation and edge deployment of tabular neural models for soil nutrient availability status classification

Article References: Silaban, F. A., Trilaksono, B. R., Mahayana, D., Maharijaya, A., Gunawan, E., Rosliani, R., & Prathama, M. (2026). Knowledge distillation and edge deployment of tabular neural models for soil nutrient availability status classification. Smart Agricultural Technology, 15, Article 102580. https://doi.org/10.1016/j.atech.2026.102580

Image Credits: AI Generated

DOI: 10.1016/j.atech.2026.102580

Keywords: knowledge distillation, edge AI, precision agriculture, soil nutrients, TabTransformer, TabNet, NVIDIA Jetson Orin NX, TensorRT, IoT sensors, model compression, shallot cultivation, tabular deep learning